Tuesday, June 18, 2024
HomeNewsAutodesk created a Deep Learning framework to build 3D lego kits

Autodesk created a Deep Learning framework to build 3D lego kits

The novel learning-based framework can interpret 2D instructions to build 3D objects.

Researchers at Stanford University, MIT’s Computer and AI lab, and the Autodesk AI Lab have created a deep learning framework to construct 3D objects. The Manual-to-Executable-Plan Network (MEPNet) framework was tested on Lego sets generated by computers. The training included genuine Lego set instructions and Minecraft-style voxel building plans. 

Existing methods of rendering 3D objects are simple but computationally expensive and not very good at handling unseen shapes. Additionally, a few problems surface when existing AI techniques interpret 2D instructions to transform them into 3D. Visual instructions like Lego sets consist entirely of images; hence, identifying differences between 2D and 3D can become complex because they are usually assembled. 

The researchers said, “This increases the difficulty for machines to interpret Lego manuals: it requires inferring 3D poses of unseen objects composed of seen primitives.”

Read More: Meta AI releases Implicitron for representations in PyTorch3D

MEPNet combines the existing upsides and new 3D rendering techniques by starting with a 3D model of components, Lego set, and 2D manual images. It predicts a set of 2D keypoints and masks each component. 

After masking, 2D keypoints are “back-projected to 3D by finding possible connections between the base shape and the new components.” The team said the combination “maintains the efficiency of learning-based models.”

All you have to do is interpret MEPNet’s 3D renderings, which would hopefully be easier than flat-pack furniture instructions. You can test MEPNet here if you are familiar with PyTorch.

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our WhatsApp Channel and Discord Server to be a part of an engaging community.

Disha Chopra
Disha Chopra
Disha Chopra is a content enthusiast! She is an Economics graduate pursuing her PG in the same field along with Data Sciences. Disha enjoys the ever-demanding world of content and the flexibility that comes with it. She can be found listening to music or simply asleep when not working!


Please enter your comment!
Please enter your name here

Most Popular