Friday, March 29, 2024
ad
HomeNewsPoint-E, OpenAI’s New Open-Source AI That Generates 3D Models

Point-E, OpenAI’s New Open-Source AI That Generates 3D Models

OpenAI introduced its new open-source AI generator that generates 3D models based on text prompts. Point-E, a machine learning system, differs from other traditional 3D generators because it uses discrete data points to represent 3D shapes rather than create them. 

3D modeling is a highly applicable technology in movies, video games, AR, VR, metaverse, etc. However, producing photorealistic 3D graphics still requires a lot of resources and effort, and doing so using text prompts is a further achievement.

Taking inspiration from the recently viral text-to-image systems like DALL-E, Lensa, and HuggingFace’s Stable Diffusion, Point-E attempts to enhance text-to-3D technology. Point-E, or Point Efficiency, uses point clouds as they are easily synthesized in terms of computational requirements. Unlike existing systems like DreamFusion, Point-E does not require hours of GPU functions. However, its resolution is not that great.

Read More: Zhejiang, Among Other Chinese Provinces, to Build a US$28.7b Industry Metaverse by 2025

OpenAI’s research team, led by Alex Nichol, said, “Other systems leverage a large corpus of (text, image) pairs, allowing it to follow diverse and complex prompts, while our image-to-3D model is trained on a smaller dataset of (image, 3D) pairs.”

When prompted with a text, Point-E first creates a synthetic 3D rendering. It will then run this version through a series of diffusion models to generate a 3D, RGB, 1024-point cloud model. The next step generates a finer version of the same, with 4096 points. Each of these diffusion models was developed using “millions” of 3D models that had all been transformed into a standardized format.


OpenAI has released the source code on Github, along with the research paper.

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our WhatsApp Channel and Discord Server to be a part of an engaging community.

Disha Chopra
Disha Chopra
Disha Chopra is a content enthusiast! She is an Economics graduate pursuing her PG in the same field along with Data Sciences. Disha enjoys the ever-demanding world of content and the flexibility that comes with it. She can be found listening to music or simply asleep when not working!

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular