Sunday, May 26, 2024
ad
HomeNewsCM3Leon Performs Better Despite Being Trained with Five Times Less Compute, Says...

CM3Leon Performs Better Despite Being Trained with Five Times Less Compute, Says Meta

Meta AI used a dataset of millions of licensed images from Shutterstock to train CM3Leon.

Last month, a multimodal model called CM3Leon was released by Meta AI, which performs both text-to-image and image-to-text creation tasks. CM3Leon can also understand instructions to edit existing images. 

Yesterday, Meta took to Twitter to reiterate that the model manages to demonstrate cutting-edge performance for text-to-image generation despite having been trained with five times less computing than previously used transformer-based methods.

The transformer model CM3Leon uses a concept called “attention” to evaluate the usefulness of input data like text or graphics. Model training speed can be increased, and models can be more easily parallelized, thanks to “attention” and other architectural peculiarities of transformers. With significant but not insurmountable increases in computation, larger transformers can be easily trained.

Read More: OpenAI’s Sam Altman Launches Cryptocurrency Project Worldcoin

According to the blog post by the company, CM3leon is a first-of-its-kind multimodal model that achieves state-of-the-art performance for text-to-image generation despite being trained with five times less computing than previous transformer-based methods. It also has the versatility and effectiveness of autoregressive models while incurring low training costs and inference efficiency. 

According to the company, Meta AI used a dataset of millions of licensed images from Shutterstock to train CM3Leon. The most capable of several versions of CM3Leon that Meta has built has 7 billion parameters, which is over twice as many as DALL-E 2.

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our WhatsApp Channel and Discord Server to be a part of an engaging community.

Sahil Pawar
Sahil Pawar
I am a graduate with a bachelor's degree in statistics, mathematics, and physics. I have been working as a content writer for almost 3 years and have written for a plethora of domains. Besides, I have a vested interest in fashion and music.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular