Sunday, July 21, 2024
HomeNewsMeta launches AI software tool AITemplate to switch between underlying chips

Meta launches AI software tool AITemplate to switch between underlying chips

Meta said its open-source AI platform AITemplate is based on a machine learning framework called PyTorch.

Meta AI has developed and is open-sourcing AITemplate (AIT), a unified inference system with separate acceleration back-ends for both AMD and NVIDIA GPU hardware. 

AITemplate delivers close to hardware-native Tensor Core (NVIDIA GPU) and Matrix Core (AMD GPU) performance on various widely used AI models such as convolutional neural networks, transformers, and diffusers. With AIT, it is now possible to run performant inference on hardware from both GPU providers. 

Meta said its open-source AI platform is based on an open-source machine learning framework called PyTorch. According to Meta, AITemplate can help code run up to 12 times faster on Nvidia’s A100 chip or up to 4 times faster on Advanced Micro Devices (AMD) MI250 chip.

Read More: NVIDIA Unveils New GeForce Series Of Graphics Chip That Uses Enhanced AI

The software has become a battleground for chipmakers looking to build up an ecosystem of developers that utilize their chips. Nvidia’s CUDA platform continues to be the most popular so far for AI work.

Once developers tailor their code for Nvidia chips, running it on graphics processing units or GPUs from Nvidia competitors like AMD is not easy. AITemplate is designed to quickly swap between chips without being locked in, Meta said in a blog post.

Meta said that the GPU back-end support gives deep learning developers more hardware vendor choices with minimal migration costs. The company added that proprietary software toolkits such as TensorRT provide ways of customization, but they are often insufficient to satisfy software developers’ needs. AITemplate can help with that. 

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our WhatsApp Channel and Discord Server to be a part of an engaging community.

Sahil Pawar
Sahil Pawar
I am a graduate with a bachelor's degree in statistics, mathematics, and physics. I have been working as a content writer for almost 3 years and have written for a plethora of domains. Besides, I have a vested interest in fashion and music.


Please enter your comment!
Please enter your name here

Most Popular