A new open-source AI tool called AudioCraft has been made available by Meta. According to the Meta AI, this programme is made to let both experienced artists and non-professionals generate audio and music using straightforward text prompts.
MusicGen, AudioGen, and EnCodec are the three models that make up AudioCraft. MusicGen can create music from text inputs and was trained using Meta‘s own music library. On the other hand, AudioGen is skilled at creating sound effects for the general public and can produce audio from text inputs. The EnCodec decoder has also been upgraded, enabling the creation of music with higher quality and less undesired artefacts.
Users will be able to create environmental noises and sound effects like dogs barking, automobiles honking, or footsteps on a wooden floor, thanks to Meta’s pre-trained AudioGen models. In addition, Meta is giving the code and all of the model weights for the AudioCraft tool. Applications for this new tool include audio production, sound effect creation, compression methods, and composition of music.
Read More: OpenAI’s Sam Altman Launches Cryptocurrency Project Worldcoin
Meta wants to make it possible for researchers and professionals to train their own models using their own datasets by making these models open-source. According to Meta, generative AI has advanced significantly in the areas of graphics, video, and text but not as much in audio. By offering a more approachable and user-friendly framework for producing high-quality audio, AudioCraft fills this gap.
According to Meta’s official blog, modeling complicated signals and patterns at many scales makes producing realistic and high-fidelity music particularly difficult. Since music is made up of both local and long-range patterns, it provides a special problem for audio generation.
Extended high-quality audio production is possible using AudioCraft. The company argues that by making the building of generative models for audio simpler, users will find it easier to play with the models that are already in place.
