Go to ChatGPT, there’s a new AI tool that can produce music (almost) out of thin air. After writing and creating art, the AI can now create music using just text messages. This is through Google’s new artificial intelligence system called MusicLM (Opens in a new tab) She can compose music of any kind.
Google describes MusicLM as “a model that generates high fidelity music from textual descriptions”. It can generate complex compositions at 24 kHz that remain consistent over several minutes. Text descriptions are very detailed and include style, genre, and even the mood and rhythm of the melody.
What’s amazing is that the AI manages to pick up on nuances like melodies and moods, too. You can listen to what AI-generated music sounds like Google search paper (Opens in a new tab).
This is not the first time that artificial intelligence has been used in the music industry. There have been several attempts such as Riffusion, Dance Diffusion, and Google-owned AudioML. Even OpenAI in ChatGPT has its own music called AI jukebox (Opens in a new tab). But they were not as successful as MusicLM in creating layered tones.
MusicLM has been trained on a dataset of 280,000 hours of music to create songs of a certain level of complexity. The AI takes descriptions and generates a “hierarchy-to-sequence modeling task” and can generate up to 5 minutes of musical narration based on the description’s length.
But there is one caveat. Google trained its AI on copyrighted music, and because of this, researchers found that 1% of examples could be associated with existing songs. This could raise many ethical concerns since AI can easily pick up copyrighted material, which is why Google won’t be releasing this AI any time soon.
The paper’s co-authors acknowledged this saying, “We strongly emphasize the need for more future work in addressing these risks associated with music generation.”
Google has made 5,500 example music text pairs available to anyone who wants to listen to MusicLM’s creations.
ChatGPT has taken the world by storm. from Pass complex law and medical exams (Opens in a new tab) to Writing CEO emails (Opens in a new tab) to Realtors are now using artificial intelligence to write real estate listingsChatGPT handles many highly skilled tasks. We may not get to see this kind of unknown growth for MusicLM since it won’t really launch, but it’s another big step in the progress of AI.
