Table of Contents
AI Music Maestro Work: The MusicLM AI empowers users to craft 20-second musical compositions with the aid of Instrument Playground, an innovative experimental tool. This cutting-edge tool enables users to incorporate a vast array of 100 distinct musical instruments sourced from various corners of the globe.
MusicLM has the capability to pair the sound of the instrument with descriptive words such as “cheerful” or “romantic” in order to produce a distinct sound. In addition, for musicians who possess more expertise, this tool offers a sequencer that enables the formation of layers and loops using up to four distinct generated instruments, each possessing its own unique sound.
Global Music Exploration with AI Music Maestro
Google claims that the initial objective of Instrument Playground was to delve into a MusicLM-driven interface that would foster innovation and the exploration of musical instruments from various cultures across the globe.
Google has expressed its stance on AI regulation in Europe, while simultaneously introducing a fresh ‘AI-powered experiment’ centered around AI Music Maestro. This endeavor, known as ‘Instrument Playground’, has been developed by Google’s Arts & Culture Lab team and utilizes the MusicLM model, which was previously launched by the company earlier this year.
The introduction states, “Have you ever experienced playing the Veena from India, the Dizi from China, or the Mbria from Zimbabwe?” Furthermore, it offers the opportunity to select any instrument from a collection of over 100 worldwide options, and MusicLM will produce a 20-second sound clip.
Additionally, individuals have the option to include adjectives such as moody, happy, or romantic in their prompts before playing the generated sound clip.
Enhanced Atmospheres in Instrument Playground
Additionally, the prompt can be enhanced with an adjective to evoke a specific atmosphere, as mentioned by the company. By adding words like “Happy,” the Instrument Playground will produce a lively track, while “Merry” will result in a more festive composition. Moreover, users have the option to incorporate sound effects by selecting from three modes: Ambient, Beat, and Pitch.
For those with an AI Music Maestro inclination, the Advanced mode allows the activation of a sequencer, enabling the combination of up to four distinct AI instruments into a single song.
Instrument Playground is part of a larger collection of AI-driven experiments introduced by Google. One notable project within this collection is ‘Viola the Bird,‘ which we previously highlighted in July as the pioneering ‘bird-tuoso’ in the realm of string instruments. Additionally, a few years ago, Google unveiled the captivating ‘Blob Opera’ experiment.
Currently, Instrument Playground is exclusively accessible in specific countries, excluding the UK where AI Music Maestro Ally is located. However, it is expected to expand its availability to more countries in the upcoming months.
Instrument Selection and Song Customization Options
Upon accessing the website, you will be prompted to select your desired instrument to play. In case you find it difficult to make a decision, there is a link provided below the prompt that will lead you to a list of 65 different instruments. We specifically requested an energetic electric guitar, and to our surprise, the AI incorporated backup vocals into the riff, to some extent.
However, most of the lyrics are unintelligible gibberish, although Chrome’s Live Caption feature apparently detected the word “Satan” within them. The generated song will play once, but you have the option to replay it at any time by clicking the Help icon. Subsequently, you can utilize the on-screen keyboard to further work on the track.
The available keys are limited to 12, centered around the C Major and C Minor scales. The layout on the page corresponds directly to the numbers on a computer keyboard, enabling you to use them instead of manually clicking each key with a mouse.
Instrument Playground is an extension of Google’s MusicLM initiative, an advanced artificial intelligence model that can generate top-quality AI Music Maestro based on textual inputs. Google initially launched MusicLM in early 2023, highlighting its training on a massive dataset of 280,000 hours of music to compose songs from text messages.
Transforming Text into Musical Narratives with MusicLM
According to researchers, this model possesses the remarkable capability to convert a series of written descriptions into a captivating AI Music Maestro narrative. It builds upon existing melodies that can be expressed through whistling, humming, singing, or playing various instruments.
In order to empower users in creating AI Music Maestro from the ground up using a maximum of 100 instruments, Google undertook the task of training MusicLM with numerous hours of audio recordings for each of these instruments. Regardless of whether it is a viola, an ocarina, or a saxophone, the algorithm has been exposed to a substantial amount of performance data for these instruments to faithfully reproduce their unique sounds.
