Generate music from text prompts with MusicFX DJ

Demo summary
Jacob Collier inputs a series of descriptive words like 'crash', 'bang', and 'high chaos' into MusicFX DJ to generate a real-time stream of experimental sounds.
Step-by-step
- Enter descriptive keywords into the text prompt field
- Click the Go button to generate the audio stream
Tips
- Use abstract or onomatopoeic words like 'crash', 'bang', and 'splurge' to influence the sound texture
- Combine descriptors like 'high chaos' and 'choppy density' to create experimental soundscapes
Highlights
“Oh I like that. Ah, I love it so much!”
All demos from “Jacob Collier x Music AI LIVE | Google Lab Sessions”
0:000:13Generate music from text prompts with MusicFX DJCurrentJacob Collier inputs a series of descriptive words like 'crash', 'bang', and 'high chaos' into MusicFX DJ to generate a real-time stream of experimental sounds.MusicFX· AI Music Generator
1:120:49Interpret instruments and export audio in MusicFX DJThe tool interprets the prompt 'Charango' to generate a jangling sound cloud, which is then downloaded and dragged into a digital audio workstation for looping.MusicFX· AI Music Generator- Watch “Jacob Collier x Music AI LIVE | Google Lab Sessions” →
AI Music Generator
2:423:51Real-time music generation with MusicFX DJJacob Collier introduces the MusicFX DJ interface, demonstrating how to blend multiple instrument prompts like Irish fiddle, djembe, and sitar while adjusting the 'chaos' and 'density' sliders to shape the sound in real-time.Jacob Collier
6:433:56Prompting and blending abstract soundsThe demo continues as Jacob adds user-suggested prompts like '808', 'saxophone', and 'otamatone' to MusicFX DJ, showing how the model interprets specific instruments and abstract concepts into a continuous audio stream.Jacob Collier
12:180:48Downloading and exporting AI samplesJacob demonstrates the workflow for capturing a specific moment of the AI generation, showing how to download a 60-second clip from MusicFX DJ to be used in a Digital Audio Workstation (DAW).Jacob Collier
36:392:25BPM syncing and stem muting in MusicFX DJJacob shows how to set a specific BPM (104) within the tool and uses the stem muting feature to isolate percussion elements from the AI-generated mix.Jacob Collier
42:274:30Generating cinematic and orchestral texturesThe demonstration shows the tool's ability to generate heavy cinematic sounds using prompts like 'disgustingly huge vast disruptive' and 'taiko drums', followed by a download of the resulting audio.Jacob Collier
0:000:13Generate music from text prompts with MusicFX DJCurrentJacob Collier inputs a series of descriptive words like 'crash', 'bang', and 'high chaos' into MusicFX DJ to generate a real-time stream of experimental sounds.Google
1:120:49Interpret instruments and export audio in MusicFX DJThe tool interprets the prompt 'Charango' to generate a jangling sound cloud, which is then downloaded and dragged into a digital audio workstation for looping.Google
0:311:04Generate music loops with Google MusicFXThe user demonstrates entering a text prompt for '90s boom bap' into Google MusicFX, adjusting loop settings, and generating two audio variations.Rock Trembath
1:350:50Creating music variations in MusicFXThe user shows how to use the interface cards to quickly create a variation of a previous track by changing the prompt to '2000s Trap with a saxophone'.Rock Trembath
3:441:46Live mixing with MusicFX DJThe user demonstrates the MusicFX DJ interface by adding custom prompts like 'Snare roll', sliding tracks in and out on the beat, and adjusting effects like brightness and chaos in real-time.Rock Trembath
0:042:55Mixing AI music in real-time with MusicFX DJThe user demonstrates how to operate the MusicFX DJ interface by adjusting sliders for different genres like 'trap beat', adding random prompts with the die icon, and modifying audio parameters like density, brightness, and chaos. He also shows how to mute specific tracks (drums, base) and adjust the BPM to see how the AI regenerates the audio live.Excelerator
1:062:43Generate music with text descriptions in MusicFXThe user demonstrates entering a 'Japanese city pop' prompt into MusicFX, selecting instrument recommendations like saxophone, and generating/playing the resulting audio tracks.AsapGuide
MusicFX