Real-time music generation with MusicFX DJ

MusicFX Try it →Watch full video →Jacob Collier · Oct 2024

Demo summary

Jacob Collier introduces the MusicFX DJ interface, demonstrating how to blend multiple instrument prompts like Irish fiddle, djembe, and sitar while adjusting the 'chaos' and 'density' sliders to shape the sound in real-time.

Step-by-step

Clear any existing prompts to start from scratch
Enter instrument or style prompts into the text fields
Press play to begin the continuous stream
Adjust the individual volume sliders for each prompt to blend the sounds
Use the chaos module to toggle between stable and unpredictable sounds
Adjust the density slider to control the choppiness or smoothness of the output
Use the spectral shape controls to adjust the general EQ of the mix

Options

Share the page link to allow others to interact with the tool
Input abstract prompts like 'cello frenzy' or specific instruments like 'Irish fiddle'

Tips

Think of using the tool like arranging or painting, shaping the overall landscape of the sound in real-time
Use the density slider on the 'smoothness' setting to achieve gliding sounds
Experiment with high chaos settings to generate unusual, non-human sounds

Highlights

“this is like this continuous thing I've spent like hours in this thing just sort of like riffing”

All demos from “Jacob Collier x MusicFX DJ”

2:423:51Real-time music generation with MusicFX DJCurrentJacob Collier introduces the MusicFX DJ interface, demonstrating how to blend multiple instrument prompts like Irish fiddle, djembe, and sitar while adjusting the 'chaos' and 'density' sliders to shape the sound in real-time.MusicFX· AI Music Generator
6:433:56Prompting and blending abstract soundsThe demo continues as Jacob adds user-suggested prompts like '808', 'saxophone', and 'otamatone' to MusicFX DJ, showing how the model interprets specific instruments and abstract concepts into a continuous audio stream.MusicFX· AI Music Generator
12:180:48Downloading and exporting AI samplesJacob demonstrates the workflow for capturing a specific moment of the AI generation, showing how to download a 60-second clip from MusicFX DJ to be used in a Digital Audio Workstation (DAW).MusicFX· AI Music Generator
36:392:25BPM syncing and stem muting in MusicFX DJJacob shows how to set a specific BPM (104) within the tool and uses the stem muting feature to isolate percussion elements from the AI-generated mix.MusicFX· AI Music Generator
42:274:30Generating cinematic and orchestral texturesThe demonstration shows the tool's ability to generate heavy cinematic sounds using prompts like 'disgustingly huge vast disruptive' and 'taiko drums', followed by a download of the resulting audio.MusicFX· AI Music Generator
1:15:532:17Generating melodic bells and texturesJacob prompts the AI for 'glockenspiel' and 'London bells', demonstrating the tool's interpretation of melodic and environmental sounds which he then exports for his track.MusicFX· AI Melody & MIDI Generator
Watch “Jacob Collier x MusicFX DJ” →

AI Music Generator

2:423:51Real-time music generation with MusicFX DJCurrentJacob Collier introduces the MusicFX DJ interface, demonstrating how to blend multiple instrument prompts like Irish fiddle, djembe, and sitar while adjusting the 'chaos' and 'density' sliders to shape the sound in real-time.Jacob Collier
6:433:56Prompting and blending abstract soundsThe demo continues as Jacob adds user-suggested prompts like '808', 'saxophone', and 'otamatone' to MusicFX DJ, showing how the model interprets specific instruments and abstract concepts into a continuous audio stream.Jacob Collier
12:180:48Downloading and exporting AI samplesJacob demonstrates the workflow for capturing a specific moment of the AI generation, showing how to download a 60-second clip from MusicFX DJ to be used in a Digital Audio Workstation (DAW).Jacob Collier
36:392:25BPM syncing and stem muting in MusicFX DJJacob shows how to set a specific BPM (104) within the tool and uses the stem muting feature to isolate percussion elements from the AI-generated mix.Jacob Collier
42:274:30Generating cinematic and orchestral texturesThe demonstration shows the tool's ability to generate heavy cinematic sounds using prompts like 'disgustingly huge vast disruptive' and 'taiko drums', followed by a download of the resulting audio.Jacob Collier
0:000:13Generate music from text prompts with MusicFX DJJacob Collier inputs a series of descriptive words like 'crash', 'bang', and 'high chaos' into MusicFX DJ to generate a real-time stream of experimental sounds.Google
1:120:49Interpret instruments and export audio in MusicFX DJThe tool interprets the prompt 'Charango' to generate a jangling sound cloud, which is then downloaded and dragged into a digital audio workstation for looping.Google
0:311:04Generate music loops with Google MusicFXThe user demonstrates entering a text prompt for '90s boom bap' into Google MusicFX, adjusting loop settings, and generating two audio variations.Rock Trembath
1:350:50Creating music variations in MusicFXThe user shows how to use the interface cards to quickly create a variation of a previous track by changing the prompt to '2000s Trap with a saxophone'.Rock Trembath
3:441:46Live mixing with MusicFX DJThe user demonstrates the MusicFX DJ interface by adding custom prompts like 'Snare roll', sliding tracks in and out on the beat, and adjusting effects like brightness and chaos in real-time.Rock Trembath
0:042:55Mixing AI music in real-time with MusicFX DJThe user demonstrates how to operate the MusicFX DJ interface by adjusting sliders for different genres like 'trap beat', adding random prompts with the die icon, and modifying audio parameters like density, brightness, and chaos. He also shows how to mute specific tracks (drums, base) and adjust the BPM to see how the AI regenerates the audio live.Excelerator
1:062:43Generate music with text descriptions in MusicFXThe user demonstrates entering a 'Japanese city pop' prompt into MusicFX, selecting instrument recommendations like saxophone, and generating/playing the resulting audio tracks.AsapGuide