Mixing AI music in real-time with MusicFX DJ

Demo summary
The user demonstrates how to operate the MusicFX DJ interface by adjusting sliders for different genres like 'trap beat', adding random prompts with the die icon, and modifying audio parameters like density, brightness, and chaos. He also shows how to mute specific tracks (drums, base) and adjust the BPM to see how the AI regenerates the audio live.
Step-by-step
- Click the play button to start the audio generation.
- Adjust the horizontal sliders between different genre prompts to blend the sounds.
- Click the die icon to add a random genre prompt to the mix.
- Click the trash can icon to remove a specific prompt from the interface.
- Adjust the Density, Brightness, and Chaos sliders at the bottom to modify audio characteristics.
- Mute specific elements like drums or bass using the toggle buttons.
- Click the BPM value to manually enter a new beats per minute and click Apply.
Options
- Type in your own custom prompts manually.
- Select suggested prompts from the bottom of the screen.
- Set Density, Brightness, and Chaos to Auto, Low, or High.
- Change the musical key of the generation.
Watch out for
- Adjusting the beats per minute (BPM) will restart the audio generation.
Tips
- Use the 'High Chaos' and 'High Density' settings together to create 'weird things'.
- If a mix feels overwhelming, try bringing specific genre sliders down or removing them entirely to find a better balance.
Highlights
“it comes out pretty cool you can just come down here click the play button and see what you're starting with”
AI Music Generator
2:423:51Real-time music generation with MusicFX DJJacob Collier introduces the MusicFX DJ interface, demonstrating how to blend multiple instrument prompts like Irish fiddle, djembe, and sitar while adjusting the 'chaos' and 'density' sliders to shape the sound in real-time.Jacob Collier
6:433:56Prompting and blending abstract soundsThe demo continues as Jacob adds user-suggested prompts like '808', 'saxophone', and 'otamatone' to MusicFX DJ, showing how the model interprets specific instruments and abstract concepts into a continuous audio stream.Jacob Collier
12:180:48Downloading and exporting AI samplesJacob demonstrates the workflow for capturing a specific moment of the AI generation, showing how to download a 60-second clip from MusicFX DJ to be used in a Digital Audio Workstation (DAW).Jacob Collier
36:392:25BPM syncing and stem muting in MusicFX DJJacob shows how to set a specific BPM (104) within the tool and uses the stem muting feature to isolate percussion elements from the AI-generated mix.Jacob Collier
42:274:30Generating cinematic and orchestral texturesThe demonstration shows the tool's ability to generate heavy cinematic sounds using prompts like 'disgustingly huge vast disruptive' and 'taiko drums', followed by a download of the resulting audio.Jacob Collier
0:000:13Generate music from text prompts with MusicFX DJJacob Collier inputs a series of descriptive words like 'crash', 'bang', and 'high chaos' into MusicFX DJ to generate a real-time stream of experimental sounds.Google
1:120:49Interpret instruments and export audio in MusicFX DJThe tool interprets the prompt 'Charango' to generate a jangling sound cloud, which is then downloaded and dragged into a digital audio workstation for looping.Google
0:311:04Generate music loops with Google MusicFXThe user demonstrates entering a text prompt for '90s boom bap' into Google MusicFX, adjusting loop settings, and generating two audio variations.Rock Trembath
1:350:50Creating music variations in MusicFXThe user shows how to use the interface cards to quickly create a variation of a previous track by changing the prompt to '2000s Trap with a saxophone'.Rock Trembath
3:441:46Live mixing with MusicFX DJThe user demonstrates the MusicFX DJ interface by adding custom prompts like 'Snare roll', sliding tracks in and out on the beat, and adjusting effects like brightness and chaos in real-time.Rock Trembath
0:042:55Mixing AI music in real-time with MusicFX DJCurrentThe user demonstrates how to operate the MusicFX DJ interface by adjusting sliders for different genres like 'trap beat', adding random prompts with the die icon, and modifying audio parameters like density, brightness, and chaos. He also shows how to mute specific tracks (drums, base) and adjust the BPM to see how the AI regenerates the audio live.Excelerator
1:062:43Generate music with text descriptions in MusicFXThe user demonstrates entering a 'Japanese city pop' prompt into MusicFX, selecting instrument recommendations like saxophone, and generating/playing the resulting audio tracks.AsapGuide
MusicFX