Riffusion: Remixing vocal themes and adjusting variety settings

Riffusion Try it →Watch full video →Bob Doyle Media · Feb 2025

Demo summary

A demonstration of uploading a show theme with lyrics and using the variety slider (set to 9%) to try and keep the output close to the original while changing the instrumentation to brass and orchestra.

Step-by-step

Upload your audio file to Riffusion
Enter a text prompt for the desired style or instrumentation (e.g., 'acapella choir', 'tuba quintet and kazoo', or 'full orchestra')
Adjust the variety level slider to control how much the output deviates from the original
Lower the variety level to approximately 9% to keep the output closer to the original lyrics and structure

Options

Use 'acapella choir' prompt for vocal-heavy remixes
Use 'tuba quintet and kazoo' for brass-heavy instrumentation
Use 'full orchestra sweeping and epic' for cinematic styles

Watch out for

Low variety settings (around 9%) can cause 'phasing' or audio distortion as the AI struggles between the original source and the new prompt
The AI may hallucinate or create 'distorted and mushy' audio at the end of clips
Specific rhythmic elements like finger snapping may not translate well into certain genres like orchestral paradigms

Tips

Turn the variety level down very low if the AI is going too far 'off the path' from your original lyrics
Monitor the waveform for high activity to identify sections where the AI is generating complex content
Expect the AI to struggle with even simple lyrics, often garbling them or changing the words

Highlights

“when you're just on the edge of taking it from sounding like it originally did to something it's going to create you get this weird sort of phasing like it doesn't really know which direction it wants to go in”

All demos from “Riffusion's AMAZING Cover Feature Changed My Mind”

1:441:46Generate a song from text in RiffusionThe creator uses Riffusion's simple mode to generate a 50s rock style song about writing AI songs, demonstrating the text-to-audio generation and playback.Riffusion· AI Music Generator
4:431:45Generate instrumental scores in RiffusionA demonstration of prompting Riffusion for a sweeping orchestral score with specific instruments like strings, woodwinds, and a clarinet solo.Riffusion· AI Music Generator
8:023:19Remix audio with Riffusion Cover featureThe user uploads an original instrumental track and uses the Cover feature to transform it into a sweeping string orchestra with choir and brass, adjusting the variation slider for creative control.Riffusion· AI Song Remixer
13:352:03Transform melody into a Xylophone QuintetUsing the Cover feature, an existing track is re-rendered as a xylophone quintet while maintaining the original melody.Riffusion· AI Song Remixer
16:422:42Convert instrumental to Acappella ChoirThe creator demonstrates Riffusion's ability to take a synthesizer-based track and attempt an Acappella choir arrangement using the Cover tool.Riffusion· AI Song Remixer
20:015:22Remixing vocal themes and adjusting variety settingsCurrentA demonstration of uploading a show theme with lyrics and using the variety slider (set to 9%) to try and keep the output close to the original while changing the instrumentation to brass and orchestra.Riffusion· AI Song Remixer
25:254:20Remastering and changing song genreThe user takes an AI-generated vocal track and uses Riffusion to remaster it into a country ballad, showing how the tool replaces the voice and alters the rhythm based on the creativity slider.Riffusion· AI Song Remixer
Watch “Riffusion's AMAZING Cover Feature Changed My Mind” →

AI Song Remixer

7:001:05Remixing and replacing song parts in RiffusionThe user demonstrates the 'Replace' function in Riffusion, showing how to select a specific segment on the timeline to regenerate lyrics or audio while preserving the rest of the track.Olivio Sarikas
8:023:19Remix audio with Riffusion Cover featureThe user uploads an original instrumental track and uses the Cover feature to transform it into a sweeping string orchestra with choir and brass, adjusting the variation slider for creative control.Bob Doyle Media
13:352:03Transform melody into a Xylophone QuintetUsing the Cover feature, an existing track is re-rendered as a xylophone quintet while maintaining the original melody.Bob Doyle Media
16:422:42Convert instrumental to Acappella ChoirThe creator demonstrates Riffusion's ability to take a synthesizer-based track and attempt an Acappella choir arrangement using the Cover tool.Bob Doyle Media
20:015:22Remixing vocal themes and adjusting variety settingsCurrentA demonstration of uploading a show theme with lyrics and using the variety slider (set to 9%) to try and keep the output close to the original while changing the instrumentation to brass and orchestra.Bob Doyle Media
25:254:20Remastering and changing song genreThe user takes an AI-generated vocal track and uses Riffusion to remaster it into a country ballad, showing how the tool replaces the voice and alters the rhythm based on the creativity slider.Bob Doyle Media
4:161:04Generate 70s classic rock remixThe user demonstrates a remix using a '70s classic rock' prompt with 'soaring lead guitar' to transform an original alternative track.Creative AI Show
6:451:48Generate 808 hip-hop beat remixThe creator applies an 'early 90s 808 hip-hop' prompt to a track, resulting in a Daft Punk-style electronic output with modified vocal delivery.Creative AI Show
9:512:25Remixing a popular song into 60s Brit popThe user uploads a well-known track by Jimmy Eat World and demonstrates two different '60s Brit pop' outputs, comparing the AI's creative liberties with the melody.Creative AI Show