“This is just a first step”: Audacity gets free AI plugins for music separation, generation and remixing (oh, and automatic text transcription, too)

It might be free and open-source, but Audacity certainly isn’t an audio editor that’s failing to move with the times. It recently got itself a new suite of plugins that are powered by Intel’s OpenVINO AI toolkit, and it sounds like some of them could be pretty useful.

First up, we have Music Generation and Music Style remix, both of which use the Stable Diffusion AI model - specifically in its Riffusion guise - to create either new music from a prompt, or existing music. 

Music Separation, meanwhile, does what it says: breaks a song up into either vocal or instrumental parts, or into vocal, drums, bass and a combined ‘anything else’ part.

Audacity AI plugins

(Image credit: Audacity)

Stem Separation is a feature that’s becoming more and more commonplace; not only does it form the basis of a number of desktop and browser-based applications, but it’s also being included in an increasing number of DAWs and other music production packages.

Audacity also gets Noise Suppression, which is designed to remove background noise from an audio file, and Whisper Transcription, a tool for transcribing spoken word audio or vocal recordings.

“We decided to add AI features to Audacity so that we could offer capabilities that were previously unavailable or just really difficult to achieve,” says Audacity Product Manager Martin Keary in a video posted by Intel Business. He also confirms that “the plugins run locally on your PC rather than from a server, addressing privacy concerns.”

According to Keary, there could be more to come, too: “This is just a first step,” he says. “We hope to continue partnering with Intel to develop all kinds of new AI tools in the future to help take Audacity to a level no one’s ever seen before.”

The only downside here is that the AI plugins are currently only available to Windows users, but we’re hoping that they’ll be coming to Mac and Linux, too. Find out more - including how to download and install them - on the Audacity blog.

Ben Rogerson

I’m the Deputy Editor of MusicRadar, having worked on the site since its launch in 2007. I previously spent eight years working on our sister magazine, Computer Music. I’ve been playing the piano, gigging in bands and failing to finish tracks at home for more than 30 years, 24 of which I’ve also spent writing about music and the ever-changing technology used to make it. 

Get over 70 FREE plugin instruments and effects… image
Get over 70 FREE plugin instruments and effects…
…with the latest issue of Computer Music magazine