Jukebox, AI can compose a complete song

OpenAI has just officially introduced "Jukebox", an open source AI system that can compose music, create songs complete with melodies, vocals and lyrics. According to experts, this is the most impressive music AI creation model ever known.

Jukebox is trained by OpenAI experts with a huge database of music, covering nearly all known music genres today. Thanks to this, it can create completely new songs without signs of "plagiarism". Even in many cases, the songs created by Jukebox are of professional quality not inferior to works from artists who have been through intensive training classes.

Just like artificial neural networks are being applied in other creative fields, Jukebox can figure out how to imitate the various styles and genres of music it has been trained through. It can even try to recreate the style of famous singers and musicians.

"Our AI model makes it possible to create songs from a variety of music genres like rock, hip-hop and jazz. The Jukebox can capture melodies, rhythms, and timbre for a wide range of genres. musical instruments, and singers' styles and voices. "

First, researchers used convolutional neural networks to encode and compress raw audio. Then use what they call a "Transformer" to create a compressed sound, then combine it to turn it into a raw sound, as described in the diagram below:

The advantage of Jukebox over the previously introduced music creation AI systems is that it can write its own lyrics by "co-writing" with OpenAI researchers. This is because Jukebox has been trained on a raw data set of 1.2 million songs (600,000 in English) and uses metadata and lyrics from LyricWiki.

Currently, Jukebox will be primarily used for academic purposes instead of entertainment, due to a number of copyright-related issues that may appear in Jukebox's works.

"Hundred listen to not see one," OpenAI has shared a Soundcloud music playlist including songs for Jukebox composed, you can try it here:

Marvin Fry

Update 02 May 2020