AI generated voice of Lady Gaga covers “video games” by Lana Del Rey
In recent months AI became dominant in many markets. Everybody use chat GPT for writing essays, song lyrics or even a screenplays. AI generated images flooded the internet, many artists use them to create video clips for they song. In call centres many human assistances got replaced by chatbots. It found it’s place even on legal market where first AI robots stats helping lawyers it their jobs in court. In recent days videos of AI covers started to appear on YouTube.
Using machine learning and huge assets of voice data of a person we can now create fully artificial asset of their speech. This technology is in an early stage for now however it is not disappointing. Cover of “Video games” was created in a program called diff-svc. For now it has closed access, just like DALL-E in it’s beta but will probably open to the public very soon. For AI to understand tones and assign it to given voice it need’s many types of audio such as singing acapella and speaking in a different ranges so it could generate the voice of a person as resembling as possible. Next step after gathering all the data is running a test consisting of at least 50 thousands steps so the AI voice could be realistic. After that process we input an acapella version of the song we want to cover so it could learn how to intonate the words with generated voice. Based on those two processes AI uses generated voice to sing chosen song.
The idea of artificially generated voice is quite new and for now it’s being used in non-harmful way, however this poses a lot of ethical and legal threats. We can do anything with the generated voice, and it don’t have to be the right, proper things. When it comes to famous people such as Lady Gaga there is also a problem of copyrights and intellectual property of their voices. With all those processes powered by AI we slowly enter an era where technology will be undistinguishable from reality.
I think AI-made vocals could change the music industry in a big way. But it brings up moral and legal questions, such as how it could be used and how to protect the intellectual property rights of famous voices. To use this technology in a responsible and ethical way, we need to carefully look at these problems and find ways to solve them as we grow.
It is really mind-blowing how accurate this is. I really appreciate that you explained how this particular AI works, I think it’s a very interesting process. I agree with you, that as long as this is used in non harmful way, it is safe. Sadly, it can be used to villainize someone and have negative effect on their life and career.