SEOUL: In a dimly lit recording studio in Seoul, producers at the K-pop music label that brought the world hit boy group BTS are using artificial intelligence to meld a South Korean singer's voice with those of native speakers in five other languages.
The technology enabled HYBE, South Korea's largest music label, to release a track by singer MIDNATT in six languages – Korean, English, Spanish, Chinese, Japanese and Vietnamese in May.
Some K-pop singers have released songs in English and Japanese in addition to their native Korean, but applying the new technology for a simultaneous six-language release is a global first, according to HYBE, and could pave the way for it to be used by more popular acts.
"We would first listen to the reaction, the voice of the fans, then decide what our next steps should be," said Chung Wooyong, the head of HYBE's interactive media arm in an interview at the company's studio.
Lee Hyun, 40, known as MIDNATT, who speaks only limited English and Chinese in addition to Korean, recorded the song "Masquerade" in each language.
Native speakers read out the lyrics, and later the two were seamlessly combined with the help of HYBE's in-house AI music technology, Chung said.
The song is the latest sign of the growing influence of AI in the music industry at a time when the Grammy Awards have introduced new rules for the technology's use and AI-generated mash-ups of songs are flooding social media.
"We divided a piece of sound into different components – pronunciation, timbre, pitch and volume," Chung said. "We looked at pronunciation which is associated with tongue movement and used our imagination to see what kind of outcome we could make using our technology."
In a before-and-after comparison shown to Reuters, an elongated vowel sound was added to the word "twisted" in the English lyrics, for example, to sound more natural while no detectable change was made to the singer's voice.
Using deep learning powered by the Neural Analysis and Synthesis (NANSY) framework developed by Supertone makes the song sound more natural than using non-AI software, Supertone chief operating officer Choi Hee-doo said.
HYBE announced the 45 billion won ($36 million) acquisition of Supertone in January. HYBE said it planned to make some of the AI technology used in MIDNATT's song accessible to creators and the public, but did not specify if it would charge fees.
'IMMERSIVE EXPERIENCE'
MIDNATT said using AI had allowed him a "wider spectrum of artistic expressions."
"I feel that the language barrier has been lifted and it's much easier for global fans to have an immersive experience with my music," he said in a statement.
While the technology is not new, it is an innovative way to use AI in music, said Valerio Velardo, director of The Sound of AI, a Spain-based consulting service for AI music and audio.
Not only professional musicians but also a wider population will benefit from AI music technology in the long term, Velardo said.
"It's going to lower the barrier of music creation. It's a little bit like Instagram for pictures but in the case of music."
For now, HYBE's pronunciation correction technology takes "weeks or months" to do its job but when the process speeds up, it could serve a wider range of purposes such as interpreting in video conferences, said Choi Jin-woo, the producer of MIDNATT's "Masquerade" who goes by the name Hitchhiker.
Reuters
Fri Jul 21 2023
![K-pop's biggest music label HYBE looks to lift language barrier with AI K-pop's biggest music label HYBE looks to lift language barrier with AI](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2023-07/71689930969_HYBEIM.jpg)
HYBE IM's producer Hitchhiker and HYBE IM President Chung Wooyong demonstrate a recording process at a company office in Seoul, South Korea. - REUTERS
![Demam denggi landa negeri selatan India Karnataka, Delhi pula catat 240 kes Demam denggi landa negeri selatan India Karnataka, Delhi pula catat 240 kes](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-03/61710238310_denggi.jpg)
Demam denggi landa negeri selatan India Karnataka, Delhi pula catat 240 kes
Demam denggi melanda beberapa bahagian di negeri selatan India, Karnataka, dengan hampir tujuh orang disyaki meninggal dunia akibat penyakit itu dan lebih 7,000 kes direkodkan.
![Skuasy: Aifa-Aira juara beregu wanita Asia 2024 Skuasy: Aifa-Aira juara beregu wanita Asia 2024](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/71720360503_TBSkuasy.jpg)
Skuasy: Aifa-Aira juara beregu wanita Asia 2024
Gandingan adik beradik, Aifa Azman-Aira Azman menepati ramalan apabila bergelar juara beregu wanita Kejohanan Skuasy Beregu Asia 2024.
![Program MADANI Rakyat Zon Timur catat jumlah pengunjung tertinggi Program MADANI Rakyat Zon Timur catat jumlah pengunjung tertinggi](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/81720350205_TBMadani.jpg)
Program MADANI Rakyat Zon Timur catat jumlah pengunjung tertinggi
Program MADANI Rakyat (PMR) 2024 Zon Timur di Dataran Sayangi Kuantan melabuhkan tirai hari ini dengan mencatatkan jumlah pengunjung tertinggi dalam tiga siri penganjurannya iaitu jumlah pengunjung me
AWANI 7:45 [07/07/2024] - Peringatan Agong | Usah korban jati diri demi kuasa | Isu buli siber jadi tumpuan | Nasib berbeza dua 'gergasi' bola sepak
#AWANI745 malam ini bersama Syaff Shukri;
1. Agong ingatkan, jangan jadikan media sosial tempat buka aib
2. Jangan korban jati diri untuk kuasa dan populariti, pesan Sultan Kedah
3. Belum ada jaminan BN dan PH kerjasama hadapi PRU16
4. England gembira, Brazil berduka, nasib berbeza dua gergasi bola sepak
1. Agong ingatkan, jangan jadikan media sosial tempat buka aib
2. Jangan korban jati diri untuk kuasa dan populariti, pesan Sultan Kedah
3. Belum ada jaminan BN dan PH kerjasama hadapi PRU16
4. England gembira, Brazil berduka, nasib berbeza dua gergasi bola sepak
![1,400 veteran ATM disasar sertai Program Desa MADANI tahun ini 1,400 veteran ATM disasar sertai Program Desa MADANI tahun ini](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/81720353771_AdlyZahari.jpg)
1,400 veteran ATM disasar sertai Program Desa MADANI tahun ini
Kementerian Pertahanan menyasarkan 1,400 veteran Angkatan Tentera Malaysia (ATM) menyertai Program Veteran Desa Madani (VDM) seluruh negara tahun ini.
![Kekalahan di Sungai Bakap bukan penamat hadapi PRK seterusnya - Ahmad Zahid Kekalahan di Sungai Bakap bukan penamat hadapi PRK seterusnya - Ahmad Zahid](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/41720350017_TBZahidHamidi.jpg)
Kekalahan di Sungai Bakap bukan penamat hadapi PRK seterusnya - Ahmad Zahid
Kekalahan calon Pakatan Harapan (PH) pada Pilihan Raya Kecil (PRK) Dewan Undangan Negeri (DUN) Sungai Bakap di Pulau Pinang semalam bukanlah penamat kepada gabungan parti dalam Kerajaan Perpaduan khus
Pentas jual anugerahkan pakej media bernilai RM55,600
Jelajah JIWA SME 2024 melabuhkan tirai untuk siri pertama di Johor Bahru. Pemyampai Astro AWANI, Irfan Faruqi membawakan perinciannya.
Perpaduan kaum, agama asas penting mesti dipelihara - Agong
Sultan Ibrahim bertitah dalam konteks Malaysia, perpaduan kaum dan agama yang kukuh adalah asas penting yang mesti dipelihara.
![John Cena umum bakal bersara dari gelanggang WWE John Cena umum bakal bersara dari gelanggang WWE](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/71720357611_JohnCena.jpg)
John Cena umum bakal bersara dari gelanggang WWE
John Cena, hari ini mengejutkan peminat dengan mengumumkan akan bersara daripada gelanggang gusti pada tahun hadapan.
![Selepas Sarawak, Pulau Pinang minat anjur bersama Sukan SEA 2027 - Hannah Selepas Sarawak, Pulau Pinang minat anjur bersama Sukan SEA 2027 - Hannah](https://resizer-awani.eco.astro.com.my/tr:w-177,h-100,q-100,f-auto/https://img.astroawani.com/2024-07/71720354301_HannahYeoh.jpg)
Selepas Sarawak, Pulau Pinang minat anjur bersama Sukan SEA 2027 - Hannah
Pulau Pinang menjadi negeri terbaharu selepas Sarawak untuk menjadi hos bersama penganjuran temasya Sukan SEA 2027, menurut Menteri Belia dan Sukan Hannah Yeoh.