DIVYENDRA Singh Jadoun was busy making artificial intelligence-based visual effects and voice clones for film and television in India, when he began getting calls from politicians: could he create AI videos, or deepfakes, for their election campaign?
With a hotly-contested local election in his home state of Rajasthan last November, and a national election due by May this year, the opportunity for his company, The Indian Deepfaker, is tremendous. But Jadoun was reluctant.
"The technology to create deepfakes is so good now, it can be done almost instantaneously, with very little effort - and people cannot tell if it's real or fake," said Jadoun, 30.
"There are no guidelines on deepfakes, and that's worrying, as it has the potential to influence how a person votes," he told the Thomson Reuters Foundation.
Instagram reels of Indian Prime Minister Narendra Modi singing in regional languages have gone viral recently, as have TikTok videos of Indonesian presidential candidates Prabowo Subianto and Anies Baswedan speaking in fluent Arabic.
But they were all created with AI, and posted with no label.
With elections due in India, Indonesia, Bangladesh and Pakistan in the coming weeks, misinformation is rife on social media platforms, with deepfakes - video or audio made using AI and broadcast as authentic - being particularly concerning, say tech experts and authorities.
In India, where more than 900 million people are eligible to vote, Modi has said deepfake videos are a "big concern", and authorities have warned social media platforms they could lose their safe-harbour status that protects them from liability for third-party content posted on their sites if they do not act.
In Indonesia - where more than 200 million voters will go to the polls on Feb. 14 - deepfakes of all three presidential candidates and their running mates are circulating online, and have the potential to influence election outcomes, said Nuurrianti Jalli, who studies misinformation on social media.
"From microtargeting of voters with disinformation to spreading false narratives at a scale and speed unachievable by human actors alone, these AI tools can significantly influence voter perceptions and behaviour," she said.
"In environments where misinformation is already prevalent, AI-generated content can further skew public perception and influence voting behaviour," added Jalli, an assistant professor at Oklahoma State University's media school.
'POLITICAL PROPAGANDA'
Deepfake images and videos churned out by generative AI tools such as Midjourney, Stable Diffusion and OpenAI's Dall-E popped up ahead of elections from New Zealand to Turkey and Argentina last year, with growing concerns about their impact on U.S. presidential polls in November.
AI makes the creation and spread of disinformation faster, cheaper and more effective, the U.S. non-profit Freedom House said in a recent report.
In Bangladesh - where Prime Minister Sheikh Hasina is set for her fourth straight term after polls on Jan. 7 - deepfake videos of female opposition politicians Rumin Farhana in a bikini and Nipun Roy in a swimming pool have emerged.
While they were debunked quickly, they are still circulated, and even poor-quality deepfake content is misleading people, said Sayeed Al-Zaman, an assistant professor of journalism at Bangladesh's Jahangirnagar University, who studies social media.
"Given the low levels of information and digital literacy in Bangladesh, deepfakes can be potent carriers of political propaganda if crafted and deployed effectively," he said.
"But the government does not appear concerned."
The ministry of information did not respond to a request for comment.
In Pakistan, where an election is scheduled for Feb. 8, Imran Khan, who is in prison on an official secrets acts case after being ousted as prime minister last year, used a AI-generated image and voice clone to address an online election rally in December, which drew more than 1.4 million views on YouTube and was attended live by tens of thousands.
While Pakistan has drafted an AI law, digital rights activists have criticised the lack of guardrails against disinformation, and to protect vulnerable communities including women.
"The threat that disinformation poses to elections and the overall democratic process in Pakistan cannot be stressed upon enough," said Nighat Dad, co-founder of the non-profit Digital Rights Foundation.
"In the past, disinformation on online platforms has managed to sway voting behaviour, party support, and even influenced legislation change. Synthetic media will make this easier to do," she added.
'DANGEROUS SIGN'
At least 500,000 video and voice deepfakes were shared on social media sites globally in 2023, estimated DeepMedia, a company developing tools to detect synthetic media.
Platforms have struggled to keep up.
Meta, which owns Facebook, Instagram and WhatsApp, said it aims to remove synthetic media when the "manipulation is not apparent and could mislead, particularly in the case of video content."
Google, which owns YouTube, said in November that the video sharing platform requires "creators to disclose altered or synthetic content that is realistic, including using AI tools, and we'll inform viewers about such content through labels".
But countries including India, Indonesia and Bangladesh have recently passed laws to more closely police online content and penalise social media sites for content deemed misinformation, so platforms are "holding their punches", said Raman Jit Singh Chima, Asia policy director at advocacy group Access Now.
In these countries, "this election cycle is actually worse than the last cycle - platforms are not set up to handle problems, and they are not being responsive and proactive enough. And that's a very dangerous sign," he said.
"There is a danger that the world's attention is only on the U.S. election, but the standards being applied there, the effort being made there should be duplicated everywhere," he added.
In India, where Modi is widely forecast to win a third term, Jadoun - who had declined to make deepfake campaign videos for the state elections - is gearing up to make them for the general election.
These will be personalised video messages from politicians for party workers, not voters, that can be sent on WhatsApp.
"They can really have an impact, because there are hundreds of thousands of party workers and they will, in turn, forward them to their friends and family," he said.
"But we will add a watermark to show that it is made with AI, so there is no misunderstanding. That's important."
Reuters
Wed Jan 03 2024
AI makes the creation and spread of disinformation faster, cheaper and more effective, the U.S. non-profit Freedom House said. - REUTERS
Bekas gabenor New York, anak tiri diserang empat individu
Kedua-dua mangsa mengalami kecederaan di bahagian muka serta badan dan dikejarkan ke hospital untuk menerima rawatan.
Tentera AS lancar serangan di bandar Yaman
AS menyerang 15 sasaran Houthi di kawasan yang dikawal oleh kumpulan yang disokong Iran itu.
Korea Selatan pindahkan 97 rakyatnya dari Lubnan
Kementerian Luar Korea Selatan maklumkan, kesemua mereka tiba di Korea Selatan pada petang Sabtu.
Pelarian tiba di Syria selepas serangan Israel ke atas Lubnan - UNHCR
Lebih 200,000 warga Syria dan Lubnan telah tiba di Syria dari Lubnan sejak serangan Israel bermula 23 September lalu.
[LAPOR LANGSUNG] Lebih 2,000 terkorban di Lubnan akibat serangan Israel
Jumlah mangsa yang maut itu termasuk 261 wanita dan 127 kanak-kanak.
Lebih 2,000 terkorban di Lubnan akibat serangan Israel
Laporan Al Jazeera menyebut, jumlah mangsa yang maut itu termasuk 261 wanita dan 127 kanak-kanak.
AWANI Pagi: Pendayaupayaan Pembangunan Sosio Ekonomi Bagi Memacu Wilayah Persekutuan
Ikuti temu bual bersama Menteri di Jabatan Perdana Menteri (Wilayah Persekutuan), Dr Zaliha Mustafa di #AWANIPagi jam 7.30 pagi di saluran 501 Astro AWANI.
Pentagon, Jabatan Negara AS beri amaran jenayah perang Israel
Pegawai-pegawai tersebut telah memberi amaran peningkatan jumlah kematian di Gaza mungkin melanggar undang-undang antarabangsa.
200,000 pelarian tiba di Syria selepas serangan Israel ke atas Lubnan - UNHCR
Lebih 200,000 warga Syria dan Lubnan telah tiba di Syria dari Lubnan sejak serangan Israel bermula pada 23 Sept.
Belanjawan 2025: Kesalinghubungan internet di sekolah, kampus jadi keutamaan - Fahmi
Kementerian Komunikasi akan memberikan keutamaan dengan meneruskan usaha untuk meningkatkan dan memantapkan lagi prasarana kesalinghubungan melibatkan isu Internet, dalam Belanjawan 2025 yang akan dibentangkan pada 18 Okt ini.
Waspada penipuan 'deepfake' tiru suara kenalan, lebih 400 kes kini disiasat - Polis
Mangsa akan diminta untuk membuat pindahan wang ke akaun tertentu yang merupakan akaun keldai.
SC beri amaran mengenai penipuan pelaburan 'deepfake'
SC berkata pelaku penipuan itu biasanya memulakan aktiviti jenayah dengan menyiarkan video 'deepfake' pada platform media sosial, yang kemudiannya disebarkan melalui aplikasi pemesejan.
JSJK minta mangsa taktik penipuan 'deepfake' tampil buat laporan polis
"Penipuan seperti ini memang sebenarnya berlaku dan ia semakin hari kita jangka akan terus berlaku."
Bruce Willis nafi jual wajahnya untuk digunakan dalam teknologi 'deepfake'
Jurucakap pelakon itu memberitahu BBC bahawa "tiada perkongsian atau perjanjian" dibuat dengan syarikat itu.
'Ratu Elizabeth' bertiktok, bawa mesej bahaya teknologi 'deepfake'
Klip itu mengajak penonton untuk berfikir apakah yang dilihat dan didengar membawa mesej atau maksud yang sebenarnya.