AI-Powered Deepfake Scam Sparks Concern Over Rise of Artificial Intelligence-Driven Fraud in China

Share

A fraud in northern China that used sophisticated “deepfake” technology to convince a man to transfer money to a supposed friend has sparked concern about the potential of artificial intelligence (AI) techniques to aid financial crimes.

China has been tightening scrutiny of such technology and apps amid a rise in AI-driven fraud, mainly involving the manipulation of voice and facial data, and adopted new rules in January to legally protect victims.

Police in the city of Baotou, in the region of Inner Mongolia, said the perpetrator used AI-powered face-swapping technology to impersonate a friend of the victim during a video call and receive a transfer of CNY 4.3 million ($622,000, roughly Rs. 5,15,52,000).

He transferred the money in the belief that his friend needed to make a deposit during a bidding process, the police said in a statement on Saturday.

The man only realised he had been duped after the friend expressed ignorance of the situation, the police added, saying they had recovered most of the stolen funds and were working to trace the rest.

The case unleashed discussion on microblogging site Weibo about the threat to online privacy and security, with the hashtag “#AI scams are exploding across the country” gaining more than 120 million views on Monday.

“This shows that photos, voices and videos all can be utilised by scammers,” one user wrote. “Can information security rules keep up with these people’s techniques?”

© Thomson Reuters 2023


Samsung Galaxy A34 5G was recently launched by the company in India alongisde the more expensive Galaxy A54 5G smartphone. How does this phone fare against the Nothing Phone 1 and the iQoo Neo 7? We discuss this and more on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.
Affiliate links may be automatically generated – see our ethics statement for details.