Deepfake video conference call defrauds unnamed multinational firm of £20 million.

[JohnS]

I know here at Friends of the el Habano we love bringing you current news of the benefits and drawbacks of artificial intelligence, but you simply have to love the following story about an employee who was tricked into transferring £20 million to fraudsters, using artificial intelligence to create deepfakes. 

As a number of us utilise on-line videoconferencing for work, you have to wonder if it could happen to us. Well, could it?

Company worker in Hong Kong pays out £20m in deepfake video call scam

Police investigate after employee says she was tricked into sending money to fraudsters posing as senior officers at her firm

Police said the woman made 15 transactions to banks accounts totalling HK$200m. Photograph: Blend Images/Alamy

Hong Kong police have launched an investigation after an employee at an unnamed company claimed she was duped into paying HK$200m (£20m) of her firm’s money to fraudsters in a deepfake video conference call.

The Hong Kong police force said it had received a report from a worker that she had been tricked into transferring the money by someone “posing as senior officers of the company”.

“Police received a report from a staff member of a company on 29 January that her company was deceived of some HK$200m after she received video conference calls from someone posing as senior officers of the company requesting to transfer money to designated bank accounts,” said police in a statement.

The force added that after an initial investigation the case had been classified as “obtaining property by deception” and was being handled by its cybercrime unit. No arrests have been made so far and investigations are continuing.

Hong Kong’s public broadcaster, RTHK, reported that the employee was a clerk working for an unnamed multinational firm. It quoted acting senior superintendent Baron Chan as speculating that the fraudster used artificial intelligence to dupe the worker.

“[The fraudster] invited the informant [clerk] to a video conference that would have many participants. Because the people in the video conference looked like the real people, the informant … made 15 transactions as instructed to five local bank accounts, which came to a total of HK$200m,” he said.

“I believe the fraudster downloaded videos in advance and then used artificial intelligence to add fake voices to use in the video conference.”

RTHK added that the worker received a message from the company’s chief financial officer that talked of the need for confidential transactions. It was only after going on the call and sending the money that the employee spoke to the company’s head office and realised it was a scam, reported RTHK.

“We can see from this case that fraudsters are able to use AI technology in online meetings, so people must be vigilant even in meetings with lots of participants,” said Chan.

AI-generated deepfakes are proliferating online, with social media platform X being forced to suspend Taylor Swift-related searches last month after fake sexually explicit images of the pop singer flooded its site. A fake version of US president Joe Biden’s voice was also used in robocalls to voters in the New Hampshire primary last month.

The UK’s cybersecurity agency warned in January that AI was making it increasingly difficult to identify phishing messages – where users are tricked into handing over passwords or personal details.

Source: https://www.theguardian.com/world/2024/feb/05/hong-kong-company-deepfake-video-conference-call-scam

[cnov]

There we were thinking that social media was the peak in misinformation, feels like we're only just getting started now.

 

 

 

[raggie]

This has been a big topic at work (I’m in InfoSec) and many discussions are taking place. This was a well planned and executed attack, and the attacker(s) likely breached the company well before this incident. The future of the photo, video, and even voice AI generation is concerning, if not downright a huge risk to companies and governments alike. Being able to generate a near perfect voice message from 5-10 seconds of someone’s audio is wild. Think of the scam phone calls to companies, governments, people (think your grandma. Get some code words!) poses a huge concern. 

[BrightonCorgi]

There's some conversations on LinkedIn Cyber groups on authenticity of the story itself.

Either way, we are at the genesis of deep fake technology like internet ~1996. Eventually, our favorite actors & TV personalities will be AI based.

[jazzboypro]

2 hours ago, BrightonCorgi said:

There's some conversations on LinkedIn Cyber groups on authenticity of the story itself.

Either way, we are at the genesis of deep fake technology like internet ~1996.  Eventually, our favorite actors & TV personalities will be AI based.

AI as already created digital artist personalities. At least one of them signed a deal with a major record label.

https://www.telegraph.co.uk/news/2023/09/01/watch-first-artificial-intelligence-singer-record-deal/