Key Takeaways
- With Google’s Veo3, you can now render AI videos, audio, and background sounds.
- This would also make it easy for scammers to design deepfake scams to defraud innocent citizens.
- Users need to exercise self-vigilance to protect themselves. Developers’ responsibilities and government regulations will also play a key part.
Google recently launched Veo3, an AI tool that lets you create videos with audio, including background tracks and various sound effects. Until recently, you could either use voice cloning apps to build AI voices or video rendering apps to generate AI videos. However, thanks to Veo3, folks can now create entire videos with audio.
While this is an exciting development, we can’t help but think how easy it would be for scammers and swindlers to use Veo3’s videos to scam people.
A video posted by a user on Threads shows a TV anchor breaking the news that ‘Secretary of Defence Pete Hegseth has died after drinking an entire litre of vodka on a dare by RFK.’ At first glance, the video is extremely convincing, and chances are that quite a few people might have believed it. After all, the quality is that of a professional news studio with a background of the Pentagon.
Another user named Ari Kuschnir posted a 1-minute 16-second video on Reddit showing various characters in different settings talking to each other in various accents. The facial expressions are very close to those of a real human.
A user commented, ‘Wow. The things that are coming. Gonna be wild!’ The ‘wild’ part is that the gap between reality and AI-generated content is closing daily. And remember, this is only the first version of this brand-new technology – things will only get worse (worse) from here.
New AI Age for Scammers
With the development of generative AI, we have already seen countless examples of people losing millions to such scams.
For example, in January 2024, an employee of a Hong Kong firm sent $25M to fraudsters who convinced the employee that she was talking to the CFO of the firm on a video call. Deloitte’s Center for Financial Services has predicted that generative AI could lead to a loss of $40B in the US alone by 2027, growing at a CAGR of 32%.
Until now, scammers also had to take the effort of generating audio and video separately and syncing them to compile a ‘believable’ video. However, advanced AI tools like Veo3 make it easier for bad actors to catch innocent people off guard.
In what is called the internet’s biggest scam so far, an 82-year-old retiree, Steve Beauchamp, lost $690,000 after he invested his retirement savings in an investment scheme. The AI-generated video showed Elon Musk talking about this investment and how everyone looking to make money should invest in the scheme.
In January 2024, sexually explicit images of Taylor Swift were spread on social media, drawing a lot of legislative attention to the matter. Now, imagine what these scammers can do with Veo3-like technology. Making deepfake porn would become easier and faster, leading to a lot of extortion cases.
It’s worth noting, though, that we’re not saying that Veo3 specifically will be used for such criminal activities because they have several safeguards in place. However, now that Veo3 has shown the path, other similar products might be developed for malicious use cases.
How to Protect Yourself
Protection against AI-generated content is a multifaceted approach involving three key pillars: self-vigilance, developers’ responsibilities, and government regulations.
Self Vigilance
Well, it’s not entirely impossible to figure out which video is made via AI and which is genuine. Sure, AI has grown leaps and bounds in the last two years, and we have something as advanced as Veo3. However, there are still a few telltale signs of an AI-generated video.
- The biggest giveaway is the lip sync. If you see a video of someone speaking, pay close attention to their lips. The audio in most cases will be out of sync by a few milliseconds.
- The voice, in most cases, will also sound robotic or flat. The tone and pitch might be inconsistent without any natural breathing sounds.
We also recommend that you only trust official sources of information and not any random video you find while scrolling Instagram, YouTube, or TikTok. For example, if you see Elon Musk promoting an investment scheme, look for the official page or website of that scheme and dig deeper to find out who the actual promoters are.
You will not find anything reliable or trustworthy in the process. This exercise takes only a couple of minutes but can end up saving thousands of dollars.
Developer’s Responsibilities
AI developers are also responsible for ensuring their products cannot be misused for scams, extortion, and misinformation. For example, Veo3 blocks prompts that violate responsible AI guidelines, such as those involving politicians or violent acts.
Google has also developed its SynthID watermarking system, which watermarks content generated using Google’s AI tools. People can use the SynthID Detector to verify if a particular content was generated using AI.
However, these safeguards are currently limited to Google’s products as of now. There’s a need for similar, if not better, prevention systems moving forward.
Government Regulations
Lastly, the government needs to play a crucial role in regulating the use of artificial intelligence. For example, the EU has already passed the AI Act, with enforcement beginning in 2025. Under this, companies must undergo stringent documentation, transparency, and oversight standards for all high-risk AI systems.
Even in the US, several laws are under proposal. For instance, the DEEPFAKES Accountability Act would require AI-generated content that shows any person to include a clear disclaimer stating that it is a deepfake. The bill was introduced in the House of Representatives in September 2023 and is currently under consideration.
Similarly, the REAL Political Advertisements Act would require political ads that contain AI content to include a similar disclaimer.
That said, we are still only in the early stages of formulating legislation to regulate AI content. With time, as more sophisticated and advanced artificial intelligence tools develop, lawmakers must also be proactive in ensuring digital safety.
Krishi is a seasoned tech journalist with over four years of experience writing about PC hardware, consumer technology, and artificial intelligence. Clarity and accessibility are at the core of Krishi’s writing style.
He believes technology writing should empower readers—not confuse them—and he’s committed to ensuring his content is always easy to understand without sacrificing accuracy or depth.
Over the years, Krishi has contributed to some of the most reputable names in the industry, including Techopedia, TechRadar, and Tom’s Guide. A man of many talents, Krishi has also proven his mettle as a crypto writer, tackling complex topics with both ease and zeal. His work spans various formats—from in-depth explainers and news coverage to feature pieces and buying guides.
Behind the scenes, Krishi operates from a dual-monitor setup (including a 29-inch LG UltraWide) that’s always buzzing with news feeds, technical documentation, and research notes, as well as the occasional gaming sessions that keep him fresh.
Krishi thrives on staying current, always ready to dive into the latest announcements, industry shifts, and their far-reaching impacts. When he’s not deep into research on the latest PC hardware news, Krishi would love to chat with you about day trading and the financial markets—oh! And cricket, as well.
View all articles by Krishi Chowdhary
The Tech Report editorial policy is centered on providing helpful, accurate content that offers real value to our readers. We only work with experienced writers who have specific knowledge in the topics they cover, including latest developments in technology, online privacy, cryptocurrencies, software, and more. Our editorial policy ensures that each topic is researched and curated by our in-house editors. We maintain rigorous journalistic standards, and every article is 100% written by real authors.
