Audio deepfakes have fooled voice biometrics at banks

A cybersecurity company developed a tool that mimics a person's voice with no noticeable delay using only publicly available software, hardware, and voice samples, allowing users to have seemingly authentic conversations while pretending to be someone else.

Artificial neural networks can identify an individual's physical characteristics when provided with training data, such as real footage of the person speaking. Graphics techniques overlay these with matching characteristics from another real or generated person to create novel footage of things that have never taken place in reality.

Although the best deepfakes are engineered using generative adversarial networks where systems compete to create and assess fake data until the two cannot be distinguished, simpler tools have allowed nonexperts to develop deepfakes for financial scams, political deception, and nonconsensual pornography.

Synthetic media tools can map voices and faces to make individuals appear as someone else. Although they open the door to new opportunities in immersive education and entertainment, they also raise concerns about the misuse of personal identity.

The technology can revolutionize education, medicine, and art through actions such as helping a disabled person express themselves. However, fictional audio and video can also jeopardize a person's reputation and life or quickly spread misinformation, even without content being flawless recreations.

Shortly after the public release of related technology in 2017, some experts saw the technical limitations of deepfakes as preventing them from becoming widespread tools of disinformation. Since then, the neural networks behind diffusion models and generative AI have eliminated the barriers to creating convincing synthetic media for propaganda.

Bad actors are not solely using deepfake technology to manipulate images. They can also manipulate audio for political purposes. In this example, eligible voters are asked to skip the 2024 New Hampshire Democratic primary.

The explosion of deepfakes depicting renowned people in both ridiculous and compromising videos has provoked widespread fears they will undermine public trust in authoritative knowledge. However, some scholars argue that real videos will always be distinguishable from deepfakes via the video-sharer's testimony and a broader social context.

Advances in artificial intelligence have made deepfakes increasingly difficult to identify, as they are intentionally designed to appear real. The technology has exacerbated some of the problems brought on by digital editing tools like Photoshop.

Traditional techniques for accomplishing this process were slow and labor-intensive, and often required manual frame-by-frame edits, forcing them to be reserved for "hero characters" and close-up shots. Deep learning methods used by Disney and other production companies now provide fully-automatic and production-ready methods to produce such deepfakes for entertainment purposes.

More than 100 videos, found primarily on Instagram and TikTok in August 2025, promoted products related to beauty, wellness and weight loss. While TikTok removed 94% of content violating its policies on AI-generated content, these deepfakes were watched and shared before removal, undermining public trust in medicine.

Journalist Evan Ratliff became the object of his own story: He opted to clone his voice, feed it into an AI chatbot, and have it do the talking. What could seem like a fun experiment ended up revealing just how far the capacity of artificial intelligence can go in imitating our identities. Hear the ins and outs of how Ratliff achieved this in this fun and thought-provoking episode.

In 2017, 96% of deepfake videos involved image-based sexual abuse, which has disproportionately targeted minority women, LGBTQ individuals, adolescents and celebrities. Cultural norms, misogyny and AI advancements have contributed to the proliferation of explicit deepfake content.

Systems that can reproduce near perfect counterfeits of legitimate financial documents are increasingly prevalent and sophisticated. The international Association of Certified Fraud Examiners estimate organizations lose about 5% of revenue to fraud each year.

Digital replicas of the deceased provide individuals with another way to process grief in a culture with long-standing traditions of communicating with ancestors. The emotional and ethical implications of "digital immortality" are complicated further by cases of actors impersonating deceased relatives during deepfake video calls to hide their deaths.

Berkshire Hathaway chairman Warren Buffett is one of the many people who’ve come face-to-face with the downside effects of AI, and in particular, deepfakes. He was recently shown a deepfake of himself in a video, which caused him to worry about how bad actors will take advantage of the technology.

The audio included incendiary remarks related to the ongoing Palestinian protests and played on the public's preexisting political biases. The technology has since destabilized the concept of truth in elections, where politicians blame the use of real gaffes on AI and deepfakes to spread misinformation.

Tom Cruise isn’t on TikTok. But you might think that he actually does have an account on the service if you came across the TikTok deepfakes of the actor that have gone viral. They’re the work of a visual and AI effects artist named Chris Umé and a Cruise stand-in, actor Miles Fisher, who already bears a vague resemblance to the actor. Watch what happens after Cruise’s face is superimposed onto Fisher’s.

Generative AI now makes it possible to create everything from computer-generated written content to beautiful imagery and hyper-realistic videos in seconds from a user’s simple text prompt. Add to that list: High-quality spoken audio, which the AI software company ElevenLabs specializes in. Its natural-sounding speech synthesis and text-to-speech tech can produce human-like speech that mimics a variety of different tones, styles, and accents.

Famous 1967 footage of a Sasquatch-like creature in a California forest has been stabilized using AI, clearly revealing the Bigfoot-esque creature to be a man in a suit.

Generative artificial intelligence has left no industry untouched, and banking isn’t an exception. Experts estimate that gen AI could add as much as $340B in value to the banking sector each year. For consumers, this involves new features to prevent fraud and customer service chatbots. This report dives into the revolution underway and seeks to define a “full stack” AI bank of the future. Read more here.

Through generative adversarial networks, the generator (a neural network that creates fictional data) competes against the discriminator (a neural network that assesses the data) to continuously train the former until it can make content indistinguishable from the real thing. Training with unstructured data can enable software to identify characteristics of gender, age, and expression.

Though deepfakes are often synonymous with manipulation and bad intentions, some artists have found creative uses for the technology. In this example, Billy Joel depicts himself in various eras of his career in keeping with the song's nostalgic message.

Social media has become rife with misinformation. In response, some organizations have deployed AI-assisted programs trying to curb the spread of this inaccurate content. The problem is that misinformation and satire, rhetorically speaking, often use the same kind of language, something AI struggles to understand.

Models involved in generating video from text must maintain spatial and temporal coherence while adhering to the laws of reality to produce smooth, logical motion. Ensuring this consistency creates long-term dependencies with high computational times.

Ear, nose, and throat expert David Howard discusses how his research team extracts vocal folds from preserved human tissue, which allows them to model the deceased person's larynx. From there, they can create a synthetic voice based on the organ's geometry.

Sora, OpenAI's video generation tool, can create up to 60 seconds of photorealistic video footage featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions from a text prompt.

Several companies developing brain-computer interfaces have begun testing on humans with promising results. These implants have helped reanimate paralyzed limbs and enable communication, though ethical concerns remain about data privacy.

Since January 2021, advances in AI research produced a plethora of deep-learning models capable of generating original images from simple text prompts. Researchers at OpenAI, Google, Facebook, and others have developed yet to be released text-to-image tools, and similar models have proliferated online. This video is a primer on how we got here, how the technology works, and its implications.

A Freedom House report found that AI-powered disinformation campaigns and censorship tactics are spreading, with 16 countries utilizing the technology to shape online narratives or suppress dissent, as of 2023. In Venezuela, deepfake software was used to push pro-government propaganda with fake news anchors.

A video examines the massive surge in AI spending—forecast to hit $500B by 2026—and how this may be propping up a fragile US economy. Experts warn that if AI investment slows or under-delivers, the consequences could be felt in markets, jobs and growth.

AI models are trained on enormous datasets built from content scraped from websites across the internet. Copyright law includes a four-factor test to determine whether copies of content fall under fair use, but the law's enforcement has been inconsistent.

Artificial intelligence is fuelling a financial technology transformation in some countries where an outsized number of residents lack access to basic financial services, including Brazil and Nigeria.

2022 was the year AI broke onto the scene, with applications like ChatGPT amazing users with its ability to generate realistic-sounding answers. Technologist Arvind Narayanan presents a clear-eyed view of what the technologies can (and can't) do.