Malicious use of deepfakes can be found in scams, misinformation, and disinformation

Artificial neural networks can identify an individual's physical characteristics when provided with training data, such as real footage of the person speaking. Graphics techniques overlay these with matching characteristics from another real or generated person to create novel footage of things that have never taken place in reality.

Deepfakes are media created using generative AI tools that intentionally misrepresent real people or events—often for malicious purposes—at the cost of public trust, security, and privacy.

Audio deepfakes have fooled voice biometrics at banks

Limitations in facial and body movements as well as mismatches between audio and lip movements can sometimes help flag a video as a deepfake, but removal of the video component significantly improves AI mimicry.

Take a quiz to identify whether you can spot deepfakes

Advances in artificial intelligence have made deepfakes increasingly difficult to identify, as they are intentionally designed to appear real. The technology has exacerbated some of the problems brought on by digital editing tools like Photoshop.

AI-generated avatars allow users to create deepfakes in real time

Synthetic media tools can map voices and faces to make individuals appear as someone else. Although they open the door to new opportunities in immersive education and entertainment, they also raise concerns about the misuse of personal identity.

Deepfake potential ranges from destabilizing democracies to improving accessibility

The technology can revolutionize education, medicine, and art through actions such as helping a disabled person express themselves. However, fictional audio and video can also jeopardize a person's reputation and life or quickly spread misinformation, even without content being flawless recreations.

Deepfakes came to prominence in the form of nonconsensual pornography

The explosion of deepfakes depicting renowned people in both ridiculous and compromising videos has provoked widespread fears they will undermine public trust in authoritative knowledge. However, some scholars argue that real videos will always be distinguishable from deepfakes via the video-sharer's testimony and a broader social context.

Once limited to expert studios, automated tools can create convincing deepfakes

Although the best deepfakes are engineered using generative adversarial networks where systems compete to create and assess fake data until the two cannot be distinguished, simpler tools have allowed nonexperts to develop deepfakes for financial scams, political deception, and nonconsensual pornography.

The ease of deepfakes creation may soon overwhelm our sense of digital truth

Shortly after the public release of related technology in 2017, some experts saw the technical limitations of deepfakes as preventing them from becoming widespread tools of disinformation. Since then, the neural networks behind diffusion models and generative AI have eliminated the barriers to creating convincing synthetic media for propaganda.

Deepfake pornography poses significant challenges in combating sexual abuse

In 2017, 96% of deepfake videos involved image-based sexual abuse, which has disproportionately targeted minority women, LGBTQ individuals, adolescents and celebrities. Cultural norms, misogyny and AI advancements have contributed to the proliferation of explicit deepfake content.

Digital re-aging and de-aging of faces in film and TV has become increasingly common

Traditional techniques for accomplishing this process were slow and labor-intensive, and often required manual frame-by-frame edits, forcing them to be reserved for "hero characters" and close-up shots. Deep learning methods used by Disney and other production companies now provide fully-automatic and production-ready methods to produce such deepfakes for entertainment purposes.

The basis for AI image and video generation was first introduced in 2014

Through generative adversarial networks, the generator (a neural network that creates fictional data) competes against the discriminator (a neural network that assesses the data) to continuously train the former until it can make content indistinguishable from the real thing. Training with unstructured data can enable software to identify characteristics of gender, age, and expression.

Test your ability to identify AI-generated images

This interactive project from MIT challenges users to distinguish between AI-generated images and real ones.

Computer systems create artificial voices by stitching together phonemes—individual sounds that make up speech, such as 't,' 'long a,' and 'k' to say 'take.'

The AI that creates any picture you want and how it works

Since January 2021, advances in AI research produced a plethora of deep-learning models capable of generating original images from simple text prompts. Researchers at OpenAI, Google, Facebook, and others have developed yet to be released text-to-image tools, and similar models have proliferated online. This video is a primer on how we got here, how the technology works, and its implications.

AI hallucinations are inaccuracies or falsehoods in generated content

AI hallucinations are a by-product of the sequential creation of content based on patterns in text, which may not reflect the context or meaning behind a prompt. Back-end issues like biased datasets and overfitting of model data contribute to hallucinations.

Deepfake videos impersonating real doctors are spreading false medical advice

More than 100 videos, found primarily on Instagram and TikTok in August 2025, promoted products related to beauty, wellness and weight loss. While TikTok removed 94% of content violating its policies on AI-generated content, these deepfakes were watched and shared before removal, undermining public trust in medicine.

Art and video produced through generative AI involve competing neural networks

Generative adversarial networks are a type of deep learning architecture that consists of a generator, which creates data that appear real, and a discriminator, which attempts to distinguish authentic from fake data. The two train in a competitive loop until the real and fictional data are indistinguishable.

Audio deepfake tools can now impersonate anyone in real time

A cybersecurity company developed a tool that mimics a person's voice with no noticeable delay using only publicly available software, hardware, and voice samples, allowing users to have seemingly authentic conversations while pretending to be someone else.

AI tools that generate images, audio, video, and 3D models rely on diffusion models, which begin with random data, such as visual noise, and gradually refine it into the requested media.

Using generative AI to create video introduces physics-compatibility challenges

Models involved in generating video from text must maintain spatial and temporal coherence while adhering to the laws of reality to produce smooth, logical motion. Ensuring this consistency creates long-term dependencies with high computational times.

Watch LinkedIn cofounder Reid Hoffman interview his deepfake doppelgänger.

In China, deepfaking a dead loved one has become a growing industry

Digital replicas of the deceased provide individuals with another way to process grief in a culture with long-standing traditions of communicating with ancestors. The emotional and ethical implications of "digital immortality" are complicated further by cases of actors impersonating deceased relatives during deepfake video calls to hide their deaths.

Generative AI tools excel at pattern recognition, not contextual accuracy

Large language models are trained on vast amounts of unstructured data, from which they develop parameters for grammar and associations between words. These connections can introduce errors due to inapplicable reasoning when used on new data in unfamiliar contexts.

AI tools can reinforce existing societal biases—especially racial ones—because they are trained on human-created data containing implicit and explicit biases.

Fair use may shield AI companies from potential copyright violations

AI models are trained on enormous datasets built from content scraped from websites across the internet. Copyright law includes a four-factor test to determine whether copies of content fall under fair use, but the law's enforcement has been inconsistent.

AI could be increasing the opportunities for financial fraud

Systems that can reproduce near perfect counterfeits of legitimate financial documents are increasingly prevalent and sophisticated. The international Association of Certified Fraud Examiners estimate organizations lose about 5% of revenue to fraud each year.

AI is not good at understanding satire

Social media has become rife with misinformation. In response, some organizations have deployed AI-assisted programs trying to curb the spread of this inaccurate content. The problem is that misinformation and satire, rhetorically speaking, often use the same kind of language, something AI struggles to understand.

Because they are built on content produced by humans, who possess biases, generative AI tools inherit prejudices and stereotypes from training data, which later appear in their outputs.

Super recognizers may use specific facial features to commit faces to memory

Researchers believe that recognizing individuals seen only in passing, even decades later, is an ability of genetic origin and specific to facial recognition, rather than a result of better overall memory or perception. Applying eye tracking data from super recognizers to AI has led to improvements in facial recognition software.

Algorithms built to detect credit card fraud can deny charges if they perceive the attempted purchase is unfamiliar or unusual based on historical data, even when a person has enough credit to make the purchase.

When you complete a CAPTCHA on a website to prove you are human, you may be unknowingly training algorithms for self-driving cars, whose systems require training data to help identify crosswalks, bicycles, and other outdoor objects.

Through prompt injection attacks, bad actors provide deceptive prompts to generative AI systems in order to manipulate their outputs and acquire sensitive data.

Just as large language models are trained on text to enable generative AI systems to mimic natural language, automated AI robotic systems are trained in virtual environments to help them 'learn' about the properties of reality.

Explore a gallery of DALL-E creations

OpenAI's text-to-image generator can create content in a wide range of image styles based on simple prompts. Its utility has also given rise to an organic, passionate user base who employ the tool both for fun and for professional purposes.

See the news with AI-generated data visualizations

Realtime uses generative AI to create immediate data visualizations of news items on its regularly-updated feed, pulling from public data feeds. Peruse stories around sports, economics, politics, and more with the helpful aid of charts and graphs. See the shape of the news with this clever AI tool here.

Unlike the models made by large AI companies, open-weight models can have their safeguards removed or weakened, a process that has become increasingly easy and may expose users to harmful information.

How generative AI differs from machine learning

Compared to machine learning - which is sort of like teaching a toddler how to recognize what a dog looks like by showing them images of one - generative AI is like teaching that same child how to actually draw a dog. Unlike machine learning, generative AI can actually generate. Read this article for a more in-depth comparison between these two types of artificial intelligence.

Warren Buffett has worried that AI might end up being as consequential as the development of the nuclear bomb

Berkshire Hathaway chairman Warren Buffett is one of the many people who’ve come face-to-face with the downside effects of AI, and in particular, deepfakes. He was recently shown a deepfake of himself in a video, which caused him to worry about how bad actors will take advantage of the technology.