Create flute, saxophone, trumpet, or violin reproductions of any 15-second piece of audio using machine learning.

Computer systems create artificial voices by stitching together phonemes—individual sounds that make up speech, such as 't,' 'long a,' and 'k' to say 'take.'

Type out a tone and play it back with this fun game

Compose an original piece of music from your phone or desktop with this simple, super fun interface: Just start typing, discover the various sounds associated with each key or letter, and then press play. Go back, tweak, delete, and revise to your...

Try out an online tone generator, which produces sounds of specific frequencies to help tune instruments, test your hearing, and generate beats by overlapping tones.

AI tools that generate images, audio, video, and 3D models rely on diffusion models, which begin with random data, such as visual noise, and gradually refine it into the requested media.

Audio deepfake tools can now impersonate anyone in real time

A cybersecurity company developed a tool that mimics a person's voice with no noticeable delay using only publicly available software, hardware, and voice samples, allowing users to have seemingly authentic conversations while pretending to be someone else.

Use generative AI to create a musical track from a text prompt

Suno, a web-based, text-to-music generator, takes a prompt—such as a music style, along with a general lyric idea—and can produce a highly polished, realistic-sounding tune in a matter of seconds.

Create professional-quality spoken audio from text

Generative AI now makes it possible to create everything from computer-generated written content to beautiful imagery and hyper-realistic videos in seconds from a user’s simple text prompt. Add to that list: High-quality spoken audio, which the AI software company ElevenLabs specializes in. Its natural-sounding speech synthesis and text-to-speech tech can produce human-like speech that mimics a variety of different tones, styles, and accents.

Listen to the 'world's first' song made by a quantum computer and AI

UK startup, Moth, collaborated with electronic artist ILĀ to create the world's first song using quantum-powered generative AI. The technology has the potential to help create more personalized content based on input parameters, such as music or dialogue in games.

Scientists are learning to guide your dreams using sound and touch.

An expert recreates the voice of a 3,000-year-old mummy

Ear, nose, and throat expert David Howard discusses how his research team extracts vocal folds from preserved human tissue, which allows them to model the deceased person's larynx. From there, they can create a synthetic voice based on the organ's geometry.

3D printing has made musical instruments more accessible

Violins fabricated from durable plastic, rather than being built from wood, can cost hundreds of dollars less, allowing children to try them out without financial pressure. They can be made in colors that appeal to children, sizes tailored to their bodies, and with tactile guides to help visually impaired learners.

One man used an AI band called the Velvet Sundown to conduct what he called an elaborate social experiment.

Explore a visual and auditory guide to wave properties and waveforms to learn how every sound imaginable can be created by combining multiple vibrations of air.

The AI that creates any picture you want and how it works

Since January 2021, advances in AI research produced a plethora of deep-learning models capable of generating original images from simple text prompts. Researchers at OpenAI, Google, Facebook, and others have developed yet to be released text-to-image tools, and similar models have proliferated online. This video is a primer on how we got here, how the technology works, and its implications.

Transformer architecture can recognize and predict patterns in language

The underlying software powering text generation in AI tools associates each word or subword—called a token—with a set of values corresponding to how often it appears near other tokens. By recognizing these associations in prompts, the LLM can infer meaning.

Visualize how transformer architecture generates a large language model's outputs by running words and subwords assigned to specific numbers through multiple rounds of mathematical processing.

Using AI to restore speech 30 years after a stroke

Through a novel surgical procedure involving electrodes implanted in the brain, along with the help of artificial intelligence, a stroke patient is regaining her ability to speak. This technology converts her thoughts into speech through a digital avatar, allowing her to verbally express herself for the first time in decades.

Interacting sound waves can create regions where the pressure from each wave combines, allowing objects to levitate in place against gravity or be manipulated for touch-free construction.

Meta's Quest and other mixed reality devices can make learning new skills easier

PianoVision utilizes the passthrough visibility of a headset to illuminate which keys to play on a real piano or keyboard, providing an immersive, software-based learning alternative to human instruction. Similar apps also offer virtual model replacements for physical devices, such as a virtual piano, to practice with.

AI-generated avatars allow users to create deepfakes in real time

Synthetic media tools can map voices and faces to make individuals appear as someone else. Although they open the door to new opportunities in immersive education and entertainment, they also raise concerns about the misuse of personal identity.

Audio deepfakes have fooled voice biometrics at banks

Limitations in facial and body movements as well as mismatches between audio and lip movements can sometimes help flag a video as a deepfake, but removal of the video component significantly improves AI mimicry.

A cochlear implant stimulates parts of the cochlea directly, with limited pitch and timbre capabilities

People with these devices have to learn or relearn how to train their brains to interpret nerve signals as sound. The range of the type of sounds that the brain can distinguish with a cochlear implant is limited and consequently it's difficult to understand a tonal language or distinguish individual speakers in a crowd.

Help scientists at LIGO train AI to resolve glitches in observational data

Volunteers are provided with visual representations of signal abnormalities at various frequencies and tasked with categorizing them based on reference examples. Progressing through the tool unlocks more difficult images and additional features. Categorized images will be used to train machine learning algorithms for automated future classification.

Listen to the 'sounds' of the universe with this sonification library, where astronomers have transformed certain astronomical data sets into audio for broader engagement.

Once limited to expert studios, automated tools can create convincing deepfakes

Although the best deepfakes are engineered using generative adversarial networks where systems compete to create and assess fake data until the two cannot be distinguished, simpler tools have allowed nonexperts to develop deepfakes for financial scams, political deception, and nonconsensual pornography.

Play 'Quick, Draw!' to help train Google's neural networks

Players are tasked with drawing objects, and Google’s AI—which has been trained on millions of user-submitted doodles—tries to guess what’s being sketched. Over 50 million drawings across 345 categories have been created and can be reviewed by users.

The basis for AI image and video generation was first introduced in 2014

Through generative adversarial networks, the generator (a neural network that creates fictional data) competes against the discriminator (a neural network that assesses the data) to continuously train the former until it can make content indistinguishable from the real thing. Training with unstructured data can enable software to identify characteristics of gender, age, and expression.

Playing music enhances the creation, storage, and retrieval of memories

Scans of the brains of individuals who play instruments have shown enhanced connectivity between multiple brain regions—visual, auditory, and motor cortices—and the corpus callosum, which connects the two brain hemispheres. These complex connections are strengthened through practice and then used in other activities that involve both logic and creativity. The brains of musicians also appear to give experiences multiple types of memory tags, such as audio, emotional, and conceptual, improving their processing.

Technologies labeled “AI” have historically lost that title after widespread adoption

Generative AI is the latest entry in a recurring cycle where emerging tools start as "AI" until they become common software, like databases or machine learning. Generative AI and large language models may be the next platform shift after smartphones and the Web.

Tokens—numbers assigned to words and subwords—are the basic units of data that AI tools process to generate outputs that mimic language without understanding the text itself.

In 2024, Meta launched an AI video generator to create or edit videos through prompts

The tool puts the Meta in direct competition with OpenAI and Google as more companies are investing billions of dollars to capitalize on the explosion of public interest in machine learning and generative media technologies.

Listen to a jazz composition triggered by the New York City Subway

A creative coder created a (synthetic) jazz ensemble that uses the locations of the city's trains to determine its performance. It's both a fascinating bit of internet culture and a fitting homage to New York, one of jazz's major hubs.

By igniting flammable gas in a tube filled with holes and playing music into it, the fire will take the shape of the sound waves, enabling the visualization of audio.

Deepfake potential ranges from destabilizing democracies to improving accessibility

The technology can revolutionize education, medicine, and art through actions such as helping a disabled person express themselves. However, fictional audio and video can also jeopardize a person's reputation and life or quickly spread misinformation, even without content being flawless recreations.

How Google's Tilt Brush brings artists' creations to life

Google has been working closely with more than 60 artists to help them explore their style in virtual reality as part of the Tilt Brush Artist in Residence program.

A sound's pitch will seem to change if the listener or the source moves toward or away from the other because motion changes the time it takes each successive sound wave to reach the listener.

AI gained mainstream attention with tools like IBM Watson and Apple’s Siri

With the release of ChatGPT in 2022, which drew over 100 million weekly users in just two months, natural language processing and understanding could be achieved at scale via machine learning. Unlike earlier artificial intelligence that could pull stored knowledge, generative AI produces text, images, or sounds.

How AI helped the Beatles win their eighth Grammy

It’s been decades since the legendary British rock band broke up, yet they still managed to snag a Grammy at the 2025 awards ceremony. This feat is thanks to AI, specifically machine-learning technology, to isolate and clean up different components of a late 1970s recording. This mini-documentary shows how the band's surviving members crafted “Now and Then” with the modern technology.