Neural networks are modeled after an idealization of the brain

ChatGPT is trained on most of the world's digitally accessible text

As with other AI chatbots, ChatGPT is primarily trained through non-supervised pretraining, which identifies underlying structure and patterns within input data. Then, human intervention addresses harmful or biased patterns that should not be propagated to generated outputs.

AlexNet was the AI tipping point that set the stage for ChatGPT

AlexNet is a neural network created in 2012 that laid the groundwork for modern AI models. Before AlexNet, the ideas behind neural networks existed, but the computational power to run them didn’t.

Neural networks mimic the structure and behavior of real physical systems

Early generative AI systems were inspired by scientific models such as the Ising model, which explains how atoms interact with one another and align in magnets. As these networks have expanded, their behavior has more closely resembled that of quantum fields, enabling them to be used in exploring complex particle physics interactions.

How ChatGPT learns to read

The introduction of ChatGPT last fall jumpstarted public interest in the future capabilities of artificial intelligence and what it means for society. Of many somewhat "jargony" terms thrown around, the phrase "Large Language Model" is commonly seen—but also incredibly unclear as to what it means. In the simplest sense, the programs comb through mountains of internet data in response to a question and guess at what should come next (subscription needed).

In 2023, OpenAI spent $520 million on ChatGPT

The ongoing development and refinement of new AI models requires larger datasets and processing more parameters between words and subwords to improve the accuracy of generated content. New startups are expected to harness this technology to provide unthought-of products and services.

LLMs are the backbone of AI tools that process and generate natural language

Large language models identify patterns in massive datasets of books, code, and unlabeled text from which to generate coherent responses. GPT-3 was trained on about 45 terabytes of data and uses 175 billion parameters—each parameter being a value the model adjusts as it learns.

Visualize how transformer architecture generates an LLM's outputs

Transformer architecture is the neural network framework upon which large language models predict and generate text based on user inputs. This interactive lets you explore the "thinking" a GPT does to generate responses based on your input.

Generative AI tools excel at pattern recognition, not contextual accuracy

Large language models are trained on vast amounts of unstructured data, from which they develop parameters for grammar and associations between words. These connections can introduce errors due to inapplicable reasoning when used on new data in unfamiliar contexts.

Transformer architecture can recognize and predict patterns in language

The underlying software powering text generation in AI tools associates each word or subword—called a token—with a set of values corresponding to how often it appears near other tokens. By recognizing these associations in prompts, the LLM can infer meaning.

Anthropic's interpretability team discusses how AI models' thinking mimics biology

Just as humans engage in complex behaviors to survive and reproduce, teams of experts in neuroscience, virology, mathematics, and other disciplines argue that large language models develop complex mechanisms to achieve their goals. These mechanisms can be manipulated to assess how they modify outputs—much like stimulating individual neurons—to uncover how LLMs "think."

Studies show AI tools can result in passive learning with less retention

Although ChatGPT, Google's AI overviews, and other similar software can save time, a study of more than 10,000 adults showed that reliance on them yielded work products that were more generic and included fewer facts than those produced solely by Google search. Weaker brain connectivity has also been observed when users write using AI.

Transformer architecture was the breakthrough that made AI chatbots possible

It changed how text was translated from a sequential, "one word at a time" method to one where every word in a text is processed in parallel. Advances in positional encoding and self-attention also helped models recognize context and word order better.

Scientists increasingly can't predict what AI will do

Most AI systems are so-called "black box" models, where we only see inputs and outputs while the inner workings remain obscure. This piece, written prior to the launch of ChatGPT, cautions developers to know why and how a system produces its results, and not to sacrifice explainability for accuracy.

Art and video produced through generative AI involve competing neural networks

Generative adversarial networks are a type of deep learning architecture that consists of a generator, which creates data that appear real, and a discriminator, which attempts to distinguish authentic from fake data. The two train in a competitive loop until the real and fictional data are indistinguishable.

The AI that creates any picture you want and how it works

Since January 2021, advances in AI research produced a plethora of deep-learning models capable of generating original images from simple text prompts. Researchers at OpenAI, Google, Facebook, and others have developed yet to be released text-to-image tools, and similar models have proliferated online. This video is a primer on how we got here, how the technology works, and its implications.

Computational and biological systems share fundamental principles, like randomness

Proposed by Alan Turing and John von Neumann, the concept originates from how DNA and computers run by executing encoded instructions in parallel. The advent of AI and the temperature parameter has seen neural networks mimic the randomness of protein encoding.

Artificial general intelligence equals or surpasses human intelligence

AGI incorporates sensory perception, memory, and advanced logical inference systems to move beyond the narrow tasks seen in large language models and chatbots. One of the most significant hurdles in developing AGI is designing systems that learn and can flexibly apply learning across domains.

Chat with famous, historical, and fantasy figures with this chatbot

Character.ai—a generative AI-based chatbot platform—allows you to have free-flowing conversations with a wide range of people. From celebrities to famous figures from the past, the platform relies on a neural language model to process huge amounts of text, learning from conversations with users to develop responses. A number of observers have referred to the platform as "making AI fun," with user time on site surpassing a whopping two hours per day.

Radiohead's chatbot was born over 20 years before ChatGPT

Looking for a novel way to promote their 2001 record "Amnesiac," Radiohead began working with ActiveBuddy, the people responsible for the popular SmarterChild chatbot, to create GooglyMinotaur, their own AOL chatbot based on a character based on the album. This oral history offers a deep dive on this fascinating piece of music and tech trivia, demonstrating the band's reliably forward-thinking perspective and providing a window into an early iteration of commercial artificial intelligence.

Explore an interactive 3D model of the brain

The brain contains about 86 billion neurons—nervous system cells—and controls vital bodily functions via electrochemical signals. Neurons form circuits through axons, and different brain regions use these circuits to perform specific tasks.

Diffusion models generate nontext media by adding and removing noise from a dataset

Unlike text-based AI tools, which rely on large language models to recognize patterns in text, diffusion models use a reward system to generate images, video, audio, and 3D models. They can also be customized to match a user’s style.

AI models incorporate a randomness parameter when generating responses to prompts

AI models use this parameter to prevent repeated outputs by sometimes choosing less likely next words during sequential generation. However, this randomness—alongside insufficient data and training—may cause hallucinations of incorrect results.

What are neural networks and why do they matter?

Learn how a neural network works, why it matters, and how it can be trained to recognize patterns, classify data, and forecast future events.

Malicious use of deepfakes can be found in scams, misinformation, and disinformation

Artificial neural networks can identify an individual's physical characteristics when provided with training data, such as real footage of the person speaking. Graphics techniques overlay these with matching characteristics from another real or generated person to create novel footage of things that have never taken place in reality.

Linguistics professors believe memes are a language

It's generally agreed upon that languages exhibit at least some of the following characteristics: compositionality, social transmission, arbitrariness of form and meaning, and accomplishment of linguistic functions like asking questions and expressing emotions, among other qualities. Memes fulfill these basic requirements, giving them linguistic legitimacy.

Watch how algorithms can be designed to train themselves and self-improve without human input, to the point where the optimized code is too complex for programmers to understand.

This site reaches millions of visitors who are tired of AI chatbots and seeking human connection. Pretend to be an AI chatbot and ask questions, provide answers, and draw for people in real time.

English mathematician Ada Lovelace wrote the first computer algorithm a century before computers existed and hypothesized that computing devices would one day be able to compose music—foreseeing the generative AI systems of today.

Researchers believe the brain consolidates memories, processes emotions, and plans for the future during dream states

Recent research found that the brain doesn't seem to massively rewire following amputation—upending earlier beliefs about the cause of phantom limb pain.

Some Pokémon have been named after real and fictional organisms, while some real-world species have been named after Pokémon, such as Chilicola charizard and Binburrum zapdos.

As of 2025, the most cited papers in science include a review of graphene, methods to improve image recognition, streamlining electron density calculations, and optimizing protein studies.

Crows are believed to have intelligence on par with a seven-year-old child and demonstrate complex behaviors, from problem-solving with tools to recognizing human faces.

Chaos theory—informally known as the butterfly effect—is the reason why weather forecasts are presented with probabilities rather than certainties.

Electrical grids worldwide must double their power delivery capacity by 2050 to meet surging demand from AI and electric vehicles.

Visualize how CRISPR-Cas9—a type of immune system used by single-celled organisms to attack invasive viruses—targets and makes precise changes to a gene's DNA.

Radioactive elements can introduce software errors because the ionizing radiation they produce can detach electrons from atoms, and computer code relies on the distribution of electrons.

Bone marrow (soft tissue found inside certain bones) generates roughly 500 billion new blood cells each day

Browse a detailed visual analysis of over 200,000 similes—comparisons that often use 'like' or 'as'—from popular fiction to see how frequently writers the same idiomatic expressions.

Neutron stars, the remains of some massive stars after they explode in a supernova, are the densest directly observable objects in the universe.

Elk Cloner, the first computer virus to spread in public, was written as a practical joke by Richard Skrenta, a Pittsburgh high school student.

The Brothers Grimm were lawyers before they were storytellers, but became interested in fairy tales as they began investigating how rules and customs had been passed down through cultures.

Gerrymandering works through two techniques: cracking opposing voters across districts to dilute their power, and packing them into a few to waste their votes in lopsided majorities.

Artificial coral reefs have been 3D printed from nontoxic, biodegradable terracotta clay, which coral polyps have used as a foundation for rebuilding marine ecosystems.

Art theft is the third-largest source of criminal revenues worldwide, thanks in part to the subjective nature of valuing a work of art.

Watch this video that uses Lego bricks to explain how venture capital works.

'Grand Canyon of the Yellowstone,' a work by American painter Thomas Moran, inspired Congress to establish Yellowstone National Park.

The US Constitution is widely regarded as the longest-standing written national constitution still in force—see how it has influenced rights worldwide.

Existentialist writer Jean-Paul Sartre coined the famous phrase 'Hell is—other people' in his play 'No Exit'

The price of gas is a composite made up of several different factors, with the federal gas tax making up less than 20% of what drivers pay at the pump.