Generative AI

AI gained mainstream attention with tools like IBM Watson and Apple’s Siri

With the release of ChatGPT in 2022, which drew over 100 million weekly users in just two months, natural language processing and understanding could be achieved at scale via machine learning. Unlike earlier artificial intelligence that could pull stored knowledge, generative AI produces text, images, or sounds.

The term 'artificial intelligence' was coined in 1956

Dartmouth professor John McCarthy introduced the term during a summer workshop aimed at exploring how to make machines perform human-like tasks. Two years later, Perceptron Mark I became one of the first neural network machines.

ChatGPT is trained on most of the world's digitally accessible text

As with other AI chatbots, ChatGPT is primarily trained through non-supervised pretraining, which identifies underlying structure and patterns within input data. Then, human intervention addresses harmful or biased patterns that should not be propagated to generated outputs.

Large language models are examples of foundation models

Such models are trained on massive amounts of data, which enable them to perform a variety of tasks, rather than being provided task-specific data to complete a narrow function. Such models come with high compute costs and potential trust issues due to the nature of their unorganized training data.

Neural networks are modeled after an idealization of the brain

These networks—including the backbone of ChatGPT-3, which has approximately 175 billion parameters—naturally discover the implicit rules of grammar and syntax within language by identifying patterns. Deviations in word patterns add creativity to the text generation.

Generative AI may automate nearly 10% of tasks in the US economy.

AI hallucinations are inaccuracies or falsehoods in generated content

AI hallucinations are a by-product of the sequential creation of content based on patterns in text, which may not reflect the context or meaning behind a prompt. Back-end issues like biased datasets and overfitting of model data contribute to hallucinations.

Indirect prompt injection is a major security flaw of generative AI systems

These attacks can manipulate AI behavior by hiding instructions in websites and PDFs that become part of training data. The more companies connect sites, services, and sensitive datasets to AI tools, the greater the chances of exposure to malicious code.

Art and video produced through generative AI involve competing neural networks

Generative adversarial networks are a type of deep learning architecture that consists of a generator, which creates data that appear real, and a discriminator, which attempts to distinguish authentic from fake data. The two train in a competitive loop until the real and fictional data are indistinguishable.

Governments are now using generative AI to manipulate public opinion

A Freedom House report found that AI-powered disinformation campaigns and censorship tactics are spreading, with 16 countries utilizing the technology to shape online narratives or suppress dissent, as of 2023. In Venezuela, deepfake software was used to push pro-government propaganda with fake news anchors.