Generative AI

With the release of ChatGPT in 2022, which drew over 100 million weekly users in just two months, natural language processing and understanding could be achieved at scale via machine learning. Unlike earlier artificial intelligence that could pull stored knowledge, generative AI produces text, images, or sounds.

Dartmouth professor John McCarthy introduced the term during a summer workshop aimed at exploring how to make machines perform human-like tasks. Two years later, Perceptron Mark I became one of the first neural network machines.

As with other AI chatbots, ChatGPT is primarily trained through non-supervised pretraining, which identifies underlying structure and patterns within input data. Then, human intervention addresses harmful or biased patterns that should not be propagated to generated outputs.

Such models are trained on massive amounts of data, which enable them to perform a variety of tasks, rather than being provided task-specific data to complete a narrow function. Such models come with high compute costs and potential trust issues due to the nature of their unorganized training data.

These networks—including the backbone of ChatGPT-3, which has approximately 175 billion parameters—naturally discover the implicit rules of grammar and syntax within language by identifying patterns. Deviations in word patterns add creativity to the text generation.

This automation is expected to impact both low- and high-wage roles, with those in customer service, food service, and office support being most likely to be affected. Large-scale investments in upskilling will be necessary to help individuals find new employment opportunities.

AI hallucinations are a by-product of the sequential creation of content based on patterns in text, which may not reflect the context or meaning behind a prompt. Back-end issues like biased datasets and overfitting of model data contribute to hallucinations.

These attacks can manipulate AI behavior by hiding instructions in websites and PDFs that become part of training data. The more companies connect sites, services, and sensitive datasets to AI tools, the greater the chances of exposure to malicious code.

Generative adversarial networks are a type of deep learning architecture that consists of a generator, which creates data that appear real, and a discriminator, which attempts to distinguish authentic from fake data. The two train in a competitive loop until the real and fictional data are indistinguishable.

A Freedom House report found that AI-powered disinformation campaigns and censorship tactics are spreading, with 16 countries utilizing the technology to shape online narratives or suppress dissent, as of 2023. In Venezuela, deepfake software was used to push pro-government propaganda with fake news anchors.