Technology

In 2022, OpenAI's CEO, Sam Altman, popularized the use of large language models with the release of ChatGPT. He has emphasized the importance of involving society in shaping AI’s safety frameworks before models begin to act independently online.

Graphics processing units are specialized computer chips that can process multiple data streams in parallel, including pixel colors for a display. Such processing is required to find connections across text data and generate outputs quickly.

Training large language models begins with pretraining the model to predict the next word in a sequence based on finding patterns in massive amounts of text. Patterns are then fine-tuned to model human-written dialogue and to align responses with user preferences.

Large language models identify patterns in massive datasets of books, code, and unlabeled text from which to generate coherent responses. GPT-3 was trained on about 45 terabytes of data and uses 175 billion parameters—each parameter being a value the model adjusts as it learns.

Tokens are words or subwords (e.g., prefixes) that a large language model processes to generate a response. During training, the model is taught that if it ever generates a special token called end-of-sequence, its response is complete.

The minerals needed to build batteries for electric vehicles are expensive and often take a human toll paid by the communities where they are mined. This interactive article details what minerals make up an electric vehicle battery, where they come from, and dangers posed by the mining process.

Lithium is the driving force behind electric vehicles as the key element in the lithium-ion batteries that power the cars. But as demand for EVs rises, will global lithium supply keep pace with demand? This report projects demand will reach up to four million metric tons of the mineral compound containing lithium by 2030, with batteries accounting for 95% of end-use applications.

In IBM’s quantum lab, quantum processors are kept at a temperature of 15 millikelvin using dilution refrigerators. These refrigerators use nested thermal layers, cryogens like liquid nitrogen and helium, and powerful compressors to maintain the ultra-cold temperatures required for qubit stability and performance.

Classical computers manipulate bits as either 0 or 1, but quantum computers use qubits to hold combinations of both, enabling new algorithms. This new approach could one day help with breakthroughs in medicine, chemistry, and AI.

As computer parts shrink, transistors—tiny switches that control the path of electrical signals—become obsolete because electrons can quantum tunnel through switch barriers. This makes quantum computers, which take advantage of quantum effects, an enticing alternative.