What's up in
Large language models
Latest Articles
What Happens When AI Starts To Ask the Questions?
Technology has forever served as science’s toolbox. But now that AI is being used to develop questions and methods as well, some scientists wonder what their role is going to become.
Why Language Models Are So Hard To Understand
AI researchers are using techniques inspired by neuroscience to study how language models work — and to reveal how perplexing they can be.
When ChatGPT Broke an Entire Field: An Oral History
Researchers in “natural language processing” tried to tame human language. Then came the transformer.
What the Most Essential Terms in AI Really Mean
A simple primer to the 19 most important concepts in artificial intelligence.
To Make Language Models Work Better, Researchers Sidestep Language
We insist that large language models repeatedly translate their mathematical processes into words. There may be a better way.
Where Does Meaning Live in a Sentence? Math Might Tell Us.
The mathematician Tai-Danae Bradley is using category theory to try to understand both human and AI-generated language.
Why Do Researchers Care About Small Language Models?
Larger models can pull off greater feats, but the accessibility and efficiency of smaller models make them attractive tools.
The Poetry Fan Who Taught an LLM to Read and Write DNA
By treating DNA as a language, Brian Hie’s “ChatGPT for genomes” could pick up patterns that humans can’t see, accelerating biological design.
Chatbot Software Begins to Face Fundamental Limitations
Recent results show that large language models struggle with compositional tasks, suggesting a hard limit to their abilities.