What's up in
Neural networks
Latest Articles
Why Language Models Are So Hard To Understand
AI researchers are using techniques inspired by neuroscience to study how language models work — and to reveal how perplexing they can be.
How Can AI ID a Cat? An Illustrated Guide.
Neural networks power today’s AI boom. To understand them, all we need is a map, a cat and a few thousand dimensions.
When ChatGPT Broke an Entire Field: An Oral History
Researchers in “natural language processing” tried to tame human language. Then came the transformer.
What the Most Essential Terms in AI Really Mean
A simple primer to the 19 most important concepts in artificial intelligence.
AI Is Nothing Like a Brain, and That’s OK
The brain’s astounding cellular diversity and networked complexity could show how to make AI better.
The Strange Physics That Gave Birth to AI
Modern thinking machines owe their existence to insights from the physics of complex materials.
To Make Language Models Work Better, Researchers Sidestep Language
We insist that large language models repeatedly translate their mathematical processes into words. There may be a better way.
Why Do Researchers Care About Small Language Models?
Larger models can pull off greater feats, but the accessibility and efficiency of smaller models make them attractive tools.
The Physicist Working to Build Science-Literate AI
By training machine learning models with enough examples of basic science, Miles Cranmer hopes to push the pace of scientific discovery forward.