What's up in

big data

Photo of Judea Pearl

To Build Truly Intelligent Machines, Teach Them Cause and Effect

Judea Pearl, a pioneering figure in artificial intelligence, argues that AI has been stuck in a decades-long rut. His prescription for progress? Teach machines to understand the question why.

A blue person made of code walks down a pink road patterned with hexagons

Best-Ever Algorithm Found for Huge Streams of Data

To efficiently analyze a firehose of data, scientists first have to break big numbers into bits.


Wanted: More Data, the Dirtier the Better

The computational immunologist Purvesh Khatri embraces messy data as a way to capture the messiness of disease. As a result, he’s making elusive genomic discoveries.

Tidal pool with ocean life
Abstractions blog

Awash in Sea of Data, Ecologists Turn to Open Access Tools

To assess the ocean’s health, ecology’s “rugged individualists” learned to get with the big data program.

Quantized Columns

Big Data’s Mathematical Mysteries

Machine learning works spectacularly well, but mathematicians aren’t quite sure why.

Data Driven: The New Big Science

The Future Fabric of Data Analysis

The nature of computing has changed dramatically over the last decade, and more innovation is needed to weather the gathering data storm.

Data Driven: The New Big Science

Our Bodies, Our Data

New technologies have launched the life sciences into the age of big data. Biologists must now make sense of their windfall.

Data Driven: The New Big Science

The Mathematical Shape of Things to Come

Scientific data sets are becoming more dynamic, requiring new mathematical techniques on par with the invention of calculus.

Data Driven: The New Big Science

A Digital Copy of the Universe, Encrypted

As physics prepares for ambitious projects like the Large Synoptic Survey Telescope, the field is seeking new methods of data-driven discovery.