Health

When Brain Imaging Goes Awry

Analysis questions the validity of many fMRI studies.

By Lacy SchleyDec 15, 2016 6:00 AM
Brain imaging with fMRI reveals blood flow in the brain, serving as a proxy for activity, though some software accuracy was recently called into question. The images above, which weren’t part of that study, show the brain in a resting state. | Ann Choe et al./PLoS ONE/doi:10.1371/journal.pone.0140134/2015

Newsletter

Sign up for our email newsletter for the latest science news
 

Researchers in Sweden and the U.K. landed in the news over the summer, seeming to claim nearly 40,000 functional magnetic resonance imaging (fMRI) studies could be invalid. The problem? The most popular statistical analysis software packages could indicate significant brain activity where there wasn’t any, more than half the time.

FMRI is becoming a more common imaging technique in neuroscience largely because it maps brain activity over time. (Unlike MRI, which maps brain structure, fMRI reveals blood flow, a proxy for activity.) Once the MRI machine cranks out images, statistical analysis software pinpoints which brain areas were significantly more active and when.

The team claims the software packages they examined weren’t calibrated with real data, just simulated data. So they used fMRI scans from 499 healthy people in a resting state, and analyzed the data as they would in a traditional fMRI study. The researchers realized that one particular analysis variation was spitting out false positives at a rate of up to 70 percent.

While mainstream media jumped on the news, neuroscientists and other researchers have debated problems with fMRI statistical software and analysis methods for years. Plus, one of the authors, Thomas Nichols, issued a correction, dialing back the 40,000 figure: Updated language in the study now questions “the validity of a number of fMRI studies.”

“We have a collection of tools in the toolbox,” Nichols says. “What we showed is not that the whole toolbox is faulty . . . basically one wrench has a problem.”

1 free article left
Want More? Get unlimited access for as low as $1.99/month
Already a subscriber? Log In or Register
1 free articleSubscribe
Want unlimited access?

Subscribe today and save 70%

Subscribe

Already a subscriber? Log In or Register
More From Discover
Recommendations From Our Store
Shop Now
Stay Curious
Join
Our List

Sign up for our weekly science updates.

 
Subscribe
To The Magazine

Save up to 70% off the cover price when you subscribe to Discover magazine.

Copyright © 2021 Kalmbach Media Co.