The Sciences

NCBI ROFL: Inappropriate Fiddling with Statistical Analyses to Obtain a Desirable P-value.

DiscoblogBy ncbi roflOct 11, 2012 11:00 PM

Newsletter

Sign up for our email newsletter for the latest science news
 

Inappropriate Fiddling with Statistical Analyses to Obtain a Desirable P-value: Tests to Detect its Presence in Published Literature "Much has been written regarding p-values below certain thresholds (most notably 0.05) denoting statistical significance and the tendency of such p-values to be more readily publishable in peer-reviewed journals. Intuition suggests that there may be a tendency to manipulate statistical analyses to push a “near significant p-value” to a level that is considered significant. This article presents a method for detecting the presence of such manipulation (herein called “fiddling”) in a distribution of p-values from independent studies.Simulations are used to illustrate the properties of the method. The results suggest that the method has low type I error and that power approaches acceptable levels as the number of p-values being studied approaches 1000."

Photo: Wikimedia commons

Related content: Discoblog: NCBI ROFL: Amusing titles in scientific journals and article citation.

Discoblog: NCBI ROFL: Consequences of erudite vernacular utilized irrespective of necessity: problems with using long words needlessly.

Discoblog: NCBI ROFL: A new scientific source of bias: SILLY bias. Analysis of citations of BMJ’s Christmas articles.

NCBI ROFL. Real articles. Funny subjects. Read our FAQ

!

1 free article left
Want More? Get unlimited access for as low as $1.99/month

Already a subscriber?

Register or Log In

1 free articleSubscribe
Magazine Examples
Want more?

Keep reading for as low as $1.99!

Subscribe

Already a subscriber?

Register or Log In

More From Discover
Recommendations From Our Store
Shop Now
Stay Curious
Join
Our List

Sign up for our weekly science updates.

 
Subscribe
To The Magazine

Save up to 70% off the cover price when you subscribe to Discover magazine.

Copyright © 2021 Kalmbach Media Co.