Register for an account

X

Enter your name and email address below.

Your email address is used to log in and will not be shared or sold. Read our privacy policy.

X

Website access code

Enter your access code into the form field below.

If you are a Zinio, Nook, Kindle, Apple, or Google Play subscriber, you can enter your website access code to gain subscriber access. Your website access code is located in the upper right corner of the Table of Contents page of your digital edition.

Mind

Negative Results, Null Results, or No Results?

NeuroskepticBy NeuroskepticJune 14, 2016 11:28 PM

Newsletter

Sign up for our email newsletter for the latest science news

What happens when a study produces evidence that doesn't support a scientific hypothesis?

fixing_science.png

Scientists have a few different ways of describing this event. Sometimes, the results of such a study are called 'null results'. They may also be called 'negative results'. In my opinion, both of these terms are useful, although I slightly prefer 'null' on the grounds that the term 'negative' tends to draw an unfavorable contrast with 'positive' results. Whereas, my impression is that 'null' makes it clear that these are results in their own right, as they are evidence consistent with the null hypothesis. Yet there's another way of talking about evidence inconsistent with a hypothesis - such results are sometimes treated as not being results at all. In this way of speaking, to "get a result" in a certain study means to find a positive result. To "get no results" or "find nothing" means to find only null results - which, on this view, have no value of their own, serving only to mark the absence of some (positive) findings. This 'non-result' idiom is common usage in science - at least in my experience - but in my view, it's misleading and harmful. A null result is still a result, and it contributes just as much to our knowledge of the world as a positive result does. We may be disappointed by null results, and we may feel that they are not as exciting as the results we hoped to find, but these are really nothing more than our own subjective responses. The view that null results aren't really results is at the root of much of publication bias and motivates p-hacking. The only true "non"-results are results that are so low quality that they are uninformative, either due to poor experimental design or errors in data collection. These failed results may be, on the face of it, either positive or negative.

    2 Free Articles Left

    Want it all? Get unlimited access when you subscribe.

    Subscribe

    Already a subscriber? Register or Log In

    Want unlimited access?

    Subscribe today and save 70%

    Subscribe

    Already a subscriber? Register or Log In