Register for an account

X

Enter your name and email address below.

Your email address is used to log in and will not be shared or sold. Read our privacy policy.

X

Website access code

Enter your access code into the form field below.

If you are a Zinio, Nook, Kindle, Apple, or Google Play subscriber, you can enter your website access code to gain subscriber access. Your website access code is located in the upper right corner of the Table of Contents page of your digital edition.

Mind

The Trouble With "Limitations" In Science

Newsletter

Sign up for our email newsletter for the latest science news

Is it always good thing to know your limitations?

limitations_science.png

Over at Scientific American, Samuel McNerneywrites about the dangers of learning about common human cognitive biases. The problem is that it's easy to find out about, say, confirmation bias, and think "Well, it affects other people, but now I know about it, I am immune to it" - and then proceed exactly as you did before, suffering the bias but now with misplaced confidence in your abilities. I fear that a similar thing is at work in science, in the form of the Limitations Section. It's become fashionable for scientific papers to end with a few paragraphs about "the limitations of the work". Why is this a problem? Well, just as a morally confused Catholic might prefer to confess his sins regularly rather than change his sinful ways, the Limitations Section can serve as a kind of ritual cleansing which makes poor scientific practice seem acceptable. There's a sense, usually unspoken, but I have heard it said, that "We acknowledge this limitation, so don't criticize it." Worse still, if papers are getting published despite the fact that even the authors admit to a certain limitation, it would be easy to conclude that the limitation isn't all that bad - so why should anyone bother fixing it? Still, at least acknowledged limitations provide the reader with something to go on. Worse are the trivial 'problems' that often fill the Limitations Section, taking up room that ought to be spent addressing the real flaws. This kind of thing is actively misleading. To say that a handful of minor issues are the limitations is tantamount to saying there are no major ones. When you think about it, it's strange that scientists are expected to be their own critics in this way. Surely the flaws are for the reader to judge? Or the peer reviewers? In fact, the reviewers are often the ones who write the Limitations Section, but I think this is often a way of passing the buck. When reviewing a manuscript, one sometimes feels that something about the study is flawed, not spectacularly so but seriously, and that in an ideal world it would prevent the paper from being published. But rather than bite the bullet and reject the paper, you may feel - well, being realistic, everyone's in the same boat, who hasn't cut corners, and we've all got to earn a living... etc... - so you recommend the paper is accepted, but in order to avoid feeling like a walkover, you make the authors include your concerns as Limitations. You act as the confessor for their scientific sins, in other words.

    2 Free Articles Left

    Want it all? Get unlimited access when you subscribe.

    Subscribe

    Already a subscriber? Register or Log In

    Want unlimited access?

    Subscribe today and save 70%

    Subscribe

    Already a subscriber? Register or Log In