Register for an account


Enter your name and email address below.

Your email address is used to log in and will not be shared or sold. Read our privacy policy.


Website access code

Enter your access code into the form field below.

If you are a Zinio, Nook, Kindle, Apple, or Google Play subscriber, you can enter your website access code to gain subscriber access. Your website access code is located in the upper right corner of the Table of Contents page of your digital edition.


The Peer Reviewer's Dilemma

Neuroskeptic iconNeuroskepticBy NeuroskepticDecember 12, 2013 12:32 AM


Sign up for our email newsletter for the latest science news

While peer-reviewing a paper this week, I found myself in a quandry.


The study in question is an open-label, observational trial of a psychoactive medication. There's no control group and no randomization. Personally, I think such studies are of little scientific value, that they more often mislead than enlighten, and that they should only be published when exceptionally informative. But these studies do get published - in fact, rather similar articles have been published recently in the (mid-ranked) journal I'm reviewing for. Apart from having no comparison group, there is nothing wrong with this study - the sample size is decent, the paper is well-written, etc. In other words, by the standards of its genre, this manuscript is perfectly good. But I don't like the genre. So what should I do? Recommend acceptance, against my convictions? Wouldn't that be betraying my scientific integrity? Or do I recommend rejection, and be unfair to the authors? To reject would be unfair because many other reviewers, for this journal, evidently do accept manuscripts like this. If I rejected it, the authors might curse the capricious nature of peer review, and complain about being unlucky enough to get a reviewer with an axe to grind. They'd probably be right. I'm inclined to compromise, by accepting the paper, but only after demanding changes, to make the manuscript more open about the limitations of the design. But I have previously written that

The reviewers are often the ones who write the Limitations Section, but I think this is often a way of passing the buck... rather than bite the bullet and reject a paper, you may feel – well, being realistic, everyone’s in the same boat, who hasn’t cut corners, and we’ve all got to earn a living… etc… – so you recommend the paper is accepted, but in order to avoid feeling like a walkover, you make the authors include your concerns as Limitations.

Which is a stinging indictment of exactly what I'm proposing to do. Ooops. I wonder how other peer-reviewers resolve this dilemma?

    3 Free Articles Left

    Want it all? Get unlimited access when you subscribe.


    Already a subscriber? Register or Log In

    Want unlimited access?

    Subscribe today and save 70%


    Already a subscriber? Register or Log In