What Kind of Peer-Review Would Jesus Want?

By Jennifer Barone | April 11, 2008 10:02 am

For all those creationists out there wondering how to approach peer review in their brand new “journal,” Answers Research Journal, take heart: the latest edition has some friendly advice.

Despite the centrality of peer review to the development of a scholarly community, very little is known about the biblical basis and Christian conduct of peer review. We find that peer review is rooted in several Christian virtues, such as reflecting Christ, being honest, seeking wisdom, humbly submitting, showing Christian love, correcting error, and being accountable. Given these principles, we recommend that creationists use a double-blind peer review system, wherein the identities of the author and peer reviewers are confidential.

I think most scientists would agree that honesty, accountability, and the correction of errors are important aspects of the scientific review process. The “biblical basis” may seem a bit of a stretch, though, since last time we checked, peer review got going in the 17th century at the Royal Society of London. The ARJ paper does cite a lot of biblical passages, but I couldn’t find any describing how to get your new protein structure results thoroughly vetted and published. It’s also more than a bit disturbing that the authors don’t seem to view scientists whose “virtues” are rooted in any other tradition as qualified to take part in the process. Then again, what else would you expect from editors who have stated in their policy that they won’t publish anything that contradicts the biblical flood story or suggests that the earth is more than a few thousand years old?

As it turns out, the authors of the peer-review tract do realize that even insulating themselves from the real world may not be enough to keep publishing humming along. For instance, they point out that the tiny number of people who actually consider themselves creationists could pose a challenge. The authors wonder (and so do I)

if all the creationists with formal training in one field coauthored a paper together, what qualified peer is left to review it?

Now that would be a fine pickle, wouldn’t it?

But although the whole concept for the journal is a scientific joke (dictating in advance that your results must not contradict the Bible), I actually think the ARJ peer review recommendations got one thing right: double-blind review. That’s where the names of both the author(s) and reviewer(s) are concealed.

Most journals operate on a single-blind system, where reviewers know who the authors are, but not vice versa. Unfortunately, many studies have found that this system perpetuates a bias against female authors. When one journal introduced a double-blind system, they found a significant increase in the number of accepted papers written by women.

Single-blind reviewing also may benefit well-known, established authors with a long publication record, making it more difficult for promising work by new, relatively unknown researchers to make it into publication. Read more about why journals should double-blind here.

As for the ARJ, I applaud their double-blind review recommendation. It’s a pity there won’t be any actual science to evaluate.

  • Whisky Rabbi

    I always wondered how many creationists it takes to screw in a light bulb. This may not answer that, but at least now I know how many creationists it takes to co-author a non-peer-reviewable paper. At least not reviewed by creationist peers. God forbid — the God that created the world in 7 days that is — that a scientist review a creationist “science” journal article.

  • Maleduck

    If there is no “actual science to evaluate,” why is it that creation scientists always defeat evolution scientists in open debates?

  • solitha

    Probably because they don’t need all that tedious “evidence” stuff.

  • John Frum

    Whisky: Creationists don’t screw in light bulbs. Creationists screw in the dark, under covers, with their underwear on. While praying. For it to be pleasing to God, and for it to be over.

    Californians don’t screw in light bulbs either. Californians screw in hot tubs.

  • M Burke

    “Whisky Rabbi” and I wondered how many atheists it takes to screw in a lightbulb, but of course it’s clear, consistent atheists are too busy screwing each other to bother with the altruistic task of turning the lights on for others. Fortunately there are very few truly consistent atheists, and those that are we lock up.

    John Frum – atheists don’t screw in light bulbs, since evolved protoplasm has little use for light much less bulbs…

    Seriously, is this the best you can do… insult?


Discover's Newsletter

Sign up to get the latest science news delivered weekly right to your inbox!


Quirky, funny, and surprising science news from the edge of the known universe.

See More

Collapse bottom bar