Lorin Hochstein

Ramblings about software, research and other things

Redacting results in reviews

with 2 comments

Here’s a thought experiment: what if empirical software engineering papers were first reviewed with the results redacted? Once the reviewers had submitted the reviews of the redacted paper, they were then shown the full paper and did a full review. I wonder how much the final reviews would change in practice.

Advertisements

Written by Lorin

January 16, 2012 at 10:26 pm

Posted in research, software

2 Responses

Subscribe to comments with RSS.

  1. But what would you do with the discussion & abstract? Or do you mean to redact only the concrete findings (results of stats tests, for instance)?

    Jorge Aranda

    January 16, 2012 at 11:42 pm

    • The discussion would have to be fully redacted, and the abstract would need to be at least partially redacted. The idea is to have the reviewers read about the study without having any information about the outcome.

      Lorin

      January 17, 2012 at 8:31 am


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: