Archives

Categories

Ad Lagendijk Ad Lagendijk 20 May 2008

Should we pay referees?

Posted in Ethics, Getting published

For editors of scientific journals it is quite hard to find referees, leave alone good referees, for peer reviewing their received manuscripts. A good referee is a person that sends in a good referee report and does so in time, and responds quickly to additional requests from the editors. Why don’t peers want to review manuscripts of their colleagues?

There are a number of reasons. Professional scientists are very busy and – perhaps more importantly – they will never get public credit for their review job.

Immaterial rewards
In the journal Science several interesting articles have been published recently about the moral duty for scientists to do regularly review jobs. In In Search of Peer Reviewer editor William Perrin, from Southwest Fisheries Science Center, complains and does a simple calculation. He proves that for every manuscript that you submit you should do at least four review jobs. Perrin’s paper has provoked a number of comments (the above link will also show these reactions). It boils down to the suggestion that, by rewarding a reviewer in a way that will boost his career, more workers will accept to perform review tasks. An interesting action in the respect was recently announced by the American Physical Society(APS). The APS has published a list of their best referees for their journals. And indeed non-anonymous credit for a referee can only come from editors. But in my opinion this will not be incentive enough to convince scientists to do more and better review jobs.

Structured referee reports
There is an additional problem with writing referee reports and that complication is related to the development of the web. It becomes more and more involved to accept a referee job and to send in referee reports. To cut down on costs journals have decided to automate the communication with the referees (and authors). Editors like to classify, edit, and compile referee reports in a relational database like MySql. Referees now have to login to the journal’s website. The report has to be submitted through more and more involved web forms. Basically the burden of administration of manuscripts is taken away from the journals and put on the back of the referee. Fortunately many referees are stubborn and keep on sending in their referee reports as flat ascii files.

Solution
The solution is simple: pay the referee, with real money. I have suggested this over and over again to publishers. They always find other reasons for explaining to me that this will not work. I am still not convinced. Commercial publishers fear that financially rewarding referees will erode their profits and not-for-profit publishers have already a hard time surviving financially. But I will explain why it will work.

Authors pay
In the 1970’s and 1980’s respectable journals requested page charges for a paper to be published after its acceptance. Scientists from developing countries could be exempted from the charges if they would sign that their institute could not afford the money. The only penalty was a publication delay of a couple of months. To my great shame I must admit that scientists from rich countries like The Netherlands signed that waiver without having any problem with their conscience.

Nowadays page charges are back. Journals request extra money for publishing colored material and they ask money for putting the paper online. The OSA journal Optics Express does not do any editing anymore. They just make your article available online (there is no print issue). Authors (including myself) are very willing to pay the charges the journal requests from them. And rightly so. Research equipment, postdoc and PhD salaries, institutional overhead, etc., amount to so much money that the couple of thousand dollars to get the results publicized can almost be neglected. And if no paper was to be published all the invested money would have been wasted.

So I suggest journals to ask a submission fee from the authors in order for the referees to be paid. Let us say 600$ (300$ per referee). Advantages are plenty. Bogus submissions will be absent. Referees only get paid when they play according to the rules. Editor response times will be much shorter. If an author appeals an editorial decision and wants a new referee he has to come up with an extra 300$. The payment for each referee will be effected when the whole review process has come to an end, either until acceptance or rejection of the submitted manuscript.

Implementation
Paying a person anywhere in the world is very simple nowadays. For instance through PayPal. Referees that refuse to participate in this scheme will be sent a Amazon gift card. Or they can point out a charity that is to receive their fee. Some sales-tax problems have to be solved, but that cannot be unsurmountable.

- - - - - -
If you like this post why don't you email subscribe to our new posts. Or subscribe to our RSS feed.
  1. Unregistered

    20 May 2008 15:41, David Bradley

    During my time as Senior Assistant Editor on the RSC journal Chemical Communications, one of the most onerous tasks was to assign referees for the dozens of papers received each day. I can see why editors have opted for a technological solution for receiving reports, but perhaps a closed system along the lines of Yahoo Answers or the LinkedIn questions with a rewards scheme could be the way forward. A paper would be posted as a “question” to a particular section of the Answerers and comments/responses and reviews would receive a couple of points, best answers would earn more and once there was agreement on a paper, it would be accepted or rejected. Of course, that’s the whole notion of the online preprint system, but the technology could presumably be licensed to make it work in a very slick way.

    David Bradley Science Writer
    http://www.sciencebase.com

  2. Unregistered

    9 Jun 2008 9:55, David Lara

    I strongly believe that it is time that the referees stop being anonymous. I do research in Optics, and there are some topics that are dominated by few scientists that referee each other’s papers. I am a referee myself of some journals (as most of us are) and I will be very happy to make public my opinion about a paper.
    This small change is similar to giving money to referees, but in the form of recognition for a good review, and makes the person think twice before submitting a quick and lousy response to the journal.

  3. ad lagendijk

    10 Jun 2008 8:34, ad lagendijk

    David,
    thanks. I would not be against my own reviews carrying my own name. One of the problems would be that authors will contact reviewers directly to get their paper published. If the reviewer would be a junior scientist looking for a tenured job and the author an influential scientist life becomes very tough for the junior reviewer.

  4. Unregistered

    16 Jun 2008 8:51, Frerik van Beijnum

    I was wondering whether publishing the names of the good referees of an article would work. One could ask the author whether he would like to acknowledge reviewer 1 and/or 2 in the journal for their splendid reviews. Thereafter the journal can replace ‘reviewer 1’ by the real name. In this manner important seniors do not get offended publicly, and good referees get rewarded. An intrinsic risk is that all referees get acknowledged. That would result in a system that shows the active referees in the field, and might stimulate people to review more work.

  5. ad lagendijk

    19 Jun 2008 21:52, ad lagendijk

    Frerik,
    as you indicate yourself, your system would lead to a situation in which all referees would be acknowledged. In addition good referees sometimes (or often) advise to reject a paper. Those referees would never be rewarded. That would be an unwanted punishment.

  6. Unregistered

    29 Apr 2013 23:02, The Future of Scientific Peer Review | Rubriq Blog

    […] Should we pay referees? Ad Lagendijk 20 May 2008 For editors of scientific journals it is quite hard to find referees, leave alone good referees, for peer reviewing their received manuscripts. A good referee is a person that sends in a good referee report and does so in time, and responds quickly to additional requests from the editors. Share […]