Blog

Ready to get to grips with open peer review? In this blog post, we highlight 8 things you should know about open peer review and its role in the open research process.

Open peer review refers to the various possible modifications of the traditional single or double-blind peer review process that together make peer review more transparent. Open peer review is considered a more progressive approach than traditional models. Arguably, increased transparency in the peer review process not only leads to a greater understanding of the published research, but also more constructive peer reviews and public recognition for reviewers.

Just like traditional peer review models, open peer review is a key pillar of research communication. Scholars, scientists, and the public alike rely on peer review to uphold research integrity and ensure that published research is valid and trustworthy. There are a range of key differences between open peer review and blinded, closed models. Here, we’ll take a look at 8 essential facts you should know about open peer review.

#1: There are over 20 definitions of open peer review

It may be a surprise to some that there is no one universally agreed-upon definition of open peer review. One 2017 study found 22 distinct configurations of 7 key open peer review traits. According to this study, open peer review refers to some combination of openness involving:

• author and reviewer identities
• peer review reports
• participation of the wider research community in peer review
• reciprocal discussion between authors and reviewers
• publication of research in advance of peer review
• post-publication commenting
• publication platforms that separate the review process from the publication process

Gates Open Research operates a post-publication, open peer review model. Articles are published online and then undergo formal, open peer review by invited reviewers. Author and reviewer identities are open and the peer review reports are published alongside the article. Furthermore, the wider research community can get involved using the open commenting system. Authors are also encouraged to respond to reviewer reports directly on the platform.

#2: Open peer review reports are published alongside the research and given a unique DOI

Open peer review reports are just as accessible to any reader as the research itself. This allows readers to see the range of reviews the papers receive – positive, negative, and neutral – which often reflects the real breadth of expert opinion in controversial and cutting-edge areas of science.

On the Gates Open Research platform, all peer review reports are published alongside the research and given a unique digital object identifier (DOI). This means that the peer review report can be cited independently from the article. The full citation for a peer review report can be obtained by clicking the Cite button next to the peer review report.

#3: Open peer review means open identities, not only open reports

When invited reviewers submit their reports, their names and affiliations are also published. Incorporating open identities into the peer review model serves multiple purposes. Firstly, peer reviewers volunteer a considerable amount of time reviewing their peers’ work and providing suggestions for improvements. With open peer review, the reviewer can be recognized and acknowledged for their time and expertise. Secondly, when reviewers’ identities are known, there is an element of accountability to peer review. As the reviews themselves are open to public scrutiny, open peer review can improve the quality of the peer-review process itself. Additionally, unreported conflicts of interest may also be spotted by the wider research community. Finally, open identities arguably lead to more honest reviewing.

#4: Open peer review isn’t limited to just traditional research articles

On Gates Open Research, all article types go through the same open peer review system, including:

• Research Articles
• Method Articles
• Study Protocols
• Software Tool Articles
• Data Notes
• Registered Reports

Extending peer review beyond the validation of traditional Research Articles helps to ensure that all research outputs, no matter what format, can be trusted.

#5: Open peer review can take place following publication

With traditional peer review models, the journey from submission to peer review, and then to publication can take months—if not years. Conducting peer review after publication removes the delay for others who can benefit from accessing the work during the review period. Furthermore, this prevents research from being held up by a single reviewer and allows others in the field to assess the work for themselves and start building on it. On the Gates Open Research platform, an article’s peer review status is clearly signposted next to its title to ensure that readers are aware of which stage in the peer review process it has reached.

#6: Open peer review offers a unique opportunity for early career researchers (ECRs)

Early career researchers (ECRs) can participate in the open peer review process through co-reviewing. Co-reviewing is when the invited reviewer works with a colleague (often a more junior member of their team) to assess a manuscript together. Sometimes the invited reviewer will bring in a co-reviewer with specific expertise, to ensure all aspects of the article can be assessed fairly.  On Gates Open Research, the names of all co-reviewers are listed with the reviewer reports. This allows ECRs to receive credit for their labors, form connections with others in their field, and build their review portfolio.

#7: Open peer review involves participation from the wider research community

With open commenting, anyone in the research community can contribute to reviewing an article – not just the invited reviewers. This is to encourage open scientific discussion that both engage the scientific community and serves to improve the research. Anyone who wishes to comment on an article will be asked to declare any competing interests, along with their full name and affiliation.

#8: Open peer review can take place over a series of article versions and authors can respond

Authors can choose to submit a new version of their article to Gates Open Research, either address peer review comments or if they simply have further updates to share. Moreover, authors are encouraged to respond to peer review reports openly on the platform, so both the reviewers and any other readers can see what changes have been made or the reasons why an author may have decided not to implement a reviewer’s suggestion. Additionally, this facilitates scientific discussion between authors and peer reviewers. Finally, once a new version is published, it then undergoes open peer review for a second time.

Open peer review puts transparency center stage. Now you’re up to speed with what open peer review looks like in practice, why not explore the wider benefits of open research or some of the myths surrounding open data?