Protocols.io Tools for PLOS Authors: Reproducibility and Recognition
Solutions to the challenges of reproducibility in experimental science should be as diverse as the challenges themselves. Inconsistent reagents, barriers to the open sharing of supporting data, experimental variation that goes unrecorded and researcher’s concerns for lack of recognition and credit for novel and meticulously created experimental methods all contribute to the challenges of reproducibility in biomedical research.
PLOS now partners directly with protocols.io to provide authors better ways to share methodological details about their work, practical tools to reduce wasted research efforts and persistent, citable identifiers for laboratory methods. For PLOS, this is a step forward on commitments to address reproducibility and provide improved recognition and credit for all contributions to a work.
“We are delighted to be associated with a like-minded partner such as PLOS,” says protocols.io CEO Lenny Teytelman. “We are aligned in our Open Access ethos, and we strive to facilitate the communication of research in an effective, accessible and reusable way.”
This new offering complements PLOS’ already robust data availability policy, requiring that data underlying the conclusions of an article be made available at the time of publication. Since the strengthening of this policy in 2014, about 60,000 articles have been published that contain a Data Availability Statement.
“We are excited to engage with protocols.io,” says PLOS Executive Editor Veronique Kiermer. “This is another step towards Open Science, facilitating access not only to the data but now also to the laboratory methodology that generated these data.”
How It Works
Researchers are encouraged, at their discretion, to deposit their laboratory protocols on the protocols.io site, obtain a unique DOI and link directly to these from the Methods section of their articles. The unique link allows reviewers and editors access to the protocols during peer review. At the time of publication, the partnership between PLOS and protocols.io ensures that links to and from the published article are established and protocols are automatically made publicly available under a CC BY license for anyone to access, use and cite.
Archived and linked permanently to and from the article, protocols become part of the scientific record. The protocols.io application allows scientists to create, copy, modify and evolve laboratory protocols, describing the critical details of experimental procedures that are often overlooked in articles Methods sections. While detailed steps in a protocol may evolve and improve over time, the version that relates to the published article remains accessible to help explain experimental nuances.
“Methods sections that describe laboratory experiments are narratives that tend to omit subtle variations that may affect the experiments,” says Kiermer. “I hope that scientists will take up the opportunity to describe their methods in a way that is much more useful to others.”
Nuanced methodological details can be shared in new ways, that in time can integrate seamlessly into the research cycle, from bench to publication and back. “It is not merely a tool for publication,” says Teytelman, “it can be useful as a lab tool, at the bench, for record keeping and for sharing expertise within and outside a laboratory.”
Engaged commenting on the protocols.io website allows interested readers to clarify and discuss deeper with others using an article’s methodology. “This partnership will improve reproducibility of published research while fostering scientists’ collaborative engagement with our content,” adds Kiermer.
A DOI for methods, citable by others, provides more granular credit to those individuals contributing to methodological development. It also enables researchers to compare methodological details between laboratories pursuing similar approaches or between published experimental methods and those subtly revised by users. In this respect, protocols.io helps bridge an information gap between published experimental methods and methods refined over time.
PLOS looks forward to authors’ participation in this novel approach to enhancing Methods sections—an Open Access tool to record and share detailed protocols. We hope you try it and let us know your experience via comment below or email to communications@plos.org.
Hero image inset credit (CC BY): Bandage plot of transcripts assembled by J. Mamrot
I am intrigued by the image from the top of the page (the squared shaped, black background one), where is it from? Thank you.
Does protocols.io accept video protocols? These can be beneficial but the main publishing venue for video protocols is very expensive to access.
Yes, we thought it interesting too. The image credit and link to the protocols.io page are at the bottom of the blog post.
Images and video can significantly help to clarify and simplify protocol instructions. Protocols.io encourages including them at the step-level or in the guidelines. For videos that are more generic to the entire article, or to specific results, PLOS also accepts video in a variety of formats. Please see Supporting Information instructions on any journal site.
https://www.protocols.io/view/how-to-make-your-protocol-more-reproducible-discov-g7vbzn6?step=8
http://journals.plos.org/plospathogens/s/supporting-information
Hi Marius,
The image is mine: it’s visual representation of de novo assembled transcripts known as a Bandage plot (http://rrwick.github.io/Bandage/).
The ‘squiggles’ are actual transcripts (genes) from the spiny mouse transcriptome, which I assembled and validated using the protocol I posted on protocols.io: https://www.protocols.io/view/de-novo-transcriptome-assembly-workflow-using-rna-ghebt3e
If you would like to know anything more, please feel free to email me, or if you’re on twitter: @Jared_Mamrot
jared.mamrot@hudson.org.au
Thanks,
Jared
[…] above Hopefully you know already about the PLOS partnership with protocols.io; if you don’t, PLOS announced this almost exactly a month ago. What we didn’t tell you then was that PLOS Biology had been […]
There are other protocol platforms / journals out there, e.g. JMIR Research Protocols (http://www.researchprotocols.org). I am not sure why PLOS is supporting only one specific vendor.
Authors are free to cite protocols published elsewhere. PLOS and protocols.io worked together to organize the flow in an author-friendly way and to ensure long-term preservation of the methods and bi-directional links between article and protocol. The partnership is not exclusive and authors can use other platforms that offer similar guarantees of preservation.
Dear Dr. Eysenbach,
Our protocols.io is not a journal but a repository. Like Dryad for data or GitHub for code, we are a repository for protocols that accompany published papers. We are also like bioRxiv for protocol preprints.
We do not do peer review and are not a journal. We are not in competition with your JRP, Nature Protocols, Current Protocols, Nature Methods, MethodsX, Bio-protocol, or any of the other method-centered journals.
Kind regards,
Lenny Teytelman
CEO, protocols.io
The partnership with protocols.io is one way of facilitating the sharing of detailed methodological information — in a way that is open, persistent and practical for authors and readers — but it is by no means an exclusive ‘marriage’. We worked with protocols.io to make sure these criteria of persistence and openness were met, but authors are free to use any other open repositories that meet these criteria, or to supply detailed protocols in supplementary information. Depositing a protocol is optional, and all authors must comply with PLOS’ robust data availability policy. It is the principle of sharing protocols and data that PLOS endorses.
[…] eLife and Bio-Protocol for partnering together to get complete protocols out there. I know that PLOS and protocols.io have done the same thing as well and hopefully many more journals will follow […]
We hope so too!
[…] of our authors and the wider scientific community. Like our partnership with protocols.io for laboratory methods citations and collaboration with bioRxiv for preprints with our journal submissions, this is just one more […]
[…] of our authors and the wider scientific community. Like our partnership with protocols.io for laboratory methods citations and collaboration with bioRxiv for preprints with our journal submissions, this is just one more […]
[…] to encourage precision and to facilitate the sharing of these details. We’re excited that our partnership with them over the past year is providing yet another catalyst for transforming research […]
[…] to encourage precision and to facilitate the sharing of these details. We’re excited that our partnership with them over the past year is providing yet another catalyst for transforming research […]
[…] to encourage precision and to facilitate the sharing of these details. We’re excited that our partnership with them over the past year is providing yet another catalyst for transforming research […]
[…] Protocols.io Tools for PLOS Authors: Reproducibility and Recognition [Internet] https://blogs.plos.org/plos/2017/04/protocols-io-tools-for-reproducibility/ […]
[…] 11. PLOS. Protocols.io Tools for PLOS Authors: Reproducibility and Recognition. 2017. Available from: https://blogs.plos.org/plos/2017/04/protocols-io-tools-for-reproducibility/ […]