PLOS has posted a report, along with accompanying data, on qualitative research about how researchers assess credibility and impact of research in different contexts…
This blog was written by Giovanni Colavizza, Isla Staden, Kirstie Whitaker and Barbara McGillivray of the Alan Turing Institute and Iain Hrynaszkiewicz, PLOS and first appeared on their website.
As many of us adapt to the benefits of remaining connected with our peers and colleagues digitally, new evidence suggests that scholarly papers might get increased citations by staying digitally connected to the research data that support their results.
To promote open, reproducible research, many journals have started to encourage or even mandate that researchers share their research data and provide statements about the availability of their data in their published papers. These Data Availability Statements (DAS’s) in published papers (see Table for examples) provide a way to study if and how researchers share their data, and if data sharing correlates with citations of research.
Previous studies have explored researchers’ data-sharing practices and their associations with citation counts in specific journals, or in specific research disciplines only. We analysed more than half a million papers across multiple journals and research disciplines, to explore the following questions:
- Are authors taking up the challenge of data sharing?
- Is this beneficial for them as well as for the scientific community?
Using an automated approach designed for the study, we classified different kinds of data availability statements, according to their main categories (illustrated in Table 1). The outcome is important as statements that contain a link to research data available in a public repository (category 3) are considered to be preferable over all other types of statements. However, depositing data in a repository may be more time-consuming for researchers than other approaches.
We found that data availability statements are now very common in published papers. We also found that journal mandates to include these statements are effective, with big increases in the number of statements in 2014 and 2015, when PLOS (Public Library of Science) and BMC (BioMed Central), respectively, mandated them. When journals only encourage that authors provide a statement, only a small percentage of papers include them. In 2018 93.7% of 21,793 PLOS articles and 88.2% of 31,956 BMC articles had data availability statements. Yet, data availability statements containing a link to data in a repository are just a fraction of the total. In 2017 and 2018, 20.8% of PLOS publications and 12.2% of BMC publications provided DAS containing a link to data in a repository. Figure 1 gives an overview of data availability trends over time in PLOS journals, while Figure 2 exemplifies distinct approaches to data sharing from two BMC journals.
Figure 1: Data availability statements over time in PLOS. The histogram shows the number of publications from specific subsets of the dataset and DAS categories: No DAS (0), Category 1 (data available on request), Category 2 (data contained within the article and supplementary materials), and Category 3 (a link to archived data in a public repository). The vertical solid line shows the date when a mandated DAS policy was introduced.
Figure 2: Data availability statements over time in articles from the BMC Genomics journal (left; selected to illustrate a journal that had high uptake of an encouraged policy) and from the Trials journal (right; published by BMC, selected to illustrate a journal that has a very high percentage of data that can only be made available by request to the authors). The vertical solid line shows the date when a mandated DAS policy was introduced. A dashed line indicates the date an encouraged policy was introduced.
We also find that papers that link to data in a repository can have up to 25.36% (± 1.07%) higher citation impact on average, using a citation prediction model. While our results show that higher citations to a paper are correlated with linking to data in a repository, we cannot be certain this is the cause for the higher citations. However, this result may be encouraging for researchers, journals, publishers, funders and policymakers who are interested in data sharing and reproducible research. It suggests there might be a further incentive—beyond increasing transparency and reproducibility of results—to authors to make their data available using a repository.
There might be a variety of reasons for this effect. More efforts and resources are put into papers sharing data, thus this choice might be made for better quality articles. It is also possible that more successful or visible research groups have also more resources at their disposal for sharing data. Sharing data likely also gives more credibility to an article’s results, as it supports reproducibility. Finally, data sharing encourages re-use, which might further contribute to citation counts.
Researchers are concerned that there are insufficient resources and incentives to share their research data, and that more effort is required to publish data when publishing papers. However, this extra effort is really an investment rather than a cost. It is an investment in more reliable and reusable research for the scientific community, and this new evidence suggests it could also be a reasonable, “selfish” investment in researchers’ own reputations.
Read the authors’ paper in PLOS ONE: The citation advantage of linking publications to research data
Access the data in the following repository.