PLOS has posted a report, along with accompanying data, on qualitative research about how researchers assess credibility and impact of research in different contexts…
For a long time now, I’ve been beating the drum of “provide your data.” If you’re willing to take take a whole mess of measurements and do a whole bunch of analyses for a published paper, why not share the raw data? New techniques and research questions continually arise, so it can be invaluable for other workers to be able to draw upon previously published databases. Although the situation is improving, it’s still far from perfect. Even today, I’m somewhat embarrassed to point out that some articles in PLOS ONE (a journal whose mission I support as advocate and volunteer academic editor) don’t provide relevant supporting data (recent examples here and here). But rather than dwell on the negatives, I want to point out a recent case study (also in PLOS ONE!) where data reuse benefited authors, journals, and science as a whole.
Derek Larson (now a graduate student at University of Toronto) and Phil Currie (a paleontologist at University of Alberta) published a massive paper in PLOS ONE concerning the identity of carnivorous dinosaur teeth. Paleontologists have a love/hate relationship with these teeth. On the one hand, they’re cool and pointy and fierce-looking. There’s nothing more thrilling than finding a tyrannosaur tooth! On the other hand, teeth kinda stink when it comes to species identification. A dromaeosaurid (“raptor”) tooth is a dromaeosaurid tooth, and you’ll never be able to get down to species level in most cases. So, museums have drawers and drawers of teeth identified as “Tyrannosauridae” or “Troodontidae” or “Dromaeosauridae”. To make matters worse, the delicate skulls and skeletons of many of these carnivores (which are useful for identifying species) are pretty stinkin’ rare.
These vague tooth identifications are problematic for issues of paleoecology and evolutionary interpretations. Let’s say you have three different rock formations with dromaeosaurid teeth, spanning 10 million years of geological time. They all look pretty much the same, but it’s almost certain they represent multiple species (evidence from skeletons shows that dinosaur species just didn’t stick around for very long–a million years or so at most). This is a problem!
So the big question here is: can we actually find evidence that a dromaeosaurid tooth from the Hell Creek Formation (~66 million years old) is (or isn’t) the same species as a superficially similar tooth from the Dinosaur Park Formation (~76 million years old)? Or are teeth just totally useless? Fortunately, Derek and Phil found a clever work-around. By compiling measurements from over 1,200 different dinosaur teeth, they developed an analysis to look at the overall shapes of teeth from each formation. There is strength in numbers! It turns out that even though the teeth are superficially rather similar, there are subtle discrepancies in measurements between the teeth from rocks of different ages. This is thus consistent with different species at different time intervals. In other words, that dromaeosaurid tooth from 66 million years ago is probably not the same species as that tooth from 76 million years ago.
Here’s the really cool part: Derek and Phil were able to do their analysis so thoroughly and with such a large sample because other authors published measurements for theropod teeth! Although many measurements were original to the PLOS ONE paper, the great majority were from previous studies. Folks like Julia Sankey have released countless data tables of tooth measurements, mainly as a way to describe characteristics of particular specimens. Previous authors may not necessarily have been thinking of the type of analysis implemented by Derek and Phil, but nonetheless released data for others to see and use.
This is a win-win situation for everyone. Researchers Larson and Currie were able to merge the previously-published data with their own new data into a monster analysis (1,200+ data points, remember) that significantly advances science as a whole. These generous previous authors saved Larson and Currie perhaps months of work and thousands of dollars in museum travel! The previous authors also win, through increased utilization of their hard work as well as another citation for their papers. And at the basest level, the journals that allowed and encouraged massive data tables (either as supplementary information or in-text tables) win through an extra citation (which helps the almighty impact factor).
Derek and Phil are also paying it forward–all of their supporting data are accessible. If you want to re-run the analysis tonight, or add your own data, or whatever, you can do it! Here’s a big thank you to all of the folks who advance science by improving data sharing.
Larson DW, Currie PJ (2013) Multivariate analyses of small theropod dinosaur teeth and implications for paleoecological turnover through time. PLOS ONE 8(1): e54329. doi:10.1371/journal.pone.0054329 [open access]