Y’all might remember the slight media coverage (ha!) of a very controversial fisheries paper published in 2006:
“Impacts of biodiversity loss on ecosystem services” by Boris Worm and others …demonstrated through a large body of evidence that biodiversity loss greatly reduces the ecosystem services that we obtain from the oceans, and also contained an analysis projecting “the global collapse of all taxa currently fished by the mid–21st century (based on the extrapolation of regression in Fig. 3A to 100% in the year 2048)”. This projection of global seafood collapse by 2048 was highlighted in their associated press release . The press release resulted in prominent coverage of the projection in major news outlets, and provoked a reaction from some fisheries researchers  and 10 rebuttals –, including three rebuttals by Ray Hilborn [who argued fisheries papers published in Science and Nature were selected for their publicity value, despite being scientifically flawed] –.
Despite the controversy, or perhaps because of it, Worm et al.  is a highly cited paper (799 citations at 20 January 2013 in the Web of Science), and was among the top 10 most cited fisheries papers in 2012 . Past citation analysis shows that the rebuttals to the 2048 projection in Worm et al.  had virtually no effect on citation rates or the impressions that people gained about this paper . (Branch 2013)
Trevor Branch, having long been captivated by fisheries research and having deep knowledge of this Worm et al. controversy, sat back in his chair, pented his fingers, and had an epiphany: “I’ve got it! We should analyze citation patterns for Worm et al. (2006)!” (a written dramatization of possibly real events). So he did. And the results are pretty awesome.
Sidenote: some of his methods were pretty badass.
Where gender [of a paper author] was not obvious it was inferred from the website Baby Name Guesser (http://www.gpeters.com/names/baby-names.php) which returns the ratio of male to female babies born with a particular name.
One of Branch’s main questions was, “Did the framing of the press release result in a greater frequency of citations mentioning the 2048 projection [mentioned in Worm et al 2006]?” – the answer was a resounding YES.
Thus, there is some evidence that increasing the prominence of the 2048 projection in the press release resulted in citing papers referring to this projection more often than expected.
However, Branch found that scientists who had a deeper understanding of the overall fisheries controversy were less likely to fall prey to the media hype:
Papers that mentioned the 2048 projection had characteristics that suggest unfamiliarity with the controversy surrounding this projection, namely papers with few authors, published in journals with low impact factors, in fields far removed from ecology and fisheries, and sharing no coauthors with the Worm et al. paper. For such papers, it is easy to see how the authors, editors, and reviewers could be unaware of the controversy over the 2048 projection.
These factors suggest that the more knowledgeable the authors of citing papers were about the controversy over the 2048 projection, the less likely they were to refer to it. A noteworthy finding was that if the original authors were also involved in the citing papers, they rarely (1 of 55 papers, 2%) mentioned the 2048 projection. Thus the original authors have emphasized the broader concerns about biodiversity loss, rather than the 2048 projection, as the key result of their study.
You can see these citation trends in the lovely Figure 2:
So that leave me asking…are us scientists just as prone to believe soundbites promoted by press releases and the media, particularly for hyped-up papers outside our own discipline? In the case of Worm et al. (2006), the message that “all fisheries will collapse by 2048” certainly seemed to spread like an urban legend in the peer-reviewed literature.
Reference: Branch TA (2013) Citation Patterns of a Controversial and High-Impact Paper: Worm et al. (2006) “Impacts of Biodiversity Loss on Ocean Ecosystem Services”. PLoS ONE 8(2): e56723. doi:10.1371/journal.pone.0056723