Peer review: Trial by Twitter
By APOORVA MANDAVILLI - NATURENEWS - NATURE.COM
Added: Sun, 23 Jan 2011 06:32:04 UTC
Via Not Exactly Rocket Science

Download a PDF of this article
Blogs and tweets are ripping papers apart within days of publication, leaving researchers unsure how to react.
Scientists discover keys to long life," proclaimed The Wall Street Journal headline on 1 July last year. "Who will live to be 100? Genetic test might tell," said National Public Radio a day later.
These and hundreds of similarly enthusiastic headlines were touting a paper in Science in which researchers claimed to have identified a set of genes that could predict human longevity with 77% accuracy — a finding with potentially huge implications for medicine, health policy and the economy.
But even as the popular media was trumpeting the finding, other researchers were taking to the web to criticize the paper's methodology. "We expect that most of the results of this study will not have the same longevity as its participants," sniped a blog posted by researchers at the personal genomics company 23andMe, based in Mountain View, California.
Critics were particularly perturbed by the genome-wide association study (GWAS) that the authors had used to identify their longevity genes: the centenarians and the controls in the study had been tested with different kinds of DNA chips, which potentially skewed the results.
"Basically anybody that does a lot of GWAS knows this [pitfall], which is why we all said it so fast," says David Goldstein, director of Duke University's Center for Human Genome Variation, who voiced his concerns to a Newsweek blogger the day the study appeared.
This critical onslaught was striking — but not exceptional. Papers are increasingly being taken apart in blogs, on Twitter and on other social media within hours rather than years, and in public, rather than at small conferences or in private conversation. In December, for example, many scientists blogged immediate criticisms of another widely publicized paper — this one heralding bacteria that the authors claimed use arsenic rather than phosphorus in their DNA backbone.
Read moreTweet
RELATED CONTENT
Richard Dawkins - Prospect 11 Comments
Richard Dawkins's review of The Social Conquest of Earth, by Edward O Wilson (WW Norton, £18.99, May)
Ancient walking mystery deepens
Helen Briggs - BBC News - Science &... 7 Comments
One of the first creatures to step on land could not have walked on four legs, 3D computer models show.
Seth Andrews - YouTube -... 24 Comments
The Center of all Things
An homage to Carl Sagan's "Pale Blue Dot," this video explores humankind's place in the cosmos.
Brian Greene - The Daily Beast 38 Comments
The latest developments in cosmology point toward the possibility that our universe is merely one of billions.
Take a stand for public access to...
Bonnie Swoger - Scientific American 5 Comments
Take five minutes of your time to say that yes, cancer patients, researchers, high school students and people around the country should be able to find out what their taxes already paid for.
Draining of world's aquifers feeds...
Damian Carrington - The Observer 3 Comments
"In the long run, I would still be more concerned about the impact of climate change, but this work shows that even if we stabilise the climate, we might still get sea level rise due to how we use water."



















Comments
Comment RSS Feed
Please sign in or register to comment
View Comments Page