Skip to content Skip to footer

Scholarly Mad Libs and Peer-Less Reviews

Scientific American published an investigative report documenting a new and curious form of scholarly publication fraud.

On December 17, 2014, Scientific American published an investigative report by journalist Charles Seife documenting a new and curious form of scholarly publication fraud, For Sale: “Your Name Here” in a Prestigious Science Journal. As an editor and supporter of evidence-based medicine I am both appalled by, and sympathetic to, how such widespread fraud could take place unnoticed.

Seife describes how he discovered the doctored writings:

The dubious papers aren’t easy to spot. Taken individually each research article seems legitimate. But in an investigation by Scientific American that analyzed the language used in more than 100 scientific articles we found evidence of some worrisome patterns—signs of what appears to be an attempt to game the peer-review system on an industrial scale…

…This is not a simple case of plagiarism. Many seemingly independent research teams have been plagiarizing the same passage. An article in PLOS ONE may eventually lead to ‘our better, comprehensive understanding’ of the association between mutations in the XRCC1 gene and thyroid cancer risk. Another in the International Journal of Cancer (published by Wiley) might eventually lead to ‘our better, comprehensive understanding’ of the association between mutations in the XPA gene and cancer risk—and so on. Sometimes there are minor variations in the wording but in more than a dozen articles we found almost identical language with different genes and diseases seemingly plunked into the paragraph, like an esoteric version of Mad Libs, the parlor game in which participants fill in missing words in a passage.

Another example virtually eliminates the likelihood of coincidence:

There is no such thing as a ‘Beggers funnel plot’…the proliferation of ‘Begger’s’ tests [were discovered] by accident. While looking for trends in medical journal articles, papers [were found] that had almost identical titles, similar choices in graphics and the same quirky errors, such as ‘Begger’s funnel plot.’

Seife’s investigative reporting revealed that China was the source of most of his “fill-in-the-blanks” research. Further,

Much of the funding for these suspect papers comes from the Chinese government. Of the first 100 papers identified by Scientific American [and listed at the close of his article], 24 had received funding from the National Natural Science Foundation of China (NSFC), a governmental funding agency roughly equivalent to the U.S.’s National Science Foundation. Another 17 acknowledged grants from other government sources.

Seife suspects that most research probably began as legitimate work without intent to deceive, but somewhere an author or service was added to help ensure publication through the necessarily arduous manuscript review process.

The culprit?

A quick Internet search uncovers outfits that offer to arrange, for a fee, authorship of papers to be published in peer-reviewed outlets. They seem to cater to researchers looking for a quick and dirty way of getting a publication in a prestigious international scientific journal.

Seife’s investigation goes undercover, 60 Minutes style:

In November Scientific American asked a Chinese-speaking reporter to contact MedChina, which offers dozens of scientific ‘topics for sale’ and scientific journal ‘article transfer’ agreements. Posing as a person shopping for a scientific authorship, the reporter spoke with a MedChina representative who explained that the papers were already more or less accepted to peer-reviewed journals; apparently, all that was needed was a little editing and revising. The price depends, in part, on the impact factor of the target journal and whether the paper is experimental or meta-analytic. In this case, the MedChina rep offered authorship of a meta-analysis linking a protein to papillary thyroid cancer slated to be published in a journal with an impact factor of 3.353. The cost: 93,000 RMB—about $15,000.

Finally, the corrosive effect of this particular fraud on scientific and medical publication is real:

Publishers at the moment are fighting an uphill battle. ‘Without insider information it’s very difficult to police this,’ Clinical Endocrinology’s Bevan says. CE and its publisher, Wiley, are trying to close loopholes in the editorial process to flag suspicious late changes in authorship and other irregularities. ‘You have to accept that people are submitting things in good faith and honesty,’ Bevan says.

That is the essential threat. Now that a number of companies have figured out how to make money off of scientific misconduct, that presumption of honesty is in danger of becoming an anachronism.

Were this the only threat currently facing research journals today! Last month, Retraction Watch published an article describing a known and partially-related problem: fake peer reviews, in this case involving 50 BioMed Central papers. In the above-described article, Seife referred to this BioMed Central discovery; he was able to examine 6 of these titles and found that all were from Chinese authors, and shared style and subject matter to other “paper mill-written” meta-analyses.

Retraction Watch agrees:

It would seem that a third party, perhaps marketing services helping authors have papers accepted, was involved.

Problems with peer review are longstanding editorial fodder. For a description of another recent peer review scam, this one involving authors hijacking researchers’ identities, see the article also written by Retraction Watch editors and published last month in Nature.

On Friday, in response to requests by several publishers, The Committee on Publication Ethics (COPE) posted a statement on inappropriate manipulation of peer review processes

While there are a number of well-established reputable agencies offering manuscript-preparation services to authors, investigations at several journals suggests that some agencies are selling services, ranging from authorship of pre-written manuscripts to providing fabricated contact details for peer reviewers during the submission process and then supplying reviews from these fabricated addresses. Some of these peer reviewer accounts have the names of seemingly real researchers but with email addresses that differ from those from their institutions or associated with their previous publications, others appear to be completely fictitious.

COPE recommends, among other things, the retraction of articles based solely on fraudulent reviews. Retraction Watch’s announcement earlier today of a MacArthur Foundation grant to help fund a comprehensive and freely available database of retractions could not have come at a better time!

Seife and Retraction Watch have documented new forms of published research fraud among third world researchers. Certainly the solution is not for editors and readers to suspect all papers from specific countries; there are ample instances of research fraud emanating from English-speaking researchers and top U.S. institutions. Research from around the world is critically important, particularly although not exclusively in the basic sciences, emerging infectious disease, and public health/epidemiology. Now that it has been identified, a common screening procedure for manuscripts at a journal can be adjusted to filter out this new form of plagiarism.

Sadly, it seems to me that fraudulent research of all types can flourish within a perfect storm of circumstances and factors: the globalization of science and medicine encourages non-or-limited English-speaking researchers to publish (or perish) in the highest impact English language journals; the proliferation of open-access wannabes, hybrids of every color and degree of sincerity, and other money-over-science journals and companies that rip off desperate and naïve researchers; a complicated, time-consuming and often author-unfriendly manuscript submission process; and journal editors who struggle with limited staffing and resources, necessarily arduous editorial processes, and the pressure of increasing numbers of worthy manuscripts deserving to reach the scientific and medical communities in near-real time. Research fraud is particularly destructive given traditional publishing’s ongoing struggle to survive the transformational Electronic Age; the pervasive if not perverse marketing of pharma, medical device companies, and self-promoting individuals and institutions using “unbiased” research; and today’s bizarrely anti-science culture.

Health Care Renewal is wonderful at calling out intentionally perpetrated health care events whose importance and implications can be debated, depending on one’s perspective and personal values. Here, I think, we have the reverse: there is near unanimity over the need to prevent fraudulent papers of any type from contaminating our research databases, as best as is humanly and technologically possible. There is also near unanimity among quality medical journals throughout the world, and internationally respected editor and publisher groups, to confront and solve these problems. The enemy identified by HCR is not always unrestrained greed or maliciousness. Sometimes, as in this case, the enemy is a cacophony of small circumstances and extraneous factors that could, if left unattended, invisibly erode something we all hold dear.

Without ongoing attention and support from the entire medical and science communities, we risk the progressive erosion of our essential, venerable research database, until it finally becomes too contaminated for even our most talented editors to heal.

Truthout Is Preparing to Meet Trump’s Agenda With Resistance at Every Turn

Dear Truthout Community,

If you feel rage, despondency, confusion and deep fear today, you are not alone. We’re feeling it too. We are heartsick. Facing down Trump’s fascist agenda, we are desperately worried about the most vulnerable people among us, including our loved ones and everyone in the Truthout community, and our minds are racing a million miles a minute to try to map out all that needs to be done.

We must give ourselves space to grieve and feel our fear, feel our rage, and keep in the forefront of our mind the stark truth that millions of real human lives are on the line. And simultaneously, we’ve got to get to work, take stock of our resources, and prepare to throw ourselves full force into the movement.

Journalism is a linchpin of that movement. Even as we are reeling, we’re summoning up all the energy we can to face down what’s coming, because we know that one of the sharpest weapons against fascism is publishing the truth.

There are many terrifying planks to the Trump agenda, and we plan to devote ourselves to reporting thoroughly on each one and, crucially, covering the movements resisting them. We also recognize that Trump is a dire threat to journalism itself, and that we must take this seriously from the outset.

After the election, the four of us sat down to have some hard but necessary conversations about Truthout under a Trump presidency. How would we defend our publication from an avalanche of far right lawsuits that seek to bankrupt us? How would we keep our reporters safe if they need to cover outbreaks of political violence, or if they are targeted by authorities? How will we urgently produce the practical analysis, tools and movement coverage that you need right now — breaking through our normal routines to meet a terrifying moment in ways that best serve you?

It will be a tough, scary four years to produce social justice-driven journalism. We need to deliver news, strategy, liberatory ideas, tools and movement-sparking solutions with a force that we never have had to before. And at the same time, we desperately need to protect our ability to do so.

We know this is such a painful moment and donations may understandably be the last thing on your mind. But we must ask for your support, which is needed in a new and urgent way.

We promise we will kick into an even higher gear to give you truthful news that cuts against the disinformation and vitriol and hate and violence. We promise to publish analyses that will serve the needs of the movements we all rely on to survive the next four years, and even build for the future. We promise to be responsive, to recognize you as members of our community with a vital stake and voice in this work.

Please dig deep if you can, but a donation of any amount will be a truly meaningful and tangible action in this cataclysmic historical moment.

We’re with you. Let’s do all we can to move forward together.

With love, rage, and solidarity,

Maya, Negin, Saima, and Ziggy