The Rise of Citation Slop
A groundbreaking study finds that AI-fabricated references are a growing problem in biomedical research. www.nursing.columbia.edu/news/rise-ci...
@elisabethbik.bsky.social@bsky.brid.gy
The Rise of Citation Slop
“Yet a fabricated reference still snuck in, because of a routine formatting step that few researchers would consider risky. And it was caught only because that journal happens to verify references, which most do not.”
The result, published in The Lancet in May 2026, was the first systematic study of the authenticity of references in scientific literature—and a wakeup call about the potential impact of imaginative machines on the reliability of healthcare data.
Among the filtered references, the researchers identified 4,046 fake citations in 2,810 papers. The incidence rose sharply after mid-2024, coinciding with the widespread adoption of so-called “large language models,” or LLMs—the type of AI that, unlike older models, can help humans write
or edit documents, rather than simply discern patterns in masses of complex data. In 2023, 1 in 2,800 papers contained at least one fabricated reference; by early 2026, the ratio was 1 in 277.
The rate of fabrications rose more than 12-fold, from 4 per 10,000 papers in 2023 to 51 per 10,000 in the last quarter of 2025. It had reached 57 per 10,000 by early 2026.
The fakes were often uncannily convincing: perfectly formatted, plausibly dated, and credited to authors known for related work.
One paper had 30 references, 18 of which were phony. Some of those fabrications, they found, were already being cited by other papers and appearing in systematic reviews. And in over 98% of cases, the papers with fake references had received no correction, retraction, or expression of concern.
“Because clinical guidelines are based on evaluations of published research, fabricated references can directly impact patient care,” Topaz notes. “Nurses and doctors may increasingly be making treatment decisions based on studies that never happened.”😨
The irony, he adds, is that the team had deliberately kept AI out of the citation process, aware that such tools can introduce plausible-sounding falsehoods—commonly known as hallucinations—into research papers.