That "Study" You Just Read? 66% of Its Sources Don't Exist
Quick answer
How can you tell if a citation in a research paper is fake?
Check each part of the citation separately. Look up the author, confirm the paper appears in their body of work, and see whether the link actually leads to it. AI can pair real researcher names with invented titles, so a familiar name is not enough. Fakes usually fail when several checks are combined.
That "Study" You Just Read? 66% of Its Sources Don't Exist
This episode is based on our article:
Read the full article →That "Study" You Just Read? 66% of Its Sources Don't Exist
Full Episode Transcript
Picture this. A research paper clears peer review, not one expert, but three or more sign off on it. And buried inside are more than a hundred citations that point to studies that simply never existed. Researchers analyzed over four thousand papers at a major A.I. conference last year. They found fake references scattered across at least fifty-three of them. The experts read the papers. They just never checked whether the sources were real.
If you've ever trusted a report, a news article, or
If you've ever trusted a report, a news article, or a school essay because it looked well-sourced, this affects you. Because A.I. is now inventing citations that look flawless. And I want to be honest with you, that idea is unsettling. A fake source used to be a typo or a mix-up. Now it's something else entirely. But by the end of this, you'll know exactly how these fakes work, and how to catch one. So why are these fabrications so hard to spot?
Let's start with the plain version. When A.I. makes up a citation, it doesn't just scramble a real one. It builds a fake from scratch. According to that conference analysis, sixty-six percent of the documented fakes were total inventions, not corrupted versions of real papers. Complete fiction. And that matters, because a garbled citation looks like a mistake. A clean invention looks like the truth. This article is part of a series, start with Your Face Is Now Your Train Ticket And Nobody Asked You Firs.
Now here's the pattern that fools people. These fake citations often use real author names. The A.I. pairs a genuine, well-known researcher with a paper title that doesn't exist. So when you glance at it, your brain relaxes. You think, "I know that name, this must be legit." That's the trap. The author is real. The paper is not.
The best way I've heard this explained is a
The best way I've heard this explained is a counterfeit invoice. It's got the right letterhead, a real company name, proper formatting. It passes a ten-second look. But check three things, does the vendor exist, did they send this, is the invoice number in their sequence, and it falls apart instantly. Fake citations work the same way. The name checks out. The journal checks out. But the actual paper was never recorded anywhere. Previously in this series: How To Verify Ai Generated Research Papers Evidence Chain.
Now, you might assume older A.I. was the problem and newer models fixed it. Not quite. Baseline research found that an older model fabricated fifty-five percent of its citations. A newer one dropped to eighteen percent. Better, but eighteen percent is still nearly one in five. And the models lie more confidently on obscure topics. When there's little real research to contradict them, fabrication rates climb toward thirty percent.
And this is the number that stopped me cold. According to a Lancet study, fake references rose six-fold between 2023 and 2025. That's a six-hundred percent jump in two years. The problem isn't leveling off. It's accelerating. Up next: Ai Facial Recognition Doorbell Cameras Lawsuits Privacy.
The Bottom Line
And here's the part that changes everything. One hundred percent of these fakes fail on multiple layers at once, real name, fake title, a link that looks valid but leads nowhere. Any single check might pass. It's only when you verify all of them together that the deception collapses.
So let me leave you with the simple version. A.I. can invent research that looks completely real. It borrows real names to make fake papers feel trustworthy. And the only way to catch it is to verify the source, not just glance at it. Look up the author. Confirm the paper's actually in their work. Check that the link truly resolves. Whether you're an investigator building a case or a parent double-checking a headline, the rule is the same now, believing your eyes isn't enough. You have to follow the trail. The full breakdown's in the show notes.
Ready for forensic-grade facial comparison?
Full forensic reports with detailed similarity scoring. Results in seconds.
Run My First SearchMore Episodes
Age Verification: Windows 11 Sorts Kids Into 5 Age Boxes
Picture a twelve-year-old downloading a new game on the family laptop. Soon, that game may not need to ask how old she is. According to Microsoft, Windows 11 will already have an answer. <break time="
PodcastMicrosoft Windows 11 Age Verification: 3 ID Checks, 1 System
Soon, your Windows laptop may ask how old you are. To prove it, it might ask for a selfie. Microsoft is building age checks directly into Windows 11. The apps you use will never see
PodcastAge Verification: Apple Backs EU Plan It Fought in Texas
Apple once warned Texas lawmakers that checking ages at the app store would mean collecting sensitive personal information from every single Texan. Now Apple's C.E.O., Tim Cook, is publicly backing a plan in Europe that p
