Deepfakes Hit 8 Million. Courts Still Can't Trust the Evidence.

Last week, a UN report landed with the kind of quiet devastation that policy documents rarely manage. Roughly 98% of all deepfakes circulating online are non-consensual pornographic images of women. The content exists. The harm is documented. And in most countries, there is no law that specifically covers it. Less than half of all nations have any legislation addressing online abuse in this form. The tools to create the content cost nothing. The tools to fight it cost billions. And the courts? They're still figuring out what "proof" means in a world where video evidence is basically untrustworthy.

This week's headlines aren't separate stories. They're the same story told from three different angles: the abuse crisis, the identity verification scramble, and the emerging technology market trying to clean up both messes at once. If you work cases involving digital evidence — and increasingly, who doesn't — all three threads are heading straight for your desk.

The Scale Is Already Staggering. It's Also Getting Worse.

Here's a number that should stop you cold. According to research cited by Deloitte, online deepfakes grew from roughly 500,000 pieces of content in 2023 to approximately 8 million in 2025. That's a 16x increase in under two years. The detection market is growing at 42% annually and is projected to hit $15.7 billion by 2026. Those numbers sound impressive until you do the math: detection investment is scaling linearly while deepfake creation scales exponentially. Offense is still winning. For a comprehensive overview, explore our comprehensive facial recognition technology resource.

The UN News report focuses specifically on women as targets, and it's worth sitting with the institutional failure this represents. Survivors aren't just being harmed — they're being disbelieved. According to the UN Women explainer accompanying that report, deepfake images can be difficult to disprove precisely because gender stereotypes already undermine women's credibility. The deepfake doesn't just cause harm — it creates a secondary victimization loop where the target has to prove a negative to a skeptical audience. That's not a technology problem. That's a forensic standards problem that technology has to solve.

Meanwhile, the legislative response is fractured by design. South Dakota just signed a deepfake pornography felony bill. Washington state passed its own identity protection law. Germany is debating criminal statutes after a high-profile deepfake scandal. Minnesota's "anti-deepfake" law is being challenged on free speech grounds by the Liberty Justice Center. Every jurisdiction is writing its own rules, and none of them are synchronized. What's admissible in one courthouse may be inadmissible three states over — or completely unaddressed in the country where the content was created.

Identity Verification Is Going Biometric Whether You're Ready or Not

Thread two this week: proving who you are online is rapidly becoming synonymous with showing your face to an algorithm. Discord reportedly runs 269 separate checks that match user faces against databases during its age verification process. Australia's age verification laws triggered a reported 250% overnight VPN surge — people are willing to route their traffic through another country rather than submit a biometric. And yet the laws keep coming, because the alternative (unverified minors accessing harmful content) is politically untenable.

Korea extended its facial recognition phone activation pilot through June. The UK's Centre for Finance, Innovation and Technology is building frameworks for trusted business digital identity. Pakistan formally accepted digital ID in legal proceedings. Ghana is adding liveness detection to SIM verification. India's Aadhaar system now has 134 crore live holders — that's 1.34 billion people tied to a biometric record. This isn't a trend. It's infrastructure being poured while the concrete is still wet.

"AI-detection tools remain an emerging field where tools and methodologies are often proprietary and can introduce uncertainties in their results — making manual validation essential and reducing courtroom defensibility." — Kennedys Law, "86% Fake, 100% Admissible: Rethinking Evidence in the AI Era"

For investigators, this biometric default creates two simultaneous pressures. On one hand, more cases will hinge on identity — was this person actually present, did they actually send this message, is this actually their voice? On the other, the systems being built to answer those questions are themselves under scrutiny. Essex police just paused their facial recognition camera program after a study flagged racial bias. Spain fined identity tool Yoti for privacy violations in its biometric app. The tools exist. Their defensibility in court is still being negotiated.

A New Market Is Forming — And the Courtroom Is the Real Battleground

Thread three is where the money is moving, and it tells you everything about where the pressure is landing. VeryAI just raised $10 million to launch what it's calling a "Proof of Reality" identity verification platform. Neuramancer landed €1.7 million in pre-seed funding to scale deepfake detection tools. A major energy-backed venture fund invested in Resemble AI specifically to expand deepfake detection in the Middle East. Zoom integrated Pindrop's voice security to flag synthetic audio on calls. A biometric IDV startup just opened US operations and launched an anti-fraud suite simultaneously. Continue reading: Deepfakes Hit 8 Million Courts Still Cant Trust The Evidence.

Banks, courts, and platforms are all arriving at the same realization: they need technology that can say, with documented confidence, "this face and this identity belong to the same person" and "this audio or video has not been synthetically generated or tampered with." That's not a product category. That's a new standard of proof — one that will be written by whoever can make their methodology survive cross-examination.

Here's the thing about the Kennedys Law analysis that should keep investigators up at night: the problem isn't whether you can detect a deepfake. The Stimson Center's analysis of AI-facilitated violence lays it out plainly — the real obstacle is what happens when your detection result reaches a courtroom. Judges can't admit what they can't explain to a jury. Defense counsel will challenge the proprietary nature of any tool that produces its findings from a black box. And without a standardized certification framework for facial comparison analysts — which still doesn't formally exist — every expert opinion is vulnerable to being characterized as one person's guess dressed up in technical language.

As Fortune's deepfake outlook makes clear, real-time voice synthesis is no longer a threat on the horizon. It's already here. A CFO at a major firm was defrauded via deepfake video call. A York city councillor had a fabricated video circulating about them. Seniors are losing thousands to AI-generated phone scams that replicate the voices of family members. These aren't edge cases in a distant future — they're this week's headlines. Each one of those incidents becomes a case. Each case demands an investigator who can produce something more than "my gut said it was fake."

Platforms like CaraComp are built specifically for the documented, explainable facial comparison work that courts actually require — not just detection, but defensible methodology with audit trails. That distinction matters more than it ever has.