CaraComp
Log inGet Started
CaraComp
Forensic-Grade AI Face Recognition for:
Get Started7-day refund guarantee**
facial-recognition

Cops Lost His Kids Over an 85% Guess — Your Face Could Be Next

Cops Lost His Kids Over an 85% Guess — Your Face Could Be Next

He had an alibi. He wasn't in the state. The camera footage was grainy. None of that stopped him from spending two months in jail, losing his job, losing his home, and losing custody of his two kids — all because a piece of software said his face looked like a suspect's face, and the people in charge decided that was enough.

TL;DR

Police departments across the U.S. are treating facial recognition "matches" — which are similarity scores, not fingerprints — as sufficient reason to arrest people, and the victims are overwhelmingly Black. At least 14 documented wrongful arrests later, the lesson still hasn't landed: a face match is a starting point, not a conclusion.

This is not a story about a glitch. It's not a story about one rogue officer or one broken department. It's a story about what happens when a tool designed to narrow down suspects gets used to end the investigation — and about who pays the price when that shortcut goes wrong.

What the Software Actually Does (And Doesn't Do)

Here's the part that nobody explains clearly enough: facial recognition doesn't tell police "this is your suspect." It tells them "this face looks similar to that face." There's a score. A percentage. Think of it like a dating app algorithm deciding two people might be compatible — it's a probability, not a fact.

In the case reported by Futurism, police ran surveillance footage through a facial recognition system that returned an 85% confidence match. Eighty-five percent sounds impressive — until you remember that means a 15% chance it's wrong, and that "confidence" is the software's internal estimate, not a legal standard of proof. They then layered two eyewitness accounts on top of that to establish what's called probable cause — the legal threshold (meaning: enough reason to believe a crime was committed by this person) for an arrest.

What they apparently didn't do first? Verify his alibi. Check whether he was even in the right city. The alibi that would later place him hundreds of miles away.

He was arrested anyway. This article is part of a series — start with Your Face Is About To Approve A 50 000 Wire Scammers Already.

14+
documented wrongful arrests in the U.S. directly linked to facial recognition misidentification — the majority of victims are Black
Source: ACLU

The Pattern Is Not a Coincidence

This isn't one bad case. The ACLU has documented more than a dozen wrongful arrests tied directly to facial recognition errors. Look at the names, the faces, the demographics of who got caught in this machine — and a pattern becomes impossible to ignore. Black people make up the overwhelming majority of victims.

That's not an accident of circumstance. It's a predictable outcome of how the technology was built. Researchers at the National Institute of Standards and Technology (NIST — a U.S. government agency that tests technology) analyzed 189 different facial recognition algorithms from 99 developers. Their finding, detailed by the Harvard Journal of Law & Technology, was stark: many of these systems misidentify Black and East Asian faces between 10 and 100 times more often than they misidentify white faces.

Ten to one hundred times. That's not a minor calibration issue. That's a structural flaw in the foundation — and police are building arrests on top of it.

Five Black plaintiffs are currently suing over wrongful arrests caused by facial recognition misidentification, according to NBC News. Their cases share the same ugly shape: software flags a face, police treat the flag as evidence, a person's life gets blown apart before anyone verifies whether the lead even holds up.

"Face recognition technology has a well-documented accuracy problem, and Black people are disproportionately likely to be misidentified. This technology is being used to identify suspects in criminal investigations, and police are then using those identifications to make arrests — even when there's evidence that the identification is wrong." ACLU
Trusted by Investigators Worldwide
Run Forensic-Grade Comparisons in Seconds
Court-ready facial comparison reports. Results in seconds.
Get Started
7-day refund guarantee**

The Warning Labels Nobody Read

Here's the part that genuinely makes you want to put your phone down in frustration: the companies selling this software and the departments approving its use already know these risks. Michigan State Police and the facial recognition vendor whose software was used in documented wrongful arrests both have explicit guidelines — written down, on the record — stating that a facial recognition result should never be used as the sole basis for an arrest.

Never. Their word, not ours. Previously in this series: You Verified Your Kids Age A Stranger Now Has Your Face.

And yet. The ACLU's analysis of whether those warnings actually work found something uncomfortable: even when officers follow the instruction to "take additional investigative steps," they frequently use those steps in ways that compound the original error rather than correct it. The eyewitnesses get shown a photo array (a lineup of photos) that's been subtly influenced by the original match. The investigators are already anchored on one suspect. The warning label is there, but the human brain ignores it once it thinks it already knows the answer.

So this isn't just "the technology is bad." The technology is flawed, yes. But the deeper problem is the workflow — the sequence of decisions that takes a probability score and treats it like a confession.

Why This Goes Wrong Every Time

  • The software scores similarity, not guilt — An 85% match means a 15% chance it's wrong. That's not a fingerprint. That's not even close to a fingerprint.
  • 📊 The bias isn't being accounted for — If a system misidentifies Black faces up to 100x more than white faces, using it without adjustment in predominantly Black communities is a compounding error, not a neutral tool.
  • 🔍 Anchoring makes verification shallow — Once investigators believe they have their person, follow-up steps often confirm the belief rather than test it. Eyewitnesses shown a suspect photo after a software match aren't independent corroboration — they're contaminated confirmation.
  • 🚨 The consequences are permanent — Lost jobs, lost housing, lost custody. Two months in jail while your alibi sits unverified doesn't give you those things back after you're released.

So What Should Actually Happen?

Look, nobody serious is arguing that facial recognition has zero place in police work. It helped identify a murder victim in Alabama using a reconstruction of her face — a case where the technology's pattern-matching ability did something genuinely useful. The question has never been "ban it or use it." The question is: what is a face match actually worth?

The answer, if we're being honest about what the software produces, is this: it's worth exactly what a tip from an anonymous informant is worth. It narrows the field. It gives investigators a direction. It is not, on its own, a reason to end someone's freedom.

Good investigative process would require independent corroboration before an arrest — not corroboration shaped by the match, but genuinely independent evidence. Check the alibi before you make the arrest. Confirm the suspect was in the right city before you put them in handcuffs. Run the match against your other evidence, not the other way around.

That's not a radical ask. That's how investigations are supposed to work anyway. Up next: Ai Regulation Africa Why Eu Model Doesnt Translate.

If you've ever wondered whether a photo or profile is really who it claims to be — whether that person online is actually the person they say they are — that's the exact question identity verification technology exists to answer. The difference between good and bad use of that technology is whether you treat the result as the beginning of the inquiry or the end of it. One useful thing you can do right now, in any context where someone's identity matters to you: never let a single data point be your whole case. A face match, a username, a profile picture — none of those things alone tell you who you're actually dealing with. Require more.

Key Takeaway

A facial recognition match is a similarity score — a lead, not a verdict. When police treat it as proof, real people with real alibis lose real things they never get back. The problem isn't just the technology. It's every decision-maker who looked at a number and called it done.


Ask the Room

Here's what we genuinely want to know, and it's not a hypothetical anymore given what's been documented: if a facial recognition system flagged your face with 85% confidence, what would you expect investigators to prove before your name showed up on an arrest warrant?

That's not a policy question. It's a personal one. And the fact that the answer feels obvious — of course they should verify my alibi first — makes it all the more worth asking why, for at least 14 documented people, the answer turned out to be: nothing. The software said so, and that was enough.

Drop your answer in the comments. We're listening.

The man described in this article was eventually released. His record was cleared. His job, his home, and his children were not automatically returned to him when it was.

Ready for forensic-grade facial comparison?

2 free comparisons with full forensic reports. Results in seconds.

Run My First Search