Police Facial Recognition: System Named a Living Man Dead

A computer told police that an eighteen-year-old man was dead. It named him as someone else entirely, a criminal from a different city. The only reason anyone caught the mistake? The man it named was alive, out on bail, and very much walking around.

This happened in Ludhiana, India

This happened in Ludhiana, India. Police say two alleged shooters died in an encounter with officers. They uploaded photos of the dead into a system called the Punjab Artificial Intelligence System. The software got one man right. The second? It flagged a young man named Gurpreet Singh as someone called Sandeep, because their faces looked alike. If you've ever thought a face-scan just confirms who someone is, this story is about you. Because here's the question that hangs over the whole thing, what happens when police treat a computer's guess as a fact?

Let's start with what actually went wrong in Ludhiana. The system didn't fail completely. It correctly matched one suspect. That's what makes this so slippery. One right, one wrong, same system, same moment, same incident. The error only surfaced when outside information reached police. Someone learned the man the software named was alive. Human detective work caught what the machine missed. For anyone who's ever trusted a confident answer on a screen, that should stick with you.

Now, why do these systems get faces wrong in the first place? A study out of M.I.T. found the error rate for dark-skinned women was nearly thirty-five percent. For lighter-skinned men? Under one percent. And researchers at N.I.S.T., the U.S. government's testing lab, found false matches up to a hundred times more likely for Black and Asian faces than for white men. A hundred times. So the tool doesn't just make mistakes. It makes them unevenly, depending on who you are.

And this isn't only happening overseas. A grandmother in Tennessee spent nearly six months in jail after software misidentified her. Six months. For a match that was wrong. Reporters say she's at least the ninth American this has happened to. Back in twenty-twenty, police in Detroit arrested a man based only on a facial recognition result. He was innocent. The city later paid him three hundred thousand dollars. The next time you unlock your phone with your face, remember, the same basic idea can put the wrong person in a cell.