A recent study by The Washington Post has revealed a startling number of cases where innocent people have been accused or arrested for crimes because they were identified through a faulty deployment of AI-driven facial recognition software.

Katie Kinsey is chief of staff for the Policing Project at the NYU School of Law. According to Kinsey, such software is often used to analyze low-quality, grainy surveillance photos or images, and as a result perform demonstrably worse in real-world situations compared to laboratory tests involving crystal-clear, high-resolution images.

Additionally, police often succumb to a phenomenon known as “automation bias,” where people tend to believe that machines or computers are less biased and more trustworthy. This phenomenon, combined with other identification techniques with limited efficacy like witness testimony, often create scenarios where officers hastily jump to conclusions without doing their due diligence. Sometimes officers fail to account for the possibility that innocent citizens might bear physical similarities to criminal suspects. Other times, they rely on the facial recognition hit without using other forensic evidence for confirmation.

For example, a medical entrepreneur named Jason Vernau spent three days behind bars after being arrested for check fraud after police used facial recognition to ID him as a bank customer. In this case, the software was correct; Vernau had been in the Miami bank where the fraudulent check was deposited, but he was there to deposit a legitimate check. Had officers done even a cursory examination of his financial documents, or the time stamps in the security footage, they would’ve ruled him out as a suspect.

“This is your investigative work?” That’s what Vernau asked the detectives who questioned him. “You have a picture of me at a bank and that’s your proof? I said, ‘where’s my fingerprints on the check? Where’s my signature?’”

After Vernau was released, prosecutors later dropped the case, but Vernau said he is still working to get the charges removed from his record.

Possible Preaching Angles:

This story highlights several themes that resonate with biblical narratives, particularly concerning justice, false accusations, and the dangers of relying on flawed systems or human biases.