Police Facial Recognition Technology Can’t Tell Black People Apart – Scientific American
Imagine being handcuffed in front of your neighbors and family for stealing watches. After spending hours behind bars, you learn that the facial recognition software state police used on footage from the store identified you as the thief. But you didnt steal anything; the software pointed cops to the wrong guy.
Unfortunately this is not a hypothetical. This happened three years ago to Robert Williams, a Black father in suburban Detroit.Sadly Williams story is not a one-off. In a recent case of mistaken identity, facial recognition technology led to the wrongful arrest of a Black Georgian for purse thefts in Louisiana.
Ourresearch supports fears that facial recognition technology (FRT) can worsen racial inequities in policing. We found that law enforcement agencies that use automated facial recognition disproportionately arrest Black people. We believe this results from factors that include the lack of Black faces in the algorithms training data sets, a belief that these programs are infallible and a tendency of officers own biases to magnify these issues.
While no amount of improvement will eliminate the possibility of racial profiling, we understand the value of automating the time-consuming, manual face-matching process. We also recognize the technologys potential to improve public safety. However, considering the potential harms of this technology, enforceable safeguards are needed to prevent unconstitutional overreaches.
FRT is an artificial intelligencepowered technology that tries to confirm the identity of a person from an image. The algorithms used by law enforcement are typically developed by companies like Amazon, Clearview AI and Microsoft, which build their systems for different environments.Despite massive improvements in deep-learning techniques, federal testing shows that most facial recognition algorithms perform poorly at identifying people besides white men.
Civil rights advocates warn that the technology struggles to distinguish darker faces, which will likely lead to more racial profiling and more false arrests. Further, inaccurate identification increases the likelihood of missed arrests.
Still some government leaders, including New Orleans Mayor LaToya Cantrell, tout this technology's ability to help solve crimes. Amid the growing staffing shortages facing police nationwide, some champion FRT as a much-needed police coverage amplifierthat helps agencies do more with fewer officers. Such sentiments likely explain why more than one quarter of local and state police forces and almost half of federal law enforcement agencies regularly access facial recognition systems, despite their faults.
This widespread adoption poses a grave threat to our constitutional right against unlawful searches and seizures.
Recognizing the threatto our civil liberties, cities like San Francisco and Boston banned or restricted government use of this technology. At the federal level President Bidens administration released the Blueprint for an AI Bill of Rights in 2022. While intended to incorporate practices that protect our civil rights in the design and use of AI technologies, the blueprints principles are nonbinding. In addition, earlier this year congressional Democrats reintroduced the Facial Recognition and Biometric Technology Moratorium Act. This bill would pause law enforcements use of FRT until policy makers can create regulations and standards that balance constitutional concerns and public safety.
The proposed AI bill of rights and the moratorium are necessary first steps in protecting citizens from AI and FRT. However, both efforts fall short. The blueprint doesnt cover law enforcements use of AI, and the moratorium only limits the use of automated facial recognition by federal authoritiesnot local and state governments.
Yet as the debate heats up over facial recognitions role in public safety, our research and others show how even with mistake-free software, this technology will likely contribute to inequitable law enforcement practices unless safeguards are put in place for nonfederal use too.
First, the concentration of police resources in many Black neighborhoods already results in disproportionate contact between Black residents and officers. With this backdrop, communities served by FRT-assisted police are more vulnerable to enforcement disparities, as the trustworthiness of algorithm-aided decisions is jeopardized by the demands and time constraints of police work, combined with an almost blind faith in AI that minimizes user discretion in decision-making.
Police typically use this technology in three ways: in-field queries to identify stopped or arrested persons, searches of video footage or real-time scans of people passing surveillance cameras. The police upload an image, and in a matter of seconds the software compares the image to numerous photos to generate a lineup of potential suspects.
Enforcement decisions ultimately lie with officers. However, people often believe that AI is infallible and dont question the results. On top of this using automated tools is much easier than making comparisons with the naked eye.
AI-powered law enforcement aids also psychologically distance police officers from citizens. This removal from the decision-making process allows officers to separate themselves from their actions. Usersalso sometimes selectively follow computer-generated guidance, favoring advice that matches stereotypes, including those about Black criminality.
Theres no solid evidence that FRT improves crime control. Nonetheless, officials appear willing to tolerate these racialized biases as cities struggle to curb crime.This leaves people vulnerable to encroachments on their rights.
The time for blind acceptance of this technology has passed. Software companies and law enforcement must take immediate steps towards reducing the harms of this technology.
For companies, creating reliable facial recognition software begins with balanced representation among designers. In the U.S. most software developers are white men. Research shows the software is much better at identifying members of the programmers race. Experts attribute such findings largely to engineers unconscious transmittal of own-race bias into algorithms.
Own-race bias creeps in as designers unconsciously focus on facial features familiar to them. The resulting algorithm is mainly tested on people of their race. As such many U.S.-made algorithms learn by looking at more white faces, which fails to help them recognize people of other races.
Using diverse training sets can help reduce bias in FRT performance. Algorithms learn to compare images by training with a set of photos. Disproportionate representation of white males in training images produces skewed algorithms because Black people are overrepresented in mugshot databases and other image repositories commonly used by law enforcement. Consequently AI is more likely to mark Black faces as criminal, leading to the targeting and arresting of innocent Black people.
We believe that the companies that make these products need to take staff and image diversity into account. However, this does not remove law enforcements responsibility. Police forces must critically examine their methods if we want to keep this technology from worsening racial disparities and leading to rights violations.
For police leaders, uniform similarity score minimums must be applied to matches. After the facial recognition software generates a lineup of potential suspects, it ranks candidates based on how similar the algorithm believes the images are. Currently departments regularly decide their own similarity score criteria, which some experts contend raises the chances for wrongful and missed arrests.
FRTs adoption by law enforcement is inevitable, and we see its value. But if racial disparities already exist in enforcement outcomes, this technology will likely exacerbate inequities like those seen in traffic stops and arrests without adequate regulation and transparency.
Fundamentally police officers need more training on FRTs pitfalls, human biases and historical discrimination. Beyond guiding officers who use this technology, police and prosecutors should also disclose that they used automated facial recognition when seeking a warrant.
Although FRT isnt foolproof, following these guidelines will help defend against uses that drive unnecessary arrests.
This is an opinion and analysis article, and the views expressed by the author or authors are not necessarily those ofScientific American.
See the original post:
Police Facial Recognition Technology Can't Tell Black People Apart - Scientific American
- KIA installs free anti-theft software this weekend in St. Louis area - KSDK.com - April 28th, 2024 [April 28th, 2024]
- KIA installing free anti-theft software to impacted car owners - WHAS11.com - April 28th, 2024 [April 28th, 2024]
- Free Windows Apps and Software for PC Gamers to Take Gaming to the Next Level - Gizchina.com - April 28th, 2024 [April 28th, 2024]
- Best survey tool of 2024 - TechRadar - April 28th, 2024 [April 28th, 2024]
- Grand Rapids Police and Hyundai Offer Free Anti-Theft Software Upgrades Amid Vehicle Theft Wave - Hoodline - April 26th, 2024 [April 26th, 2024]
- Blueprint Software Systems Announces Free Trial for RPA Analytics Solution - PR Web - April 26th, 2024 [April 26th, 2024]
- Houston Police, Hyundai to host free anti-theft security event for vehicle owners - Houston Public Media - April 26th, 2024 [April 26th, 2024]
- Descartes Systems buys Aerospace Software Developments Winnipeg Free Press - Winnipeg Free Press - April 26th, 2024 [April 26th, 2024]
- Kia offers free software upgrades in Cleveland this weekend - WKYC.com - April 20th, 2024 [April 20th, 2024]
- Free software lets you design and test warp drives with real physics - New Atlas - April 20th, 2024 [April 20th, 2024]
- Clinic offering free Kia software updates continuing through weekend - Yahoo! Voices - April 20th, 2024 [April 20th, 2024]
- Hyundai providing free anti-theft software installation this weekend at Greenspoint Mall - KHOU.com - April 20th, 2024 [April 20th, 2024]
- Kia offers free software upgrades in Cleveland this weekend: How to get yours - WKYC.com - April 20th, 2024 [April 20th, 2024]
- Hyundai providing free anti-theft software installion in Houston - KHOU.com - April 20th, 2024 [April 20th, 2024]
- Kia gives free software upgrades this weekend at the Cleveland Aquarium - WKYC.com - April 20th, 2024 [April 20th, 2024]
- Ubuntu Studio in new LTS beta; still the easiest creative Linux distro - CDM Create Digital Music - Create Digital Music - April 20th, 2024 [April 20th, 2024]
- Free anti-theft software upgrades available for Central Texas Hyundai drivers - KEYE TV CBS Austin - March 15th, 2024 [March 15th, 2024]
- How to get free help with income tax prep, or free software | Business | postandcourier.com - The Post and Courier - February 23rd, 2024 [February 23rd, 2024]
- Best encryption software of 2024 - TechRadar - February 23rd, 2024 [February 23rd, 2024]
- The best free VPN in 2024 - TechRadar - February 23rd, 2024 [February 23rd, 2024]
- AI imaging software generates a gallery of stereotypes, says Univ. of ... - GeekWire - November 28th, 2023 [November 28th, 2023]
- Roku's free update that makes it easier to find new shows and ... - TechRadar - November 28th, 2023 [November 28th, 2023]
- How To Find Alternatives To ChatGPT Forbes Advisor UK - Forbes - November 28th, 2023 [November 28th, 2023]
- How To Find Alternatives To ChatGPT Forbes Advisor Australia - Forbes - November 28th, 2023 [November 28th, 2023]
- Assassin's Creed Syndicate is now free to keep on Ubisoft Connect - OC3D - November 28th, 2023 [November 28th, 2023]
- Google Confirms Its Schedule for Disabling Third-Party Cookies in ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Tata Consultancy Services Ordered To Cough Up $210 Million In ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Meta Knowingly Collected Data on Pre-Teens, Unredacted ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- US, Britain, Other Countries Ink Agreement To Make AI 'Secure by ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Plex Users Fear New Feature Will Leak Porn Habits To Their ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- This free software converts drone videos into 2D maps in minutes! - DroneDJ - November 14th, 2023 [November 14th, 2023]
- How 'Hour of Code' Will Teach Students About Issues with AI - Slashdot - November 14th, 2023 [November 14th, 2023]
- Nothing is Bringing iMessage To Its Android Phone - Slashdot - November 14th, 2023 [November 14th, 2023]
- How To Build A WordPress Website In 9 Steps - Forbes - November 1st, 2023 [November 1st, 2023]
- Best Adobe Acrobat free alternatives - PC Guide - For The Latest PC Hardware & Tech News - November 1st, 2023 [November 1st, 2023]
- Monday.com Pricing and Plans 2023 Forbes Advisor Canada - Forbes - November 1st, 2023 [November 1st, 2023]
- PIRG Petitions Microsoft To Extend the Life of Windows 10 - Slashdot - November 1st, 2023 [November 1st, 2023]
- Kidsoft launches free calculator to simplify "Free Kindy" fee working - The Sector - November 1st, 2023 [November 1st, 2023]
- Drugmakers Are Set To Pay 23andMe Millions To Access Consumer ... - Slashdot - November 1st, 2023 [November 1st, 2023]
- Biden Signs Executive Order To Oversee and Invest in AI - Slashdot - November 1st, 2023 [November 1st, 2023]
- Meta's Next AI Attack on OpenAI: Free Code-Generating Software - The Information - August 18th, 2023 [August 18th, 2023]
- Millions of Samsung Galaxy S23 users just got a sweet free software ... - Yahoo Life - August 18th, 2023 [August 18th, 2023]
- Red Hat unlikely to be standard for enterprise Linux in future, says ... - iTWire - August 18th, 2023 [August 18th, 2023]
- Observing Basics: Astrophotography without a scope | Astronomy.com - Astronomy Magazine - August 18th, 2023 [August 18th, 2023]
- Chattanooga trucking and logistics companies are among the fastest ... - Chattanooga Times Free Press - August 18th, 2023 [August 18th, 2023]
- How Google is Planning To Beat OpenAI - Slashdot - August 18th, 2023 [August 18th, 2023]
- Tesla Says It Will Build New 'First of Its Kind' Data Centers - Slashdot - August 18th, 2023 [August 18th, 2023]
- Bank of Ireland IT Blunder Allows Customers To Withdraw More ... - Slashdot - August 18th, 2023 [August 18th, 2023]
- LK-99 Isn't a Superconductor - How Science Sleuths Solved the ... - Slashdot - August 18th, 2023 [August 18th, 2023]
- Mayor Bowser Announces Hyundai Anti-Theft Mobile Clinic | mayormb - Executive Office of the Mayor - July 30th, 2023 [July 30th, 2023]
- Responding to Data Breach at Contractor | CMS - CMS - July 30th, 2023 [July 30th, 2023]
- Five Auburn Alumni Receive Award for Work to Advance Tax Prep ... - CPAPracticeAdvisor.com - July 30th, 2023 [July 30th, 2023]
- Codeiums Varun Mohan and Jeff Wang on Unleashing the Power of ... - Nvidia - July 30th, 2023 [July 30th, 2023]
- Banner Health provides free concussion baseline testing for every ... - Queen Creek Sun Times - July 30th, 2023 [July 30th, 2023]
- Hugging Face, GitHub and More Unite To Defend Open Source in ... - Slashdot - July 30th, 2023 [July 30th, 2023]
- Lindsey Graham and Elizabeth Warren: When It Comes To Big Tech ... - Slashdot - July 30th, 2023 [July 30th, 2023]
- Best Dogecoin Casinos & Gambling Sites Ranked by DOGE Bonuses, Games, and More - The Hudson Reporter - July 2nd, 2023 [July 2nd, 2023]
- GCC Steering Committee Announces a Code of Conduct - Slashdot - July 2nd, 2023 [July 2nd, 2023]
- AI Predicts Diseases, Advancing Toward HIV Cure, Acquisitions ... - Bio-IT World - July 2nd, 2023 [July 2nd, 2023]
- WISeKey upgrades its WISeID digital identity and privacy platform - Help Net Security - July 2nd, 2023 [July 2nd, 2023]
- FBI Forms National Database To Track and Prevent 'Swatting' - Slashdot - July 2nd, 2023 [July 2nd, 2023]
- BYU Library offers free software classes - The Daily Universe - Universe.byu.edu - June 16th, 2023 [June 16th, 2023]
- Free Streaming Software Market to Witness an Outstanding Growth ... - The Bowman Extra - June 16th, 2023 [June 16th, 2023]
- How to build a virtual studio for free with free plugins and music ... - MusicRadar - June 16th, 2023 [June 16th, 2023]
- Battlebit Remastered Price - Is it free? - PC Guide - For The Latest PC Hardware & Tech News - June 16th, 2023 [June 16th, 2023]
- How to Install the iPadOS 17 Developer Beta on Your iPad for Free - MacRumors - June 16th, 2023 [June 16th, 2023]
- Human Resources Software: 4 HR Tools for Small Businesses - CO by the U.S. Chamber of Commerce - June 16th, 2023 [June 16th, 2023]
- YouTube Tells Open-Source Privacy Software 'Invidious' to Shut Down - Slashdot - June 16th, 2023 [June 16th, 2023]
- Arctic Could Be Sea Ice-Free in the Summer by the 2030s - Slashdot - June 16th, 2023 [June 16th, 2023]
- The IRS Will Test Out Its Own Free Tax Prep Software in 2024 - Money - May 20th, 2023 [May 20th, 2023]
- The IRS is working on software to allow taxpayers to file online - NPR - May 20th, 2023 [May 20th, 2023]
- RIB Software launches free-to-use RIB Carbon Quantifier for ... - GlobeNewswire - May 20th, 2023 [May 20th, 2023]
- Read the letter: Twitter accuses Microsoft of using its data in unauthorized ways - CNBC - May 20th, 2023 [May 20th, 2023]
- Porsche Taycan Gets EV Charging Station Finder in Apple Maps - Car and Driver - May 20th, 2023 [May 20th, 2023]
- Tesla to roll out free Full Self-Driving software, but there's a catch. Know here - HT Auto - May 20th, 2023 [May 20th, 2023]
- Meta Made Its AI Tech Open-Source. Rivals Say Its a Risky Decision. - The New York Times - May 20th, 2023 [May 20th, 2023]
- Generative AI needs guardrails as businesses add it to software ... - CIO Dive - May 20th, 2023 [May 20th, 2023]
- You may not care where you download software from, but malware ... - We Live Security - May 20th, 2023 [May 20th, 2023]
- International cooperation and the challenge of internet accessibility ... - BMC Medical Education - May 20th, 2023 [May 20th, 2023]
- IRS Might Make Tax Season a Whole Lot Easier - The Journal ... - The Wall Street Journal - May 20th, 2023 [May 20th, 2023]