When Government Rules by Software, Citizens Are Left in the Dark – WIRED
In July, San Francisco Superior Court Judge Sharon Reardon considered whether to hold Lamonte Mims, a 19-year-old accused of violating his parole, in jail. One piece of evidence before her: the output of algorithms known as PSA that scored the risk that Mims, who had previously been convicted of burglary, would commit a violent crime or skip court. Based on that result, another algorithm recommended that Mims could safely be released, and Reardon let him go. Five days later, police say, he robbed and murdered a 71-year old man.
On Monday, the San Francisco District Attorneys Office said staffers using the tool had erroneously failed to enter Mims prior jail term. Had they done so, PSA would have recommended he be held, not released.
Mims case highlights how governments increasingly rely on mathematical formulas to inform decisions about criminal justice, child welfare, education and other arenas. Yet its often hard or impossible for citizens to see how these algorithms work and are being used.
San Francisco Superior Court began using PSA in 2016, after getting the tool for free from the John and Laura Arnold Foundation, a Texas nonprofit that works on criminal-justice reform. The initiative was intended to prevent poor people unable to afford bail from needlessly lingering in jail. But a memorandum of understanding with the foundation bars the court from disclosing any information about the Tool, including any information about the development, operation and presentation of the Tool.
The agreement was unearthed in December by two law professors, who in a paper released this month document a widespread transparency problem with state and municipal use of predictive algorithms. Robert Brauneis, of George Washington University, and Ellen Goodman, of Rutgers University, filed 42 open-records requests in 23 states seeking information about PSA and five other tools used by governments. They didnt get much of what they asked for.
Jason Tashea
Courts Are Using AI to Sentence Criminals. That Must Stop Now
Megan Molteni
Artificial Intelligence Is Learning to Predict and Prevent Suicide
Mark Harris
How Peter Thiel's Secretive Data Company Pushed Into Policing
Many governments said they had no relevant records about the programs. Taken at face value, that would mean those agencies did not document how they chose, or how they use, the tools. Others said contracts prevented them from releasing some or all information. Goodman says this shows governments are neglecting to stand up for their own, and citizens, interests. You can really see who held the pen in the contracting process, she says.
The Arnold Foundation says it no longer requires confidentiality from municipal officials, and is happy to amend existing agreements, to allow officials to disclose information about PSA and how they use it. But a representative of San Francisco Superior Court said its contract with the foundation has not been updated to remove the gag clause.
Goodman and Brauneis ran their records-request marathon to add empirical fuel to a debate about widening use of predictive algorithms in government decision-making. In 2016, an investigation by ProPublica found that a system used in sentencing and bail decisions was biased against black people . Scholars have warned for years public policy could become hidden under the shroud of trade secrets, or technical processes divorced from the usual policy-making process.
The scant results from nearly a year of filing and following up on requests suggests those fears are well-grounded. But Goodman says the study has also helped convince her that governments could be more open about their use of algorithms, which she says have clear potential to make government more efficient and equitable.
Some scholars and activists want governments to reveal the code behind their algorithms, a tough ask because they are often commercial products. Goodman thinks its more urgent that the public knows how an algorithm was chosen, developed, and testedfor example how sensitive it is to false positives and negatives. Thats no break from the past, she argues, because citizens have always been able to ask for information about how new policy was devised and implemented. Governments have not made the shift to understanding this is policy making, she says. The concern is that public policy is being pushed into a realm where its not accessible.
For Goodmans hopes to be met, governments will have to stand up to the developers of predictive algorithms and software. Goodman and Brauneis sought information from 16 local courts that use PSA. They received at least some documents from five; four of those, including San Francisco, said their agreement with the Arnold Foundation prevented them from discussing the tool and its use.
Some things are known about PSA. The Arnold Foundation has made public the formulas at the heart of its tool, and the factors it considers, including a persons age, criminal history and whether they have failed to appear for prior court hearings. It says researchers used data from nearly 750,000 cases to design the tool. After PSA was adopted in Lucas County, Ohio, the Arnold Foundation says, crimes committed by people awaiting trial fell, even as more defendants were released without having to post bail.
Goodman argues the foundation should disclose more information about its dataset and how it was analyzed to design PSA, as well as the results of any validation tests performed to tune the risk scores it assigns people. That information would help governments and citizens understand PSAs strengths and weaknesses, and compare it with competing pretrial risk-assessment software. The foundation didnt answer a direct request for that information from the researchers this March. Moreover, some governments now using PSA have agreed not to disclose details about how they use it.
An Arnold Foundation spokeswoman says it is assembling a dataset for release that will allow outside researchers to evaluate its tool. She says the foundation initially required confidentiality from jurisdictions to inhibit governments or rivals from using or copying the tool without permission.
Goodman and Brauneis also queried 11 police departments that use PredPol, commercial software that predicts where crime is likely to occur and can be used to plan patrols. Only three responded. None revealed the algorithm PredPol uses to make predictions, or anything about the process used to create and validate it. PredPol is marketed by a company of the same name, and originated in a collaboration between Los Angeles Police Department and University of California Los Angeles. It did not respond to a request for comment.
Some municipalities were more forthcoming. Allegheny County in Pennsylvania produced a report describing the development and testing of an algorithm that helps child-welfare workers decide whether to formally investigate new reports of child maltreatment, for example. The countys Department of Human Services had commissioned the tool from Auckland University of Technology, in New Zealand. Illinois specifies that information about its contracts for a tool that tries to predict when children may be injured or killed will be public unless prohibited by law.
Most governments the professors queried didnt appear to have the expertise to properly consider or answer questions about the predictive algorithms they use. I was left feeling quite sympathetic to municipalities, Goodman says. Were expecting them to do a whole lot they dont have the wherewithal to do.
Danielle Citron, a law professor at the University of Maryland, says that pressure from state attorneys general, court cases, and even legislation will be necessary to change how local governments think about, and use, such algorithms. Part of it has to come from law, she says. Ethics and best practices never gets us over the line because the incentives just arent there.
Researchers believe predictive algorithms are growing more prevalent and more complex. I think that probably makes things harder, says Goodman.
UPDATE 07:34 am ET 08/17/17: An earlier version of this story incorrectly described the Arnold Foundation's PSA tool.
Read more here:
When Government Rules by Software, Citizens Are Left in the Dark - WIRED
- Speedrun AI Labs reveals free open source reverse engineering software tool - ARYnews.tv - November 15th, 2026 [November 15th, 2026]
- Opinion | How AI is resurrecting the free software revolution - breezejmu.org - November 13th, 2026 [November 13th, 2026]
- Sunfish Software releases FANDUST, a FREE lo-fi plugin with a Windows 98 GUI - Bedroom Producers Blog - November 13th, 2026 [November 13th, 2026]
- ShareX 22.1.0 records GIFs without FFmpeg and debuts a Photo editor - BetaNews - November 7th, 2026 [November 7th, 2026]
- A developer used AI to build 7 free Adobe alternatives, and subscription software has a new problem - How-To Geek - October 19th, 2026 [October 19th, 2026]
- HomePod is about to get free upgrade with these new features - 9to5Mac - October 19th, 2026 [October 19th, 2026]
- This Is My Favorite Microsoft 365 Replacement and Its Free on Linux, Mac and Windows - CNET - October 19th, 2026 [October 19th, 2026]
- Three New Features Are Coming to Apple HomePod With a Free Upgrade - Android Headlines - October 19th, 2026 [October 19th, 2026]
- Researchers and health professionals can apply for free software licenses for one year - Informat.ro - October 19th, 2026 [October 19th, 2026]
- Unitree Releases UniUni Swarm Control Software, Free for Its Users, Starting With H2 and G1 - Pandaily - October 19th, 2026 [October 19th, 2026]
- Adobe software dupe maker takes on Microsoft Office, releasing free versions of Word, Powerpoint, and Excel - Mashable - October 13th, 2026 [October 13th, 2026]
- From GTA V on iPhone to Free Photoshop: This AI Tool Is Upending Software - Decrypt - October 13th, 2026 [October 13th, 2026]
- You can now download vibe-coded clones of Word, Excel, and PowerPoint but users are split on whether AI is helping the industry - TechRadar - October 13th, 2026 [October 13th, 2026]
- Creator of free Adobe clones unveils open-source Microsoft Office Excel, PowerPoint, and Word replications Autodesk tools and other... - October 13th, 2026 [October 13th, 2026]
- Adobe software dupe maker takes on Microsoft Office, releasing free versions of Word, Powerpoint, and Excel - Mashable SEA - October 13th, 2026 [October 13th, 2026]
- Software Is Over: Developer Uses AI to Build Free Adobe Alternatives - Yahoo Tech - October 13th, 2026 [October 13th, 2026]
- In 1982, Steve Jobs launched Apple's 'Kids Can't Wait' school giveaway; the programme put more than 9,000 - The Times of India - October 13th, 2026 [October 13th, 2026]
- Someone just rebuilt Adobe Creative Cloud with AI then gave it away for free - Creative Bloq - October 8th, 2026 [October 8th, 2026]
- "Software is over": Developer uses AI to build free Adobe clones after frustration with cancellation fees - TechSpot - October 8th, 2026 [October 8th, 2026]
- Solo developer rebuilds Adobe Creative Suite in Rust using Claude, releases it free to all targets 100% parity in one month despite piracy claims and... - October 8th, 2026 [October 8th, 2026]
- Someone Rebuilt Free, Open-Source Versions of Photoshop, Premiere, and Lightroom Using AI - PetaPixel - October 8th, 2026 [October 8th, 2026]
- Save the date: free webinar on the software-defined broadcast facility - TVBEurope - October 8th, 2026 [October 8th, 2026]
- Software is over: Bold AI developer takes aim at Adobe with open source clones - Ars Technica - October 8th, 2026 [October 8th, 2026]
- ArtCraft: Free Open Source Adobe Alternatives Built With AI - Tbreak UAE - October 8th, 2026 [October 8th, 2026]
- FIA to strengthen software testing after F1 cars stopped on track in Malaysia - Winnipeg Free Press - October 8th, 2026 [October 8th, 2026]
- FlightScopes Free Golf Software Update Gets at the Work Between Shots - Athlon Sports - October 6th, 2026 [October 6th, 2026]
- Optimus acquires SmartHop, will give freight software away for free - Dealroom - October 6th, 2026 [October 6th, 2026]
- All Ratchet and Clank PS3 games can now be played crash-free on RPCS3 - OC3D - October 6th, 2026 [October 6th, 2026]
- Software sector outlook: M&A hopes, cheap valuations, and rising free cash flow - Investing.com Canada - October 6th, 2026 [October 6th, 2026]
- This Android browser now gives you a free eSIM with 3GB of data when you travel - Android Central - October 2nd, 2026 [October 2nd, 2026]
- Nvidia launches OpenShell and Sentry to stop AI agents acting outside their limits - tech-ish.com - October 2nd, 2026 [October 2nd, 2026]
- These smart glasses have been recalled for overheating temples causing burns - The Verge - September 26th, 2026 [September 26th, 2026]
- Affinitys biggest photography update yet but dont panic, the image editor is still free! - Digital Camera World - September 26th, 2026 [September 26th, 2026]
- MemBrowse continuously tracks firmware memory footprint, is free for open-source projects - CNX Software - September 26th, 2026 [September 26th, 2026]
- 2026 Special edition - Free/libre and open source software: Visions of openness from the Global South - Association for Progressive Communications - September 13th, 2026 [September 13th, 2026]
- Millions of students can now get access to a free year of Kiro from AWS - About Amazon - September 13th, 2026 [September 13th, 2026]
- Impact Cloud+ Emerges as the Nations Preferred Subscription-Free Software for LED Sign Buyers - EIN Presswire - September 13th, 2026 [September 13th, 2026]
- Switzerland is trialing moving away from Microsoft towards free and open-source software - PC Gamer - September 13th, 2026 [September 13th, 2026]
- Eclipse Foundation Releases Free Toolkit to Help SMEs Prepare for the EU Cyber Resilience Act - Yahoo Finance UK - September 13th, 2026 [September 13th, 2026]
- Richard Stallman: New York Autodidact, Free-Software Pioneer, and Founder of the GNU Project and the Free Software Foundation - bbntimes.com - September 8th, 2026 [September 8th, 2026]
- This free app could become the Blender of texture painting software - Creative Bloq - September 8th, 2026 [September 8th, 2026]
- Version 4.0.0 of the free audio editing software 'Audacity' has been released. - GIGAZINE - September 8th, 2026 [September 8th, 2026]
- 5 reasons Linux is the most valuable software in the world (even though it's free) - How-To Geek - August 31st, 2026 [August 31st, 2026]
- 8 Best Free Antivirus Software in 2026: Windows, Mac & Mobile - memeburn.com - August 18th, 2026 [August 18th, 2026]
- Can Free Design Software Help You Remodel a Kitchen Without a Designer? This Homeowner Put It to the Test - The Spruce - August 18th, 2026 [August 18th, 2026]
- Looking for a Free Microsoft 365 Replacement? Try This Program - CNET - August 18th, 2026 [August 18th, 2026]
- Debian Celebrates 33 Years of Free and Open Source Software - Linuxiac - August 18th, 2026 [August 18th, 2026]
- 10 Best Video Editing Software in 2026: Free & Paid Compared - memeburn.com - August 18th, 2026 [August 18th, 2026]
- I found the perfect free web app. Then I checked what it was doing - PCWorld - August 1st, 2026 [August 1st, 2026]
- Foundation Software and PAS, Inc. Address Construction Compensation Trends and Pay Practices in Free Webinar - voiceofalexandria.com - August 1st, 2026 [August 1st, 2026]
- I added head tracking to my games with a webcam and free software - MakeUseOf - August 1st, 2026 [August 1st, 2026]
- I replaced Lightroom with an open-source alternative, and Adobe's subscription suddenly felt pointless - XDA - August 1st, 2026 [August 1st, 2026]
- Govt to give 100,000 youths free access to AI software - Free Malaysia Today - August 1st, 2026 [August 1st, 2026]
- Why open-source software can be both good and bad - New Scientist - July 26th, 2026 [July 26th, 2026]
- What is open-source AI? A software engineering researcher explains - The Conversation - July 24th, 2026 [July 24th, 2026]
- This free, open-source app changed the way I think about paid software - How-To Geek - July 24th, 2026 [July 24th, 2026]
- Nvidias Brilliant Freemium Software Hook is Why Im Loading Up for The Long Term - 24/7 Wall St. - July 24th, 2026 [July 24th, 2026]
- The legislation would bar the sale of vehicles or software significantly controlled by Chinese owners but it may need changes before passage. See link... - July 24th, 2026 [July 24th, 2026]
- Are Free Software Bundles Becoming the Best Way to Sell Chromebooks? - About Chromebooks - July 24th, 2026 [July 24th, 2026]
- Free Ink is an open ecosystem for e-readers, comprised of open-source projects developing software, firmware, and hardware. - GIGAZINE - July 24th, 2026 [July 24th, 2026]
- ZML Takes On Nvidia Lock In With Free AI Software - Open Source For You - July 9th, 2026 [July 9th, 2026]
- LibreOffice 26.8 Beta Released For Improving This Free Software Office Suite - Phoronix - July 9th, 2026 [July 9th, 2026]
- Toybox Audio Thump One: hard-hitting free synth plugin gets a wild update 3.0 (beta) - synth anatomy - July 9th, 2026 [July 9th, 2026]
- Belm do Par lends its name to the new version of the free software QGIS - MundoGEO - July 9th, 2026 [July 9th, 2026]
- This free software aims to turn Sony headphones into a head tracker for '200+ PC games' - inkl - July 9th, 2026 [July 9th, 2026]
- Tilr TetraOP: a free 4OP FM and wavetable Synthesizer plugin (mac, linux, win) - synth anatomy - July 9th, 2026 [July 9th, 2026]
- If you have Sony headphones, you may be able to use them as a headtracker with this free software - PC Gamer - July 7th, 2026 [July 7th, 2026]
- IGV Investors: Watch Oracles Free Cash Flow as the Real Test of AI Capex Economics - 24/7 Wall St. - July 1st, 2026 [July 1st, 2026]
- 5 free and open-source software (FOSS) to replace Microsoft, Google, and big tech - How-To Geek - July 1st, 2026 [July 1st, 2026]
- Oxyfinz Unveils Free Software Initiative to Bridge the UAE Wealth Management Technology Gap - The Fintech Times - July 1st, 2026 [July 1st, 2026]
- FREE TO READ | Cracking the code to using enterprise software - TimesLIVE - July 1st, 2026 [July 1st, 2026]
- Ag View Solutions Offers Farm Profit Manager Software for Free - AG INFORMATION NETWORK OF THE WEST - June 24th, 2026 [June 24th, 2026]
- From free speech to software design: How experts are reading the Delhi HCs Telegram ruling - MediaNama - June 24th, 2026 [June 24th, 2026]
- Year of free HPE software a step in the correct direction in VMware rivalry - Ars Technica - June 22nd, 2026 [June 22nd, 2026]
- Free Software Foundation Europe pushes EU to force Google to allow AI uninstalls on Android - Neowin - June 22nd, 2026 [June 22nd, 2026]
- Smokeball Offers Free Software Access To Over 900,000 Attys - Law360 - June 16th, 2026 [June 16th, 2026]
- Foundation Software and Sax LLP to Host Free Webinar on Job Cost Reporting for Better Profit Management - ACCESS Newswire - June 16th, 2026 [June 16th, 2026]
- Palantir (PLTR): Debt-Free AI Growth Shows Why Its Software Story Still Has Financial Firepower - Yahoo Finance - June 16th, 2026 [June 16th, 2026]
- Foundation Software and Sax LLP to Host Free Webinar on Job Cost Reporting for Better Profit Management - Bluefield Daily Telegraph - June 16th, 2026 [June 16th, 2026]
- Massive's Pioneering 'Lord Of The Rings' Crowd Simulation Software Is Now Free To Use - Engadget - May 29th, 2026 [May 29th, 2026]