Texas is replacing thousands of human exam graders with AI – The Verge
Students in Texas taking their state-mandated exams this week are being used as guinea pigs for a new artificial intelligence-powered scoring system set to replace a majority of human graders in the region.
The Texas Tribune reports an automated scoring engine that utilizes natural language processing the technology that enables chatbots like OpenAIs ChatGPT to understand and communicate with users is being rolled out by the Texas Education Agency (TEA) to grade open-ended questions on the State of Texas Assessments of Academic Readiness (STAAR) exams. The agency is expecting the system to save $1520 million per year by reducing the need for temporary human scorers, with plans to hire under 2,000 graders this year compared to the 6,000 required in 2023.
We wanted to keep as many constructed open-ended responses as we can, but they take an incredible amount of time to score.
The STAAR exams, which test students between the third and eighth grades on their understanding of the core curriculum, were redesigned last year to include fewer multiple-choice questions. It now contains up to seven times more open-ended questions, with TEA director of student assessment Jose Rios saying the agency wanted to keep as many constructed open-ended responses as we can, but they take an incredible amount of time to score.
According to a slideshow hosted on TEAs website, the new scoring system was trained using 3,000 exam responses that had already received two rounds of human grading. Some safety nets have also been implemented a quarter of all the computer-graded results will be rescored by humans, for example, as will answers that confuse the AI system (including the use of slang or non-English responses).
While TEA is optimistic that AI will enable it to save buckets of cash, some educators arent so keen to see it implemented. Lewisville Independent School District superintendent Lori Rapp said her district saw a drastic increase in constructed responses receiving a zero score when the automated grading system was used on a limited basis in December 2023. At this time, we are unable to determine if there is something wrong with the test question or if it is the new automated scoring system, Rapp said.
AI essay-scoring engines are nothing new. A 2019 report from Motherboard found that they were being used in at least 21 states to varying degrees of success, though TEA seems determined to avoid the same reputation. Small print on TEAs slideshow also stresses that its new scoring engine is a closed system thats inherently different from AI, in that AI is a computer using progressive learning algorithms to adapt, allowing the data to do the programming and essentially teaching itself.
The attempt to draw a line between them isnt surprising theres no shortage of teachers despairing online about how generative AI services are being used to cheat on assignments and homework. The students being graded by this new scoring system may have a hard time accepting how they believe rules for thee and not for me are being applied here.
Follow this link:
Texas is replacing thousands of human exam graders with AI - The Verge
- Unlock real-time insights with AI-powered analytics in Microsoft Fabric - Microsoft - May 22nd, 2024 [May 22nd, 2024]
- Companies Are Drowning In Visual Data. Coactive AI Wants To Make Sense Of It. - Forbes - May 22nd, 2024 [May 22nd, 2024]
- Holistic AI Is Now H, a New French Startup With $220 Million Out of the Gate - Yahoo Finance - May 22nd, 2024 [May 22nd, 2024]
- Google Search's New AI Overviews Will Soon Have Ads - WIRED - May 22nd, 2024 [May 22nd, 2024]
- Microsoft's new Windows Copilot Runtime aims to win over AI developers - The Verge - May 22nd, 2024 [May 22nd, 2024]
- DOJ arrests man over AI-generated CSAM, in likely first known case - The Washington Post - May 22nd, 2024 [May 22nd, 2024]
- Nvidia is talk of the town at AI events leading into this weeks earnings - CNBC - May 22nd, 2024 [May 22nd, 2024]
- This is how I plan to explain AI PC to my confused friends and relatives - TechRadar - May 22nd, 2024 [May 22nd, 2024]
- Get Google Search Results Without AI, Ads or Anything but Links - CNET - May 22nd, 2024 [May 22nd, 2024]
- Releasing a new paper on openness and artificial intelligence - Mozilla & Firefox - May 22nd, 2024 [May 22nd, 2024]
- AI Outperforms Humans in Theory of Mind Tests - IEEE Spectrum - May 22nd, 2024 [May 22nd, 2024]
- Cooler Master introduces colored 'AI Thermal Paste' CryoFuze 5 comes with nano-diamond technology - Tom's Hardware - May 22nd, 2024 [May 22nd, 2024]
- Five ways criminals are using AI - MIT Technology Review - May 22nd, 2024 [May 22nd, 2024]
- Microsoft Stock Flirts With Breakout On AI Software News - Investor's Business Daily - May 22nd, 2024 [May 22nd, 2024]
- Microsofts stock rides AI elation toward first record close in two months - MarketWatch - May 22nd, 2024 [May 22nd, 2024]
- Wisconsin man arrested for allegedly creating AI-generated child sexual abuse material - The Verge - May 22nd, 2024 [May 22nd, 2024]
- Beyond keywords: AI-driven approaches to improve data discoverability - World Bank - May 22nd, 2024 [May 22nd, 2024]
- AI boom may leave Israel behind due to shortage of funds and talent, report warns - The Times of Israel - May 22nd, 2024 [May 22nd, 2024]
- Microsoft's AI chatbot will 'recall' everything you do on a PC - The Associated Press - May 22nd, 2024 [May 22nd, 2024]
- Amazon is helping decarbonize the grid with AI - About Amazon - May 22nd, 2024 [May 22nd, 2024]
- Wearable AI Pin maker Humane is reportedly seeking a buyer - Engadget - May 22nd, 2024 [May 22nd, 2024]
- What Nvidia says about AI chip demand could matter for more than just the tech trade - Yahoo Finance - May 22nd, 2024 [May 22nd, 2024]
- TechScape: The people charged with making sure AI doesnt destroy humanity have left the building - The Guardian - May 22nd, 2024 [May 22nd, 2024]
- Total Recall: the only Copilot+ AI feature that matters is a huge privacy risk - Tom's Hardware - May 22nd, 2024 [May 22nd, 2024]
- The fake AI Scarlett Johansson is a reality check for Washington - POLITICO - May 22nd, 2024 [May 22nd, 2024]
- In Seoul summit, heads of states and companies commit to AI safety - TechCrunch - May 22nd, 2024 [May 22nd, 2024]
- Databricks is expanding the scope of its AI investments with second VC fund - Fortune - May 22nd, 2024 [May 22nd, 2024]
- Windows 11 to Deprecate NTLM, Add AI-Powered App Controls and Security Defenses - The Hacker News - May 22nd, 2024 [May 22nd, 2024]
- Seoul AI safety summit kicks off with tech industry at a critical juncture - Semafor - May 22nd, 2024 [May 22nd, 2024]
- Adobe's AI-Powered Generative Remove Feature in Lightroom Erases Unsightly Objects in Seconds - WIRED - May 22nd, 2024 [May 22nd, 2024]
- Voice Actors Sue Company Whose AI Sounds Like Them - The New York Times - May 20th, 2024 [May 20th, 2024]
- Missed Out on Nvidia's Run-Up? My Best Artificial Intelligence (AI) Stock to Buy and Hold - Yahoo Finance - May 20th, 2024 [May 20th, 2024]
- Here's My Top Artificial Intelligence (AI) Stock to Buy and Hold - Yahoo Finance - May 20th, 2024 [May 20th, 2024]
- How ISIS allies are using AI fakes to spread propaganda quickly - The Washington Post - May 20th, 2024 [May 20th, 2024]
- Sainsbury's and Microsoft announce five-year AI collaboration - Microsoft - May 20th, 2024 [May 20th, 2024]
- Marc Dion: Diners and AI - The Dispatch - The Commercial Dispatch - May 20th, 2024 [May 20th, 2024]
- What is an AI PC, and how it might change the tech industry - Axios - May 20th, 2024 [May 20th, 2024]
- Age of the AI agents: OpenAI's GPT-4o and Google's Project Astra, plus an exclusive sit-down with Google CEO Sundar ... - CNBC - May 20th, 2024 [May 20th, 2024]
- Alphabet Goes All In on Artificial Intelligence (AI). Is It Time to Go All In on the Stock? - The Motley Fool - May 20th, 2024 [May 20th, 2024]
- Reddit soars after announcing OpenAI deal that allows use of its data for training AI models - CNBC - May 20th, 2024 [May 20th, 2024]
- How Googles AI Overviews Work, and How to Turn Them Off (You Cant) - WIRED - May 20th, 2024 [May 20th, 2024]
- Google AI: Gemini comes to Workspace for Education - The Keyword | Google Product and Technology News - May 20th, 2024 [May 20th, 2024]
- Exclusive | CoreWeave Raises $7.5 Billion in Debt for AI Computing Push - The Wall Street Journal - May 20th, 2024 [May 20th, 2024]
- How can AI be used in education? From ABCs to SATs - USA TODAY - May 20th, 2024 [May 20th, 2024]
- Among AI infrastructure hopefuls, Qualcomm has become an unlikely ally - The Register - May 20th, 2024 [May 20th, 2024]
- We have to stop ignoring AI's hallucination problem - The Verge - May 20th, 2024 [May 20th, 2024]
- How Google's Gemini AI model got its name - The Keyword | Google Product and Technology News - May 20th, 2024 [May 20th, 2024]
- SoundHound AI: Should Investors Buy This Artificial Intelligence (AI) Stock After 160% Gains? - The Motley Fool - May 20th, 2024 [May 20th, 2024]
- Bye Bye, AI: How to turn off Google's annoying AI overviews and just get search results - Tom's Hardware - May 20th, 2024 [May 20th, 2024]
- As the AI world gathers in Seoul, can an accelerating industry balance progress against safety? - The Guardian - May 20th, 2024 [May 20th, 2024]
- Microsoft delivers an AI blow to Nvidia - TheStreet - May 20th, 2024 [May 20th, 2024]
- Hollywood at a Crossroads: Everyone Is Using AI, But They Are Scared to Admit It - Hollywood Reporter - May 20th, 2024 [May 20th, 2024]
- 3 Companies Already Working on the Next Phase of Artificial Intelligence (AI) - The Motley Fool - May 20th, 2024 [May 20th, 2024]
- Hollywood agency CAA aims to help stars manage their own AI likenesses - TechCrunch - May 20th, 2024 [May 20th, 2024]
- Dow Jones Futures Rise; Nvidia Earnings Offer Huge Test With 5 AI Stocks Near Buy Points - Investor's Business Daily - May 20th, 2024 [May 20th, 2024]
- 'Copper is the new oil,' and prices could soar 50% as AI, green energy, and military spending boost demand, top ... - Fortune - May 20th, 2024 [May 20th, 2024]
- New support for AI advancement in Central and Eastern Europe - The Keyword | Google Product and Technology News - May 20th, 2024 [May 20th, 2024]
- OpenAI dissolves team focused on long-term AI risks, less than one year after announcing it - CNBC - May 20th, 2024 [May 20th, 2024]
- Caution: 3 Things You Must Know About C3.ai Stock - The Motley Fool - May 20th, 2024 [May 20th, 2024]
- Business school teaching case study: risks of the AI arms race - Financial Times - May 20th, 2024 [May 20th, 2024]
- Congressman Don Beyer went back to college to learn AI - The Associated Press - April 15th, 2024 [April 15th, 2024]
- Georgia Tech Unveils New AI Makerspace in Collaboration with NVIDIA - Georgia Tech College of Engineering - April 15th, 2024 [April 15th, 2024]
- Energy-Guzzling AI Is Also the Future of Energy Savings - The Wall Street Journal - April 15th, 2024 [April 15th, 2024]
- South Korea to host second AI Safety Summit on May 21-22 - Reuters - April 15th, 2024 [April 15th, 2024]
- What is artificial intelligence (AI)? - Livescience.com - April 15th, 2024 [April 15th, 2024]
- 'Jailbreaking' AI services like ChatGPT and Claude 3 Opus is much easier than you think - Livescience.com - April 15th, 2024 [April 15th, 2024]
- Google AI podcast: 6 conversations with global leaders - The Keyword | Google Product and Technology News - April 15th, 2024 [April 15th, 2024]
- Galaxy AI features are coming to last-gen Samsung phones including the S21 series - The Verge - April 15th, 2024 [April 15th, 2024]
- AI's Most Promising Startups Are Getting Younger And Leaner - Forbes - April 15th, 2024 [April 15th, 2024]
- How to Stop Your Data From Being Used to Train AI - WIRED - April 15th, 2024 [April 15th, 2024]
- 7 of the best Sora AI videos featuring animals - Tom's Guide - April 15th, 2024 [April 15th, 2024]
- How Microsoft discovers and mitigates evolving attacks against AI guardrails - Microsoft - April 15th, 2024 [April 15th, 2024]
- Apple's First AI Features in iOS 18 Reportedly Won't Use Cloud Servers - MacRumors - April 15th, 2024 [April 15th, 2024]
- Samsung officially bringing One UI 6.1 and AI features to Galaxy S22, Fold 4, Flip 4 in May - 9to5Google - April 15th, 2024 [April 15th, 2024]
- Eat the future, pay with your face: my dystopian trip to an AI burger joint - The Guardian - April 15th, 2024 [April 15th, 2024]
- Humans Forget. AI Assistants Will Remember Everything - WIRED - April 15th, 2024 [April 15th, 2024]
- From boom to burst, the AI bubble is only heading in one direction - The Guardian - April 15th, 2024 [April 15th, 2024]
- Meta and Google announce new in-house AI chips, creating a trillion-dollar question for Nvidia - Fortune - April 15th, 2024 [April 15th, 2024]
- Google goes all in on generative AI at Google Cloud Next - TechCrunch - April 15th, 2024 [April 15th, 2024]
- Humane AI Pin review: the post-smartphone future isnt here yet - The Verge - April 15th, 2024 [April 15th, 2024]
Tags: