Opinion: I asked AI about myself. The answers were all wrong – The Virginian-Pilot
My interest in artificial intelligence piqued after a colleague told me he was using it for research and writing. Before I used AI for my own work, I decided to test its authenticity with a question I could verify. I asked OpenAIs ChatGPT about my own identity expecting a text version of a selfie. After a week of repeating the same question, the responses were confounding and concerning.
ChatGPT answered who is Philip Shucet by listing 15 distinct positions I supposedly held at one time or another. The positions included specific titles, job responsibilities and employment dates. But only three of the 15 jobs were accurate. The other 12 were fabrications; the positions were real, but I was never in any of them. The misinformation included jobs in two states I never lived in, as well as a congressional appointment to the Amtrak Review Board. How could AI be so wrong?
Although newsrooms, boardrooms and classrooms are buzzing with stories, AI is not new. The first chatbot, Eliza, was created in 1966 by Joseph Weizenbaum at MIT. Weizenbaum, who died in 2008, became skeptical of artificial intelligence, telling the New Age Journal in 1985, The dependence on computers is merely the most recent, and the most extreme, example of how man relies on technology in order to escape the burden of acting as an independent agent.
Was Weizenbaum sending a warning that technology might make us lazy?
In an interview about AI on a March segment of 60 Minutes, Brad Smith, president of Microsoft, told Leslie Stahl that a benefit of AI could be, looking at forms to see if theyve been filled out correctly. But what if the form is a resume created by AI? Can AI check its own misinformation? What happens when an employment record is tainted with false information created by AI? Can job recruiters rely on AI queries? Can employers rely on recruiters who use AI? And who is accountable when someone is hired based on misinformation generated by a machine and not by a human?
In the same 60 Minutes segment, Ellie Pavlik, an assistant professor at Brown, told Stahl, It (AI) doesnt really understand what it is saying is wrong. If AI doesnt know when it is wrong, how can anyone rely on AI to be correct?
In May, two New York attorneys used ChatGPT to write a court brief. The brief cited misinformation from cases that didnt exist. Schwartz told the judge that he failed miserably to do his own research to make sure the information was correct. The judge fined each attorney $5,000.
I asked ChatGPT about the consequences of giving out bad information. ChatGPT answered by saying that false information results in misrepresentation, confusion, legal concerns, emotional distress and erodes trust in AI. If ChatGPT understands the implications of false information, why does it continue to provide fabrications when a search engine could easily provide correct information? Because, as I know now, ChatGPT is not a search engine. I know because I asked.
ChatGPT says it is a language model designed to understand and generate human-like text based on input. ChatGPT says it doesnt crawl the web or search the Internet. Instead, it generates responses based on patterns and information it learned from the text it was trained on.
If AI needs to be trained, then theres a critical human element of accountability we cant ignore. So I started training ChatGPT by correcting it each time it answered with false information. After a week of training, ChatGPT was still returning a mix of accurate and inaccurate information, sometimes repeating fabrications. Im still sending back correct information, but Im ready to bring this experiment to an end for now.
This wasnt a test of ego, it was a test of reliability and trust. A 20% accuracy rate is a failing grade.
In 1976, Weizenbaum wrote, No other organism, and certainly no computer, can be made to confront genuine human problems in human terms. Im not a luddite. But as technology continues to leap forward further and faster, lets remember that we are in control of the information that defines us. We are the trainers.
Philip Shucet is a journalist. He previously held positions as the commissioner of VDOT, president and CEO of Hampton Roads Transit, and CEO of Elizabeth River Crossings. He has never held a congressional appointment.
Read more:
Opinion: I asked AI about myself. The answers were all wrong - The Virginian-Pilot
- Whats Working: AI skills arent just for tech workers anymore, even in Colorado - The Colorado Sun - July 27th, 2025 [July 27th, 2025]
- China releases AI action plan days after the U.S. as global tech race heats up - CNBC - July 27th, 2025 [July 27th, 2025]
- PREVENTING WOKE AI IN THE FEDERAL GOVERNMENT - The White House (.gov) - July 27th, 2025 [July 27th, 2025]
- How Astronomer Turned A Viral Scandal Into An AI And Data-Driven Win - Forbes - July 27th, 2025 [July 27th, 2025]
- Chinas Overlooked AI Strategy: Beijing Is Using Soft Power to Gain Global Dominance - Foreign Affairs - July 27th, 2025 [July 27th, 2025]
- Competition shows humans are still better than AI at coding just - The Guardian - July 27th, 2025 [July 27th, 2025]
- PROMOTING THE EXPORT OF THE AMERICAN AI TECHNOLOGY STACK - The White House (.gov) - July 27th, 2025 [July 27th, 2025]
- Meta is shelling out big bucks to get ahead in AI. Heres who its hiring - CNN - July 27th, 2025 [July 27th, 2025]
- China calls for global AI cooperation days after Trump administration unveils low-regulation strategy - The Guardian - July 27th, 2025 [July 27th, 2025]
- Why AI is making us lose our minds (and not in the way youd think) - VentureBeat - July 27th, 2025 [July 27th, 2025]
- Judge disqualifies three Butler Snow attorneys from case over AI citations - Reuters - July 27th, 2025 [July 27th, 2025]
- Why Are We Pretending AI Is Going to Take All the Jobs? - thebignewsletter.com - July 27th, 2025 [July 27th, 2025]
- Teens say they are turning to AI for advice, friendship and more - AP News - July 27th, 2025 [July 27th, 2025]
- AI Travel Tricks: Watch Out for the Road to Nowhere - Herald/Review Media - July 27th, 2025 [July 27th, 2025]
- China calls for the creation of a global AI organization - Engadget - July 27th, 2025 [July 27th, 2025]
- AI start-up Anthropic open to Mideast funds in talks to double valuation to over $150bn - Financial Times - July 27th, 2025 [July 27th, 2025]
- Is AI Killing Google Search? It Might Be Doing the Opposite - WSJ - The Wall Street Journal - July 27th, 2025 [July 27th, 2025]
- Heres what happened when I asked AI if my job as a humor columnist is in jeopardy - AL.com - July 27th, 2025 [July 27th, 2025]
- Exclusive | Why Walmart Is Overhauling Its Approach to AI Agents - The Wall Street Journal - July 27th, 2025 [July 27th, 2025]
- Transcript: Donald Trump's Address at 'Winning the AI Race' Event - Tech Policy Press - July 27th, 2025 [July 27th, 2025]
- Its the most empathetic voice in my life: How AI is transforming the lives of neurodivergent people - Reuters - July 27th, 2025 [July 27th, 2025]
- LeBron James' lawyers threaten to sue over perverse AI video of Steph Curry - SFGATE - July 27th, 2025 [July 27th, 2025]
- DOGE is reportedly pushing an AI tool that would put half of all federal regulations on a 'delete list' - Engadget - July 27th, 2025 [July 27th, 2025]
- Bees wearing QR codes tracked by AI cameras to help researchers save them in the wild - FOX Weather - July 27th, 2025 [July 27th, 2025]
- Are we thinking about AI the wrong way? - WBUR - July 27th, 2025 [July 27th, 2025]
- Vice President JD Vance on AI taking jobs: If the robots were coming to take all of our jobs, you would . - Times of India - July 27th, 2025 [July 27th, 2025]
- Trump posts AI-generated videos on Truth Social of women in bikinis and Obama. Why? - MSNBC News - July 27th, 2025 [July 27th, 2025]
- Musks Grok AI is now on the Kalshi, Polymarket betting apps. What could go wrong? - CNBC - July 27th, 2025 [July 27th, 2025]
- Meta just hired the co-creator of ChatGPT in an escalating AI talent war with OpenAI - Business Insider - July 27th, 2025 [July 27th, 2025]
- Trump is set to unveil his AI roadmap: Heres what to know - TechCrunch - July 27th, 2025 [July 27th, 2025]
- Donald Trump Is Fairy-Godmothering AI - The Atlantic - July 24th, 2025 [July 24th, 2025]
- Trump on AI: "Whatever it takes" to lead the world - Axios - July 24th, 2025 [July 24th, 2025]
- White House unveils U.S. strategic plan on AI. Here's what it includes. - CBS News - July 24th, 2025 [July 24th, 2025]
- Google users are less likely to click on links when an AI summary appears in the results - Pew Research Center - July 24th, 2025 [July 24th, 2025]
- Google develops AI tool that fills missing words in Roman inscriptions - The Guardian - July 24th, 2025 [July 24th, 2025]
- Try on styles with AI, jump on great prices and more - The Keyword - July 24th, 2025 [July 24th, 2025]
- AI could soon think in ways we don't even understand evading our efforts to keep it aligned top AI scientists warn - Live Science - July 24th, 2025 [July 24th, 2025]
- Trump says fewer regulations needed to win the AI race - NPR - July 24th, 2025 [July 24th, 2025]
- Trump signs executive orders targeting woke AI models and regulation - The Guardian - July 24th, 2025 [July 24th, 2025]
- America 'going to win' AI race against China, Trump declares as Meta executive applauds strategy - Fox Business - July 24th, 2025 [July 24th, 2025]
- Nvidia CEO says Trump's AI plan will 'fundamentally change' US' position in years to come - Fox Business - July 24th, 2025 [July 24th, 2025]
- Alphabet Boosted by AI, Cloud Demand as Spending Needs Jump - Yahoo Finance - July 24th, 2025 [July 24th, 2025]
- Trump releases AI 'action plan' that offers a split with Biden - Yahoo Finance - July 24th, 2025 [July 24th, 2025]
- White House unveils sweeping plan to win global AI race through deregulation - Ars Technica - July 24th, 2025 [July 24th, 2025]
- AI, the UN and the performance of virtue - Coda Story - July 24th, 2025 [July 24th, 2025]
- Trump is targeting woke AI. Heres what that means. - The Washington Post - July 24th, 2025 [July 24th, 2025]
- AI companions: A threat to love, or an evolution of it? - TechCrunch - July 24th, 2025 [July 24th, 2025]
- Samsung backs a video AI startup that can analyze thousands of hours of footage - TechCrunch - July 24th, 2025 [July 24th, 2025]
- What If the AI Is Coming From Inside the House in Motorcycle World? - RideApart.com - July 24th, 2025 [July 24th, 2025]
- Google Revenue Soars on AI Boom, and Investors Eye Spending Surge - The Wall Street Journal - July 24th, 2025 [July 24th, 2025]
- Trump targets woke AI in series of executive orders on artificial intelligence - New York Post - July 24th, 2025 [July 24th, 2025]
- I used Grok's AI companions for a week. The foul-mouthed red panda is hilarious the flirty anime girl is worrying. - Business Insider - July 24th, 2025 [July 24th, 2025]
- Googles AI Overviews are cutting off the oxygen to the web - Fortune - July 24th, 2025 [July 24th, 2025]
- Integrated biotechnological and AI innovations for crop improvement - Nature - July 24th, 2025 [July 24th, 2025]
- Tech companies want to move fast. Trumps AI Action Plan aims to cut red tape - Los Angeles Times - July 24th, 2025 [July 24th, 2025]
- Hacker injects malicious, potentially disk-wiping prompt into Amazon's AI coding assistant with a simple pull request told 'Your goal is to clean a... - July 24th, 2025 [July 24th, 2025]
- Trump unveils AI Action Plan aims to cut red tape and 'partisan bias' - BBC - July 24th, 2025 [July 24th, 2025]
- AI Comes Up with Bizarre Physics Experiments. But They Work. - Quanta Magazine - July 24th, 2025 [July 24th, 2025]
- Amazon to buy startup focused on AI wearables - Reuters - July 24th, 2025 [July 24th, 2025]
- 2 Top Artificial Intelligence (AI) Stocks Ready for a Bull Run - The Motley Fool - July 24th, 2025 [July 24th, 2025]
- The hallucinations that haunt AI: why chatbots struggle to tell the truth - Financial Times - July 22nd, 2025 [July 22nd, 2025]
- America Should Assume the Worst About AI: How To Plan For a Tech-Driven Geopolitical Crisis - Foreign Affairs - July 22nd, 2025 [July 22nd, 2025]
- Researchers from top AI labs warn they may be losing the ability to understand advanced AI models - Fortune - July 22nd, 2025 [July 22nd, 2025]
- Doctors at Cedars-Sinai develop AI-powered mental health robot therapist - Los Angeles Times - July 22nd, 2025 [July 22nd, 2025]
- Is today's AI boom bigger than the dotcom bubble? - Reuters - July 22nd, 2025 [July 22nd, 2025]
- Universal Music Group Increasing Efforts on Music AI Patents - The Hollywood Reporter - July 22nd, 2025 [July 22nd, 2025]
- Apple almost open-sourced its AI models, heres why it didnt: report - 9to5Mac - July 22nd, 2025 [July 22nd, 2025]
- Amazon's AI-Powered Cost Cuts, Labor Gains And Record Prime Day Drive Analyst's Bullish Outlook - Yahoo Finance - July 22nd, 2025 [July 22nd, 2025]
- AI Is Reshaping Work. Heres How Students Can Be Ready. - U.S. News & World Report - July 22nd, 2025 [July 22nd, 2025]
- Alphabet will seek to reassure investors as AI rivals step up competition - Reuters - July 22nd, 2025 [July 22nd, 2025]
- AI chatbots remain overconfidenteven when they're wrong, study finds - Tech Xplore - July 22nd, 2025 [July 22nd, 2025]
- Nvidia Stock Slips. Reasons to Believe the AI Trend Will Keep Going. - MSN - July 22nd, 2025 [July 22nd, 2025]
- Personal Perspective: Using the ubiquity of AI to consider what it means to be a scholar. - Psychology Today - July 22nd, 2025 [July 22nd, 2025]
- Five things you need to know about AI right now - MIT Technology Review - July 22nd, 2025 [July 22nd, 2025]
- OpenAI and UK Government Partner on AI Infrastructure and Deployment - PYMNTS.com - July 22nd, 2025 [July 22nd, 2025]
- Apple (AAPL) Analysts Stay Positive Ahead of Earnings, But AI Clarity Still Needed - Yahoo Finance - July 22nd, 2025 [July 22nd, 2025]
- This startup thinks email could be the key to usable AI agents - TechCrunch - July 22nd, 2025 [July 22nd, 2025]
- Nvidia Stock Slips. Here Are Reasons to Believe the AI Trend Will Keep Going, Analysts Say. - Barron's - July 22nd, 2025 [July 22nd, 2025]
- Oklo and Vertiv Team Up To Take Advantage of AI Boom - Investopedia - July 22nd, 2025 [July 22nd, 2025]
- Deltas Use of AI for Setting Fares Sparks Concern in Washington - Skift - July 22nd, 2025 [July 22nd, 2025]