ChatGPT cant think consciousness is something entirely different to today’s AI – The Conversation
There has been shock around the world at the rapid rate of progress with ChatGPT and other artificial intelligence created with whats known as large language models (LLMs). These systems can produce text that seems to display thought, understanding and even creativity.
But can these systems really think and understand? This is not a question that can be answered through technological advance, but careful philosophical analysis and argument tells us the answer is no. And without working through these philosophical issues, we will never fully comprehend the dangers and benefits of the AI revolution.
In 1950, the father of modern computing, Alan Turing, published a paper which laid out a way of determining whether a computer thinks. This is now called the Turing test. Turing imagined a human being engaged in conversation with two interlocutors hidden from view: one another human being, the other a computer. The game is to work out which is which.
If a computer can fool 70% of judges in a five-minute conversation into thinking its a person, the computer passes the test. Would passing the Turing test something which now seems imminent show that an AI has achieved thought and understanding?
Turing dismissed this question as hopelessly vague, and replaced it with a pragmatic definition of thought, whereby to think just means passing the test.
Turing was wrong, however, when he said the only clear notion of understanding is the purely behavioural one of passing his test. Although this way of thinking now dominates cognitive science, there is also a clear, everyday notion of understanding thats tied to consciousness. To understand in this sense is to consciously grasp some truth about reality.
In 1997, the Deep Blue AI beat chess grandmaster Garry Kasparov. On a purely behavioural conception of understanding, Deep Blue had knowledge of chess strategy that surpasses any human being. But it was not conscious: it didnt have any feelings or experiences.
Humans consciously understand the rules of chess and the rationale of a strategy. Deep Blue, in contrast, was an unfeeling mechanism that had been trained to perform well at the game. Likewise, ChatGPT is an unfeeling mechanism that has been trained on huge amounts of human-made data to generate content that seems like it was written by a person.
It doesnt consciously understand the meaning of the words its spitting out. If thought means the act of conscious reflection, then ChatGPT has no thoughts about anything.
How can I be so sure that ChatGPT isnt conscious? In the 1990s, neuroscientist Christof Koch bet philosopher David Chalmers a case of fine wine that scientists would have entirely pinned down the neural correlates of consciousness in 25 years.
By this, he meant they would have identified the forms of brain activity necessary and sufficient for conscious experience. Its about time Koch paid up, as there is zero consensus that this has happened.
This is because consciousness cant be observed by looking inside your head. In their attempts to find a connection between brain activity and experience, neuroscientists must rely on their subjects testimony, or on external markers of consciousness. But there are multiple ways of interpreting the data.
Some scientists believe there is a close connection between consciousness and reflective cognition the brains ability to access and use information to make decisions. This leads them to think that the brains prefrontal cortex where the high-level processes of acquiring knowledge take place is essentially involved in all conscious experience. Others deny this, arguing instead that it happens in whichever local brain region that the relevant sensory processing takes place.
Scientists have good understanding of the brains basic chemistry. We have also made progress in understanding the high-level functions of various bits of the brain. But we are almost clueless about the bit in-between: how the high-level functioning of the brain is realised at the cellular level.
People get very excited about the potential of scans to reveal the workings of the brain. But fMRI (functional magnetic resonance imaging) has a very low resolution: every pixel on a brain scan corresponds to 5.5 million neurons, which means theres a limit to how much detail these scans are able to show.
I believe progress on consciousness will come when we understand better how the brain works.
As I argue in my forthcoming book Why? The Purpose of the Universe, consciousness must have evolved because it made a behavioural difference. Systems with consciousness must behave differently, and hence survive better, than systems without consciousness.
If all behaviour was determined by underlying chemistry and physics, natural selection would have no motivation for making organisms conscious; we would have evolved as unfeeling survival mechanisms.
My bet, then, is that as we learn more about the brains detailed workings, we will precisely identify which areas of the brain embody consciousness. This is because those regions will exhibit behaviour that cant be explained by currently known chemistry and physics. Already, some neuroscientists are seeking potential new explanations for consciousness to supplement the basic equations of physics.
While the processing of LLMs is now too complex for us to fully understand, we know that it could in principle be predicted from known physics. On this basis, we can confidently assert that ChatGPT is not conscious.
There are many dangers posed by AI, and I fully support the recent call by tens of thousands of people, including tech leaders Steve Wozniak and Elon Musk, to pause development to address safety concerns. The potential for fraud, for example, is immense. However, the argument that near-term descendants of current AI systems will be super-intelligent, and hence a major threat to humanity, is premature.
This doesnt mean current AI systems arent dangerous. But we cant correctly assess a threat unless we accurately categorise it. LLMs arent intelligent. They are systems trained to give the outward appearance of human intelligence. Scary, but not that scary.
If so, youll be interested in our free daily newsletter. Its filled with the insights of academic experts, written so that everyone can understand whats going on in the world. With the latest scientific discoveries, thoughtful analysis on political issues and research-based life tips, each email is filled with articles that will inform you and often intrigue you.
Get our newsletters
Editor and General Manager
Get news thats free, independent and based on evidence.
Get newsletter
Editor
Find peace of mind, and the facts, with experts. Add evidence-based articles to your news digest. No uninformed commentariat. Just experts. 90,000 of them have written for us. They trust us. Give it a go.
Get our newsletter
If you found the article you just read to be insightful, youll be interested in our free daily newsletter. Its filled with the insights of academic experts, written so that everyone can understand whats going on in the world. Each newsletter has articles that will inform and intrigue you.
Subscribe now
CEO | Editor-in-Chief
It helps you go deeper into key political issues and also introduces you to the diversity of research coming out of the continent. It's not about breaking news. It's not about unfounded opinions. The Europe newsletter is evidence-based expertise from European scholars, presented by myself in France, and two of my colleagues in Spain and the UK.
Get our newsletter
Head of English section, France edition
The rest is here:
ChatGPT cant think consciousness is something entirely different to today's AI - The Conversation
- Awareness and Understanding of Artificial Intelligence and Super Intelligence - Ipsos - October 22nd, 2026 [October 22nd, 2026]
- Trumps Move to Rename Artificial Intelligence to Super Intelligence is About Much More Than It Seems - Talking Points Memo - October 17th, 2026 [October 17th, 2026]
- Artificial intelligence (nope, not super intelligence ) discussions are moving beyond concerns about data residency - Apple World Today - October 17th, 2026 [October 17th, 2026]
- President Donald Trump doesnt like the term artificial intelligence, but can super intelligence really catch on? - Digital Camera World - October 17th, 2026 [October 17th, 2026]
- I am the enemy because I wont call Artificial Intelligence Super Intelligence until its actually super - Stuff - October 10th, 2026 [October 10th, 2026]
- Marjorie Taylor Greene takes aim at Trump as he says anyone using Artificial Intelligence instead of Super Intelligence will be called an Enemy -... - October 10th, 2026 [October 10th, 2026]
- Trump Says Anyone Using Artificial Intelligence Instead of Super Intelligence Is Enemy: What We Know - News18 - October 10th, 2026 [October 10th, 2026]
- Why Trump wants to call artificial intelligence 'Super Intelligence' - DW.com - October 4th, 2026 [October 4th, 2026]
- Artificial or super? When it comes to digital intelligence, its all in the name. - The Week - October 4th, 2026 [October 4th, 2026]
- Trump tells federal agencies to use the term 'Super Intelligence ' instead of artificial intelligence President insists that AI is only suffering... - October 4th, 2026 [October 4th, 2026]
- US diplomats told to say super intelligence not artificial intelligence after Trumps call - AP News - September 28th, 2026 [September 28th, 2026]
- Trump wants to call AI Super Intelligence because artificial sounds fake but thats not even what superintelligence means - Tom's Guide - September 28th, 2026 [September 28th, 2026]
- Trump says Xi agrees with his Super Intelligence framing instead of Artificial Intelligence - Firstpost - September 28th, 2026 [September 28th, 2026]
- Trump Says He's Changing Artificial Intelligence to 'Super Intelligence' on Government Documents - Gizmodo - September 26th, 2026 [September 26th, 2026]
- 'Artificial' is out: Trump orders officials to call it 'super intelligence' instead - Euronews.com - September 26th, 2026 [September 26th, 2026]
- Diplomats ordered to use super intelligence instead of artificial intelligence in Trump push - The Hill - September 26th, 2026 [September 26th, 2026]
- Trump Addresses United Nations to Declare That the United States Is Now Calling Artificial Intelligence "Super Intelligence" in "All... - September 26th, 2026 [September 26th, 2026]
- Trump is rebranding Artificial Intelligence as Super Intelligence. Heres what will change - Firstpost - September 26th, 2026 [September 26th, 2026]
- Why is the State Department replacing artificial intelligence with super intelligence? - attackofthefanboy.com - September 26th, 2026 [September 26th, 2026]
- Trump just decided to rename artificial intelligence. Thats super confusing - Nine.com.au - September 26th, 2026 [September 26th, 2026]
- Diplomats ordered to use super intelligence instead of artificial intelligence in Trump push - AOL.ca - September 26th, 2026 [September 26th, 2026]
- Trump Wants To Rename AI 'Super Intelligence', Calling 'Artificial' Inaccurate as He Plans AI Force and Czar - International Business Times UK - September 26th, 2026 [September 26th, 2026]
- VTU introduces artificial super intelligence to make students job-ready in Bengaluru - MSN - March 7th, 2026 [March 7th, 2026]
- VTU signs pact with UK firm to introduce artificial super intelligence - MSN - February 11th, 2026 [February 11th, 2026]
- VTU introduces Artificial Super Intelligence to make students job-ready in Bengaluru - EdexLive - February 7th, 2026 [February 7th, 2026]
- President Lee Requests AI Advice... Son Says "Artificial Super Intelligence (ASI) Is the Next Technology" - - December 7th, 2025 [December 7th, 2025]
- AnChain.AI Announces Strategic Investment Round to Build Artificial Super Intelligence for Fighting Fraud - Yahoo Finance - December 7th, 2025 [December 7th, 2025]
- Trillion Labs, a super-intelligent artificial intelligence (AI) startup, announced on the 21st that - - October 21st, 2025 [October 21st, 2025]
- SoftBank to pay $5.4 billion for robotics producer, one of four areas its investing to realize artificial super intelligence. - MarketWatch - October 9th, 2025 [October 9th, 2025]
- Psycho AI now 'evolves without human control' as Artificial Super Intelligence fears grow - MSN - October 4th, 2025 [October 4th, 2025]
- Meta CEO Mark Zuckerberg Just Assembled a "Super Intelligence Avengers" Team That Could Totally Change the Game in Artificial Intelligence... - July 20th, 2025 [July 20th, 2025]
- Former Google CEO warns AI could surpass human intelligence in next few years; what is artificial super - The Times of India - July 8th, 2025 [July 8th, 2025]
- SoftBank (SFTBY) Aims to Lead in Artificial Super Intelligence - GuruFocus - June 29th, 2025 [June 29th, 2025]
- SoftBank's Masayoshi Son Sets Sights On Artificial Super Intelligence Domination With Bets On OpenAI And Ampere: 'I'm All In' - Alibaba Gr Hldgs... - June 28th, 2025 [June 28th, 2025]
- Masayoshi Son sees SoftBank leading 'artificial super intelligence' race in 10 years (SFTBY:Pink Limited Info) - Seeking Alpha - June 28th, 2025 [June 28th, 2025]
- SoftBank Vows to Lead Artificial Super Intelligence Revolution With Aggressive Bets - kaohoon international - June 28th, 2025 [June 28th, 2025]
- Super Micro Computer vs. SoundHound AI: What's the Better Artificial Intelligence Stock to Buy Today? - The Motley Fool - June 22nd, 2025 [June 22nd, 2025]
- Qubetics: Investor's Favorite & Top Crypto to Invest in Today, Plus Kaspa Blockchain Tech & Artificial Super Intelligence Alliance Networks -... - March 28th, 2025 [March 28th, 2025]
- Qubetics Among The Best Crypto ICOs to Invest In Now, Solanas Rise, and Artificial Super Intelligence Alliance Dominance - Analytics Insight - March 3rd, 2025 [March 3rd, 2025]
- Elon Musk Is Not Taking Over the GovernmentAI Is: The NSA and the Emergence of Artificial Super Intelligence - substack.com - March 3rd, 2025 [March 3rd, 2025]
- Next Bull Run Crypto: How Qubetics, Artificial Super Intelligence Alliance, and Solana Are Shaping the Future of Blockchain - Techpoint Africa - February 27th, 2025 [February 27th, 2025]
- The Best Crypto to Buy This Week: Qubetics, Stacks, and Artificial Super Intelligence AllianceWhich One Deserves Your Investment? - MSN - February 27th, 2025 [February 27th, 2025]
- Learn How Solana And Artificial Super Intelligence Alliance Are Gaining Traction And Why Qubetics ($TICS) Could Be the Next Bull Run Crypto With... - February 16th, 2025 [February 16th, 2025]
- The Singularity Is Near: How Super Artificial Intelligence Will Reshape The World - Space Daily - January 26th, 2025 [January 26th, 2025]
- 5 Top Altcoins to Invest in This Week: Qubetics ($TICS), Arweave, Ondo, ZIGnaly And Artificial Super Intelligence Alliance Are On Spotlight -... - January 26th, 2025 [January 26th, 2025]
- The Best Altcoin with 100x Potential: Qubetics ($TICS) Has Earned the Trust of Over 14,000 Holders, While Artificial Super Intelligence Alliance... - January 13th, 2025 [January 13th, 2025]
- SoftBank's Masayoshi Son says artificial super intelligence to exist by 2035 - MSN - November 2nd, 2024 [November 2nd, 2024]
- SoftBank's Son says artificial super intelligence to exist by 2035 - MSN - November 2nd, 2024 [November 2nd, 2024]
- Qubetics Leads the Charge Against Quantum Threats, Fantom Soars and Artificial Super Intelligence Alliance Set for Growth: Guest Post by TheCoinrise... - October 12th, 2024 [October 12th, 2024]
- $OCEAN, $AGIX, And $FET Merge To Propel The Development Of Artificial Super Intelligence - The Merkle News - September 10th, 2024 [September 10th, 2024]
- Specter of Artificial Super Intelligence Looms in Camden Discussion - Freepress Online - August 25th, 2024 [August 25th, 2024]
- AI Coin Price: Will Artificial Superintelligence Alliance Have Bullish Impact? - Bankless Times - July 6th, 2024 [July 6th, 2024]
- 3 crypto firms are combining into one AI token - Morning Brew - June 16th, 2024 [June 16th, 2024]
- Could This New Artificial Intelligence (AI) Crypto Token Be a Millionaire Maker? - The Motley Fool - June 16th, 2024 [June 16th, 2024]
- Former OpenAI researcher outlines AI advances expectations in the next decade - Windows Central - June 16th, 2024 [June 16th, 2024]
- Creepy Study Suggests AI Is The Reason We've Never Found Aliens - ScienceAlert - May 11th, 2024 [May 11th, 2024]
- Beyond Human Cognition: The Future of Artificial Super Intelligence - Medium - January 16th, 2024 [January 16th, 2024]
- AI can easily be trained to lie and it can't be fixed, study says - Yahoo New Zealand News - January 16th, 2024 [January 16th, 2024]
- OpenAI's Ilya Sutskever Has a Plan for Keeping Super-Intelligent AI in Check - WIRED - December 17th, 2023 [December 17th, 2023]
- Sam Altman on OpenAI and Artificial General Intelligence - TIME - December 17th, 2023 [December 17th, 2023]
- Will AIs Next Wave of Super Intelligence Replace Human Ingenuity? Its Complicated - Grit Daily - December 17th, 2023 [December 17th, 2023]
- New Novel Skillfully Weaves Artificial Intelligence, Martial Arts and ... - Lakenewsonline.com - November 14th, 2023 [November 14th, 2023]
- Googles artificial intelligence predicts the weather around the globe in just one minute - EL PAS USA - November 14th, 2023 [November 14th, 2023]
- Nick Bostrom: Will AI lead to tyranny? - UnHerd - November 14th, 2023 [November 14th, 2023]
- Appeals court mulls whether to revive Wynn FARA case - POLITICO - November 14th, 2023 [November 14th, 2023]
- The AI Revolution From Evolution to Super intelligence - Cryptopolitan - October 21st, 2023 [October 21st, 2023]
- AI Symposium Explores Flaws and Potential of Artificial Intelligence - The Skanner - October 21st, 2023 [October 21st, 2023]
- Artificial intelligence has surprising pick to win 2024 Super Bowl - ClutchPoints - October 21st, 2023 [October 21st, 2023]
- Artificial Intelligence isn't taking over anything - Talon Marks - October 21st, 2023 [October 21st, 2023]
- AI and You: The Chatbots Are Talking to Each Other, AI Helps ... - CNET - October 21st, 2023 [October 21st, 2023]
- How to Build a Chatbot Using Streamlit and Llama 2 - MUO - MakeUseOf - October 21st, 2023 [October 21st, 2023]
- ONU's Polar SURF undergraduate research projects expand into the ... - Northern News - October 21st, 2023 [October 21st, 2023]
- Why Artificial Intelligence Needs to Consider the Unique Needs of ... - Women's eNews - September 27th, 2023 [September 27th, 2023]
- What Is Image-to-Image Translation? | Definition from TechTarget - TechTarget - September 27th, 2023 [September 27th, 2023]
- There is probably an 80% consensus that free will is actually ... - CTech - September 27th, 2023 [September 27th, 2023]
- Meta is planning on introducing dozens of chatbot personas ... - TechRadar - September 27th, 2023 [September 27th, 2023]
- We Cannot Trust AI With Control Of Our Bombs - Fair Observer - August 26th, 2023 [August 26th, 2023]
- AI: is the end nigh? | Laura Dodsworth - The Critic - August 26th, 2023 [August 26th, 2023]
- "Most Beautiful Car in the World" Alfa Romeo Asks People To ... - autoevolution - August 26th, 2023 [August 26th, 2023]
- Managing Past, Present and Future Epidemics - Australian Institute ... - Australian Institute of International Affairs - August 26th, 2023 [August 26th, 2023]