Researchers gave AI an ‘inner monologue’ and it massively improved its performance – Livescience.com
Giving artificial intelligence (AI) systems an "inner monologue" makes them considerably better at reasoning, new research shows.
The method trains AI systems to think before they respond to prompts, just as many people consider what we should say next before we speak. This is different from the way scientists have trained mainstay AI chatbots, like ChatGPT, which don't "think" about what they write or anticipate different possibilities for the next steps in a conversation.
Dubbed "Quiet-STaR," the new method instructs an AI system to generate many inner rationales in parallel before responding to a conversational prompt. When the AI answers prompts, it generates a mixture of these predictions with and without a rationale, printing the best answer which can be verified by a human participant depending on the nature of the question.
Finally, it learns by discarding rationales that proved incorrect. In effect, the training method gives AI agents the capacity to anticipate future conversations and learn from ongoing ones.
Related: AI singularity may come in 2027 with artificial 'super intelligence' sooner than we think, says top scientist
The researchers applied the Quiet-STaR algorithm to Mistral 7B, an open-source large language model (LLM), and posted the results March 14 to the pre-print database arXiv. (The paper has not yet been peer-reviewed.)
The Quiet-STaR-trained version of Mistral 7B scored 47.2% on a reasoning test versus 36.3% before any training. It still flunked a school math test, earning a score of 10.9%. But that was nearly double the starting score of 5.9% in the vanilla version.
Get the worlds most fascinating discoveries delivered straight to your inbox.
Models like ChatGPT and Gemini are built from neural networks collections of machine learning algorithms arranged in a way that mimics the structure and learning patterns of the human brain. However, systems built using this architecture are abysmal at common sense reasoning or contextualization and AI chatbots do not have genuine "understanding."
Past attempts to improve the reasoning capabilities of LLMs have been highly domain-specific and could not be applied to different types of AI models.
The self-taught reasoner (STaR) algorithm, which the researchers used as a basis for their work, is one example of such a training algorithm but is held back by these limitations.
The scientists who developed Quiet-STaR named it that because the principles of STaR can be applied quietly in the background and generally over several different types of LLM, independent of the original training data. Now they want to investigate how techniques like theirs can reduce the gap between neural network-based AI systems and human-like reasoning capabilities.
See original here:
Researchers gave AI an 'inner monologue' and it massively improved its performance - Livescience.com
- Congressman Don Beyer went back to college to learn AI - The Associated Press - April 15th, 2024 [April 15th, 2024]
- Georgia Tech Unveils New AI Makerspace in Collaboration with NVIDIA - Georgia Tech College of Engineering - April 15th, 2024 [April 15th, 2024]
- Energy-Guzzling AI Is Also the Future of Energy Savings - The Wall Street Journal - April 15th, 2024 [April 15th, 2024]
- South Korea to host second AI Safety Summit on May 21-22 - Reuters - April 15th, 2024 [April 15th, 2024]
- What is artificial intelligence (AI)? - Livescience.com - April 15th, 2024 [April 15th, 2024]
- 'Jailbreaking' AI services like ChatGPT and Claude 3 Opus is much easier than you think - Livescience.com - April 15th, 2024 [April 15th, 2024]
- Google AI podcast: 6 conversations with global leaders - The Keyword | Google Product and Technology News - April 15th, 2024 [April 15th, 2024]
- Galaxy AI features are coming to last-gen Samsung phones including the S21 series - The Verge - April 15th, 2024 [April 15th, 2024]
- AI's Most Promising Startups Are Getting Younger And Leaner - Forbes - April 15th, 2024 [April 15th, 2024]
- How to Stop Your Data From Being Used to Train AI - WIRED - April 15th, 2024 [April 15th, 2024]
- 7 of the best Sora AI videos featuring animals - Tom's Guide - April 15th, 2024 [April 15th, 2024]
- How Microsoft discovers and mitigates evolving attacks against AI guardrails - Microsoft - April 15th, 2024 [April 15th, 2024]
- Apple's First AI Features in iOS 18 Reportedly Won't Use Cloud Servers - MacRumors - April 15th, 2024 [April 15th, 2024]
- Samsung officially bringing One UI 6.1 and AI features to Galaxy S22, Fold 4, Flip 4 in May - 9to5Google - April 15th, 2024 [April 15th, 2024]
- Eat the future, pay with your face: my dystopian trip to an AI burger joint - The Guardian - April 15th, 2024 [April 15th, 2024]
- Humans Forget. AI Assistants Will Remember Everything - WIRED - April 15th, 2024 [April 15th, 2024]
- From boom to burst, the AI bubble is only heading in one direction - The Guardian - April 15th, 2024 [April 15th, 2024]
- Meta and Google announce new in-house AI chips, creating a trillion-dollar question for Nvidia - Fortune - April 15th, 2024 [April 15th, 2024]
- Google goes all in on generative AI at Google Cloud Next - TechCrunch - April 15th, 2024 [April 15th, 2024]
- Humane AI Pin review: the post-smartphone future isnt here yet - The Verge - April 15th, 2024 [April 15th, 2024]
- Ukraines attacks on Russian oil refineries show the growing threat AI drones pose to energy markets - CNBC - April 15th, 2024 [April 15th, 2024]
- Texas is replacing thousands of human exam graders with AI - The Verge - April 15th, 2024 [April 15th, 2024]
- Humane AI Pin review and OpenAIs YouTube project - The Verge - April 15th, 2024 [April 15th, 2024]
- AI makes retinal imaging 100 times faster, compared to manual method - National Institutes of Health (NIH) (.gov) - April 15th, 2024 [April 15th, 2024]
- AI Is Poised to Replace the Entry-Level Grunt Work of a Wall Street Career - The New York Times - April 15th, 2024 [April 15th, 2024]
- $10 Billion Productivity Startup Notion Wants To Build Your AI Everything App - Forbes - April 15th, 2024 [April 15th, 2024]
- Wall Street is bullish on copper, thanks to AI. Analysts love these stocks, giving one 234% upside - CNBC - April 15th, 2024 [April 15th, 2024]
- AI editing tools are coming to all Google Photos users - The Keyword | Google Product and Technology News - April 15th, 2024 [April 15th, 2024]
- AI model has potential to detect risk of childbirth-related post-traumatic stress disorder - National Institutes of Health (NIH) (.gov) - April 15th, 2024 [April 15th, 2024]
- How soon will machines outsmart humans? The biggest brains in AI disagree - Financial Times - April 15th, 2024 [April 15th, 2024]
- 3 Hot Artificial Intelligence (AI) Stocks to Buy With $1,000 and Hold Forever - Yahoo Finance - March 24th, 2024 [March 24th, 2024]
- 11 Stocks That Will Profit From AI Evolution - Yahoo Finance - March 24th, 2024 [March 24th, 2024]
- USF plans to launch college focused on artificial intelligence, cybersecurity and computing - University of South Florida - March 24th, 2024 [March 24th, 2024]
- Stability AI CEO resigns to pursue decentralized AI - The Verge - March 24th, 2024 [March 24th, 2024]
- Scientists create AI models that can talk to each other and pass on skills with limited human input - Livescience.com - March 24th, 2024 [March 24th, 2024]
- AI-generated blues misses a human touch and a metronome - The Verge - March 24th, 2024 [March 24th, 2024]
- Financial Times tests an AI chatbot trained on decades of its own articles - The Verge - March 24th, 2024 [March 24th, 2024]
- Microsoft's First AI Surface PC: What Does It Offer? - Investopedia - March 24th, 2024 [March 24th, 2024]
- S&P 500 Stocks: AI Stock Super Micro Is Lapping The Field In 2024, Even Nvidia - Investor's Business Daily - March 24th, 2024 [March 24th, 2024]
- Using AI to expand global access to reliable flood forecasts - Google Research - March 24th, 2024 [March 24th, 2024]
- Generative AI for designing and validating easily synthesizable and structurally novel antibiotics - Nature.com - March 24th, 2024 [March 24th, 2024]
- Top 8 Free AI Tools in 2024 - eWeek - March 24th, 2024 [March 24th, 2024]
- The iPhone 16 could come with extra RAM and storage just for AI - TechRadar - March 24th, 2024 [March 24th, 2024]
- World's first global AI resolution unanimously adopted by United Nations - Ars Technica - March 24th, 2024 [March 24th, 2024]
- How Google uses AI to improve global flood forecasting - The Keyword | Google Product and Technology News - March 24th, 2024 [March 24th, 2024]
- These are JPMorgan's top AI stock picks outside of the chip space - CNBC - March 24th, 2024 [March 24th, 2024]
- 16 Changes to the Way Enterprises Are Building and Buying Generative AI - Andreessen Horowitz - March 24th, 2024 [March 24th, 2024]
- The first batch of Rabbit R1 AI devices will be shipping next week - TechRadar - March 24th, 2024 [March 24th, 2024]
- 7 great Google Gemini AI prompts to try this weekend - Tom's Guide - March 24th, 2024 [March 24th, 2024]
- Stability AI CEO resigns because youre not going to beat centralized AI with more centralized AI - TechCrunch - March 24th, 2024 [March 24th, 2024]
- Nvidia inks tie-ups with Abridge, GE HealthCare and Microsoft as it expands its footprint in healthcare AI - Fierce healthcare - March 24th, 2024 [March 24th, 2024]
- A Stealth AI 'Agent' To Speed Global Hiring Launches With $27 Million Fundraise - Forbes - March 24th, 2024 [March 24th, 2024]
- Microsoft and NVIDIA announce major integrations to accelerate generative AI for enterprises everywhere - Stories - Microsoft - March 24th, 2024 [March 24th, 2024]
- SMCI Stock: Why Chasing the 'Obvious' AI Play Could Leave You Burned - InvestorPlace - March 24th, 2024 [March 24th, 2024]
- Late Night With the Devil Directors Explain Using AI Art in the Film, Say They Experimented With Three Images Only (EXCLUSIVE) - Variety - March 24th, 2024 [March 24th, 2024]
- Broadcom shows a gargantuan AI chip XPU could be the world's largest chip built for a consumer AI company - Tom's Hardware - March 24th, 2024 [March 24th, 2024]
- SOUN Stock: The AI Voice Revolution Starts Here, and Nvidia Knows It - InvestorPlace - March 24th, 2024 [March 24th, 2024]
- Securing generative AI: Applying relevant security controls - AWS Blog - March 24th, 2024 [March 24th, 2024]
- Mustafa Suleyman, DeepMind and Inflection Co-founder, joins Microsoft to lead Copilot - The Official Microsoft Blog - Microsoft - March 24th, 2024 [March 24th, 2024]
- OpenAI Unveils A.I. That Instantly Generates Eye-Popping Videos - The New York Times - February 19th, 2024 [February 19th, 2024]
- Reddit signs content licensing deal with AI company ahead of IPO, Bloomberg reports - Reuters - February 19th, 2024 [February 19th, 2024]
- Install open-source AI in a commercial robot and it'll clean your room - Big Think - February 19th, 2024 [February 19th, 2024]
- There's AI, and Then There's AGI: What You Need to Know to Tell the Difference - CNET - February 19th, 2024 [February 19th, 2024]
- Mysterious Entity Paying Reddit $60 Million to Train AI With Users' Posts - Futurism - February 19th, 2024 [February 19th, 2024]
- PayPal Ventures first AI investment, a credit-based dating app and Robinhoods good week - TechCrunch - February 19th, 2024 [February 19th, 2024]
- I'll Just ChatGPT It: Questioning The Effects of AI Use in Classrooms - The Connecticut College Voice - February 19th, 2024 [February 19th, 2024]
- Reddit has a new AI training deal to sell user content - The Verge - February 19th, 2024 [February 19th, 2024]
- Super Micro Computer: Riding The AI Revolution (NASDAQ:SMCI) - Seeking Alpha - February 19th, 2024 [February 19th, 2024]
- Reddit reportedly signed a multi-million dollar licensing deal to train AI models - Mashable - February 19th, 2024 [February 19th, 2024]
- 6 Compelling Uses of Generative AI | Inc.com - Inc. - February 19th, 2024 [February 19th, 2024]
- Billionaire Investor Chase Coleman Has 46% of His Portfolio Invested in 5 Brilliant Artificial Intelligence (AI) Growth ... - The Motley Fool - February 19th, 2024 [February 19th, 2024]
- We Tested an AI Tutor for Kids. It Struggled With Basic Math. - The Wall Street Journal - February 19th, 2024 [February 19th, 2024]
- OpenAI, Meta and other tech giants sign effort to fight AI election interference - Reuters - February 19th, 2024 [February 19th, 2024]
- OpenAI's Sam Altman has huge chip ambitions. They might not work - Quartz - February 19th, 2024 [February 19th, 2024]
- AI Avatars Will Soon Attend Your Work Meetings, Claims Tech CEO - NDTV - February 19th, 2024 [February 19th, 2024]
- AI In Focus Ahead Of Nvidia's Earnings, Assessing AIO's Outlook (NYSE:AIO) - Seeking Alpha - February 19th, 2024 [February 19th, 2024]
- Scoop: N.Y. governor wants to criminalize deceptive AI - Axios - February 19th, 2024 [February 19th, 2024]
- What Are AI Text Generators? 8 Best Tools To Improve Writing - Forbes - February 19th, 2024 [February 19th, 2024]
- Staying ahead of threat actors in the age of AI - Microsoft - February 19th, 2024 [February 19th, 2024]
- Election security threats in 2024 range from AI to anthrax? - The Register - February 19th, 2024 [February 19th, 2024]
Tags: