Install open-source AI in a commercial robot and it’ll clean your room – Big Think
Using just open-source AIs, researchers got a commercial robot to find and move objects around a room it had never entered before. The bot isnt perfect, but it suggests we might not be as far from sharing our homes with domestic robots as experts previously believed.
Just completely impossible:Demo videos of robotscleaning kitchens,making snacks, anddoing other choresmight have you hoping your days of loading the dishwasher are numbered, but AI experts predict were stilla decade awayfrom handing even a fraction of our chores over to bots.
There is a very pervasive feeling in the [robotics] community that homes are difficult, robots are difficult, and combining homes and robots is just completely impossible, Mahi Shafiullah, a PhD student at NYU Courant,told MIT Technology Review.
Simply tell the robot what to pick and where to drop it in natural language, and it will do it.
Open-source, off-the-shelf:A major holdup in the home robot revolution is the fact that building a robot that could work inanyoneshome is a lot harder than training one to work in a controlled lab environment.
A new study co-led by Shafiullah and involving researchers from NYU and AI at Meta suggests we might be closer to domestic robots than we think, though.
Using only open-source software, they modified a commercially available robot so that it could move objects around a room it had never entered before on demand. They call the system OK-Robot, and detail the work in apapershared on the preprint server arXiv.
Simply tell the robot what to pick and where to drop it in natural language, and it will do it,tweetedLerrel Pinto, who co-led the study along with Shafiullah.
How it works:Thebot at the core of the OK-Robot system is calledStretch(you can buy one for just $19,950, plus shipping and taxes). Stretch has a wheeled base, a vertical pole, and a robotic arm that can slide up and down the pole. At the end of the arm is a gripper that allows the bot to grasp objects.
To turn the robot into something humans can talk to, the team equipped it with vision-language models (VLMs) AIs trained to understand both images and words as well as pre-trained navigation and grasping models.
They then created a 3D video of a room using the iPhone app Record3D and shared it with the robot that process took about six minutes. After that, they could give the robot a text command to move an object in the room to a new location, and it would locate the object and move it.
They tested OK-Robot in 10 rooms. In each room, they choose 10-20 objects that could fit in the robots gripper and told it to move them (one at a time) to another part of the room (Move the soda can to the box, Move the Takis on the desk to the nightstand, etc.).
Overall, the robot had a 58.5% success rate at completing the tasks. But in rooms that were less cluttered, its success rate was much higher: 82.4%.
Looking ahead:Even though OK-Robot can only do one thing (and doesnt always do it right), the fact that it relies on off-the-shelf models and doesnt require any special training to work in a new environment just a video of the room is pretty remarkable.
The next step for the team will beopen sourcing their codeso that others can build off of what theyve started and potentially help get domestic robots doing our chores sooner than predicted.
I think once people start believing home robots are possible, a lot more work will start happening in this space, said Shafiullah.
This article was originally published by our sister site, Freethink.
More here:
Install open-source AI in a commercial robot and it'll clean your room - Big Think
- Congressman Don Beyer went back to college to learn AI - The Associated Press - April 15th, 2024 [April 15th, 2024]
- Georgia Tech Unveils New AI Makerspace in Collaboration with NVIDIA - Georgia Tech College of Engineering - April 15th, 2024 [April 15th, 2024]
- Energy-Guzzling AI Is Also the Future of Energy Savings - The Wall Street Journal - April 15th, 2024 [April 15th, 2024]
- South Korea to host second AI Safety Summit on May 21-22 - Reuters - April 15th, 2024 [April 15th, 2024]
- What is artificial intelligence (AI)? - Livescience.com - April 15th, 2024 [April 15th, 2024]
- 'Jailbreaking' AI services like ChatGPT and Claude 3 Opus is much easier than you think - Livescience.com - April 15th, 2024 [April 15th, 2024]
- Google AI podcast: 6 conversations with global leaders - The Keyword | Google Product and Technology News - April 15th, 2024 [April 15th, 2024]
- Galaxy AI features are coming to last-gen Samsung phones including the S21 series - The Verge - April 15th, 2024 [April 15th, 2024]
- AI's Most Promising Startups Are Getting Younger And Leaner - Forbes - April 15th, 2024 [April 15th, 2024]
- How to Stop Your Data From Being Used to Train AI - WIRED - April 15th, 2024 [April 15th, 2024]
- 7 of the best Sora AI videos featuring animals - Tom's Guide - April 15th, 2024 [April 15th, 2024]
- How Microsoft discovers and mitigates evolving attacks against AI guardrails - Microsoft - April 15th, 2024 [April 15th, 2024]
- Apple's First AI Features in iOS 18 Reportedly Won't Use Cloud Servers - MacRumors - April 15th, 2024 [April 15th, 2024]
- Samsung officially bringing One UI 6.1 and AI features to Galaxy S22, Fold 4, Flip 4 in May - 9to5Google - April 15th, 2024 [April 15th, 2024]
- Eat the future, pay with your face: my dystopian trip to an AI burger joint - The Guardian - April 15th, 2024 [April 15th, 2024]
- Humans Forget. AI Assistants Will Remember Everything - WIRED - April 15th, 2024 [April 15th, 2024]
- From boom to burst, the AI bubble is only heading in one direction - The Guardian - April 15th, 2024 [April 15th, 2024]
- Meta and Google announce new in-house AI chips, creating a trillion-dollar question for Nvidia - Fortune - April 15th, 2024 [April 15th, 2024]
- Google goes all in on generative AI at Google Cloud Next - TechCrunch - April 15th, 2024 [April 15th, 2024]
- Humane AI Pin review: the post-smartphone future isnt here yet - The Verge - April 15th, 2024 [April 15th, 2024]
- Ukraines attacks on Russian oil refineries show the growing threat AI drones pose to energy markets - CNBC - April 15th, 2024 [April 15th, 2024]
- Texas is replacing thousands of human exam graders with AI - The Verge - April 15th, 2024 [April 15th, 2024]
- Humane AI Pin review and OpenAIs YouTube project - The Verge - April 15th, 2024 [April 15th, 2024]
- AI makes retinal imaging 100 times faster, compared to manual method - National Institutes of Health (NIH) (.gov) - April 15th, 2024 [April 15th, 2024]
- AI Is Poised to Replace the Entry-Level Grunt Work of a Wall Street Career - The New York Times - April 15th, 2024 [April 15th, 2024]
- $10 Billion Productivity Startup Notion Wants To Build Your AI Everything App - Forbes - April 15th, 2024 [April 15th, 2024]
- Wall Street is bullish on copper, thanks to AI. Analysts love these stocks, giving one 234% upside - CNBC - April 15th, 2024 [April 15th, 2024]
- AI editing tools are coming to all Google Photos users - The Keyword | Google Product and Technology News - April 15th, 2024 [April 15th, 2024]
- AI model has potential to detect risk of childbirth-related post-traumatic stress disorder - National Institutes of Health (NIH) (.gov) - April 15th, 2024 [April 15th, 2024]
- How soon will machines outsmart humans? The biggest brains in AI disagree - Financial Times - April 15th, 2024 [April 15th, 2024]
- 3 Hot Artificial Intelligence (AI) Stocks to Buy With $1,000 and Hold Forever - Yahoo Finance - March 24th, 2024 [March 24th, 2024]
- 11 Stocks That Will Profit From AI Evolution - Yahoo Finance - March 24th, 2024 [March 24th, 2024]
- USF plans to launch college focused on artificial intelligence, cybersecurity and computing - University of South Florida - March 24th, 2024 [March 24th, 2024]
- Stability AI CEO resigns to pursue decentralized AI - The Verge - March 24th, 2024 [March 24th, 2024]
- Scientists create AI models that can talk to each other and pass on skills with limited human input - Livescience.com - March 24th, 2024 [March 24th, 2024]
- AI-generated blues misses a human touch and a metronome - The Verge - March 24th, 2024 [March 24th, 2024]
- Financial Times tests an AI chatbot trained on decades of its own articles - The Verge - March 24th, 2024 [March 24th, 2024]
- Microsoft's First AI Surface PC: What Does It Offer? - Investopedia - March 24th, 2024 [March 24th, 2024]
- S&P 500 Stocks: AI Stock Super Micro Is Lapping The Field In 2024, Even Nvidia - Investor's Business Daily - March 24th, 2024 [March 24th, 2024]
- Using AI to expand global access to reliable flood forecasts - Google Research - March 24th, 2024 [March 24th, 2024]
- Generative AI for designing and validating easily synthesizable and structurally novel antibiotics - Nature.com - March 24th, 2024 [March 24th, 2024]
- Top 8 Free AI Tools in 2024 - eWeek - March 24th, 2024 [March 24th, 2024]
- Researchers gave AI an 'inner monologue' and it massively improved its performance - Livescience.com - March 24th, 2024 [March 24th, 2024]
- The iPhone 16 could come with extra RAM and storage just for AI - TechRadar - March 24th, 2024 [March 24th, 2024]
- World's first global AI resolution unanimously adopted by United Nations - Ars Technica - March 24th, 2024 [March 24th, 2024]
- How Google uses AI to improve global flood forecasting - The Keyword | Google Product and Technology News - March 24th, 2024 [March 24th, 2024]
- These are JPMorgan's top AI stock picks outside of the chip space - CNBC - March 24th, 2024 [March 24th, 2024]
- 16 Changes to the Way Enterprises Are Building and Buying Generative AI - Andreessen Horowitz - March 24th, 2024 [March 24th, 2024]
- The first batch of Rabbit R1 AI devices will be shipping next week - TechRadar - March 24th, 2024 [March 24th, 2024]
- 7 great Google Gemini AI prompts to try this weekend - Tom's Guide - March 24th, 2024 [March 24th, 2024]
- Stability AI CEO resigns because youre not going to beat centralized AI with more centralized AI - TechCrunch - March 24th, 2024 [March 24th, 2024]
- Nvidia inks tie-ups with Abridge, GE HealthCare and Microsoft as it expands its footprint in healthcare AI - Fierce healthcare - March 24th, 2024 [March 24th, 2024]
- A Stealth AI 'Agent' To Speed Global Hiring Launches With $27 Million Fundraise - Forbes - March 24th, 2024 [March 24th, 2024]
- Microsoft and NVIDIA announce major integrations to accelerate generative AI for enterprises everywhere - Stories - Microsoft - March 24th, 2024 [March 24th, 2024]
- SMCI Stock: Why Chasing the 'Obvious' AI Play Could Leave You Burned - InvestorPlace - March 24th, 2024 [March 24th, 2024]
- Late Night With the Devil Directors Explain Using AI Art in the Film, Say They Experimented With Three Images Only (EXCLUSIVE) - Variety - March 24th, 2024 [March 24th, 2024]
- Broadcom shows a gargantuan AI chip XPU could be the world's largest chip built for a consumer AI company - Tom's Hardware - March 24th, 2024 [March 24th, 2024]
- SOUN Stock: The AI Voice Revolution Starts Here, and Nvidia Knows It - InvestorPlace - March 24th, 2024 [March 24th, 2024]
- Securing generative AI: Applying relevant security controls - AWS Blog - March 24th, 2024 [March 24th, 2024]
- Mustafa Suleyman, DeepMind and Inflection Co-founder, joins Microsoft to lead Copilot - The Official Microsoft Blog - Microsoft - March 24th, 2024 [March 24th, 2024]
- OpenAI Unveils A.I. That Instantly Generates Eye-Popping Videos - The New York Times - February 19th, 2024 [February 19th, 2024]
- Reddit signs content licensing deal with AI company ahead of IPO, Bloomberg reports - Reuters - February 19th, 2024 [February 19th, 2024]
- There's AI, and Then There's AGI: What You Need to Know to Tell the Difference - CNET - February 19th, 2024 [February 19th, 2024]
- Mysterious Entity Paying Reddit $60 Million to Train AI With Users' Posts - Futurism - February 19th, 2024 [February 19th, 2024]
- PayPal Ventures first AI investment, a credit-based dating app and Robinhoods good week - TechCrunch - February 19th, 2024 [February 19th, 2024]
- I'll Just ChatGPT It: Questioning The Effects of AI Use in Classrooms - The Connecticut College Voice - February 19th, 2024 [February 19th, 2024]
- Reddit has a new AI training deal to sell user content - The Verge - February 19th, 2024 [February 19th, 2024]
- Super Micro Computer: Riding The AI Revolution (NASDAQ:SMCI) - Seeking Alpha - February 19th, 2024 [February 19th, 2024]
- Reddit reportedly signed a multi-million dollar licensing deal to train AI models - Mashable - February 19th, 2024 [February 19th, 2024]
- 6 Compelling Uses of Generative AI | Inc.com - Inc. - February 19th, 2024 [February 19th, 2024]
- Billionaire Investor Chase Coleman Has 46% of His Portfolio Invested in 5 Brilliant Artificial Intelligence (AI) Growth ... - The Motley Fool - February 19th, 2024 [February 19th, 2024]
- We Tested an AI Tutor for Kids. It Struggled With Basic Math. - The Wall Street Journal - February 19th, 2024 [February 19th, 2024]
- OpenAI, Meta and other tech giants sign effort to fight AI election interference - Reuters - February 19th, 2024 [February 19th, 2024]
- OpenAI's Sam Altman has huge chip ambitions. They might not work - Quartz - February 19th, 2024 [February 19th, 2024]
- AI Avatars Will Soon Attend Your Work Meetings, Claims Tech CEO - NDTV - February 19th, 2024 [February 19th, 2024]
- AI In Focus Ahead Of Nvidia's Earnings, Assessing AIO's Outlook (NYSE:AIO) - Seeking Alpha - February 19th, 2024 [February 19th, 2024]
- Scoop: N.Y. governor wants to criminalize deceptive AI - Axios - February 19th, 2024 [February 19th, 2024]
- What Are AI Text Generators? 8 Best Tools To Improve Writing - Forbes - February 19th, 2024 [February 19th, 2024]
- Staying ahead of threat actors in the age of AI - Microsoft - February 19th, 2024 [February 19th, 2024]
- Election security threats in 2024 range from AI to anthrax? - The Register - February 19th, 2024 [February 19th, 2024]
Tags: