At CES, new AI tools for TVs offer new features for both content and commerce – Digiday
The current wave of AI innovation is making smart TVs smarter.
At CES 2024 this week in Las Vegas, giant and startup TV manufactures alike are rolling out new AI integrations to power viewing, advertising and shopping.
Earlier this week, Telly a startup that gives people a free 4K TV in exchange for more ads debuted a new voice AI assistant called Hey Telly. Built with OpenAIs large language model, the chatbot helps operate the TV, chat with viewers and behave in ways similar to ChatGPT. With three possible characters to start and more to come the chatbot can also provide personalized recommendations based on whos watching. Its also exploring ways of using generative AI platforms like Midjourney and DALL-E to let people make generative AI images for TV screensavers.
Besides using OpenAIs LLMs, Telly also employs others for various tasks. For example, it uses a separate voice engine that can translate speech to text and then use that raw text for various AI models depending on uses.
We have brought in the models, all the processing, that we see fit for the use case, said Telly chief product officer Sascha Prueter.
Beyond startups, giants like Samsung, LG and Hisense are all adding AI to new TVs to improve picture and sound quality. For example, some use visual recognition to optimize the screen based on the content someone is watching or playing. Others are using AI to optimize audio by analyzing a rooms background noise and voices.
TV manufacturers also hope new AI features will make screens more useful beyond entertainment options include assisting people with workouts, providing telehealth tools, and becoming a hub for controlling other smart home devices. One end goal is to potentially replace other smart screens from companies like Amazon and Google by making the TV a central hub for everything in the home.
Some marketers who attended CES said they think new transparent TVs from LG and Samsung also powered by new AI processors offer compelling uses beyond showing viewers whats on the wall behind their big screen. For example, the newly unveiled devices which can operate like a normal TV or turn off to be clear as glass might someday be used by retailers to give passersby new ways to window shop.
AI is also enabling more options for commerce. Telly has added new AI-powered image recognition tools that show products to buy depending on whats on the screen. In a demo for Digiday during CES, a televised basketball game showcased products worn by players that can then be bought directly through Telly. Advertisers will also be able to sponsor product ads to show alongside other unpaid personalized recommendations.
Telly isnt the only TV startup thinking about AI and e-commerce. Another on the showroom floor at CES was Displace, which initially debuted a wireless TV at CES 2023. This year, the startups added a way to use hand gestures which the TV recognizes with AI to tell the TV to pause the show, analyze the screen for various products before Displace suggests similar products to buy.
Unlike Telly, Displace doesnt plan to run sponsored product ads, but one of its TVs does have an NFC reader so people can tap their preferred method of payment to buy something on Amazon or another platform. (Displace is also using OpenAIs technology along with various other sources.) Displaces new features also hope to ultimately provide recipes and show where to buy ingredients based on a cooking show someone is watching in their kitchen.
We are building a TV platform, said Displace founder and CEO Balaji Krishnan. This is exactly what happened with smartphones. Before smartphones, everything was SMS-based messaging. And even payments PayPal started with email, but now everything is integrated into the phone because companies like Apple and Google created a platform We are trying to create a contextual thing for the TV set.
Of course, the AI used in new cameras and voice tools also creates new privacy concerns: How do they make sure their faces, conversations, credit card data and other information arent leaked by one of the LLMs that process them? Prueter also said Tellys survey data is highly confidential and wont be fed back into ChatGPT or other public AI models.
To offer a sense of privacy, Tellys camera has a shutter in front and requires permission before taking a photo, but other sensors know when people are watching and how many are in the room. On Displaces devices, the camera pops up and can get closed into the screen whenever they dont want to use it.
Although ads are part of Tellys pitch people need to fill out a lengthy survey with more than 100 questions that helps to personalize features and advertising thats not the case for Displace. When asked about whether Displace plans to offer retargeting for advertisers, Krishnan said the company will never sell data because ads arent our thing.
What we are enabling is the advertisers now can actually pay their ads in a way that is interactive and transactional, Krishnan said. Because theyre already playing ads.Like if you look at the Super Bowl ads, theyre millions of dollars worth of ads, but theyre not interactive.
More:
At CES, new AI tools for TVs offer new features for both content and commerce - Digiday
- The people refusing to use AI - BBC - May 5th, 2025 [May 5th, 2025]
- Trump posts AI image of himself as pope, leaving Catholics offended and unamused as conclave nears - CNN - May 5th, 2025 [May 5th, 2025]
- The Deadly AI Slow Roll in SaaS: It May Cost You Everything - SaaStr - May 5th, 2025 [May 5th, 2025]
- President Trump shares AI-generated photo of himself dressed as pope - CBS News - May 5th, 2025 [May 5th, 2025]
- 'They can't take a joke': Trump says he knew 'nothing' about AI image of him as the pope - USA Today - May 5th, 2025 [May 5th, 2025]
- 2 Magnificent Artificial Intelligence (AI) Stocks to Buy in May and 1 to Avoid - The Motley Fool - May 5th, 2025 [May 5th, 2025]
- Catholic community reacts to Trump's AI image of himself as the pope - ABC News - May 5th, 2025 [May 5th, 2025]
- Palantir raises annual revenue forecast on AI demand but investors unimpressed - Reuters - May 5th, 2025 [May 5th, 2025]
- The new IT stack: Rebuilding infrastructure for an AI-first world - cio.com - May 5th, 2025 [May 5th, 2025]
- Function Health acquires Ezra to combine lab testing and AI-powered medical imaging for preventive health - Fierce Healthcare - May 5th, 2025 [May 5th, 2025]
- WATCH: Journalist Kara Swisher on Elon Musk, whats next in tech and AI | 2025 Reframe Festival - PBS - May 5th, 2025 [May 5th, 2025]
- How an AI Star Wars image has backfired on Trump and the White House - Euronews.com - May 5th, 2025 [May 5th, 2025]
- The AI Industry Has a Huge Problem: the Smarter Its AI Gets, the More It's Hallucinating - futurism.com - May 5th, 2025 [May 5th, 2025]
- I have trouble focusing, but this AI browser feature helps - Fast Company - May 5th, 2025 [May 5th, 2025]
- Its Time To Get Concerned As More Companies Replace Workers With AI - Forbes - May 5th, 2025 [May 5th, 2025]
- Anthropic hires a top Biden official to lead its new AI for social good team (exclusive) - Fast Company - May 5th, 2025 [May 5th, 2025]
- Trump defends viral AI picture of him as the pope: Have to have a little fun - New York Post - May 5th, 2025 [May 5th, 2025]
- Anduril is working on the difficult AI-related task of real-time edge computing - TechCrunch - May 5th, 2025 [May 5th, 2025]
- Datadog Acquires Eppo to Expand Its AI, Product Analytics, Experimentation and Feature Flag Capabilities - GlobeNewswire - May 5th, 2025 [May 5th, 2025]
- Tariffs And AI Are Causing Major Shifts In The Ad Tech M&A Landscape - AdExchanger - May 5th, 2025 [May 5th, 2025]
- AI systems are built on English but not the kind most of the world speaks - The Conversation - May 5th, 2025 [May 5th, 2025]
- Man pleads guilty to using malicious AI software to hack Disney employee - Ars Technica - May 5th, 2025 [May 5th, 2025]
- How to Prevent AI Agents From Becoming the Bad Guys - Dark Reading - May 5th, 2025 [May 5th, 2025]
- This is the future of AI, according to Nvidia - Fast Company - May 5th, 2025 [May 5th, 2025]
- Palantir raises annual revenue forecast on booming AI demand - Yahoo Finance - May 5th, 2025 [May 5th, 2025]
- New ways to interact with information in AI Mode - Google Blog - May 5th, 2025 [May 5th, 2025]
- Google Is Adding Gemini AI to Your Kid's Account, but You Can Turn It Off - Lifehacker - May 5th, 2025 [May 5th, 2025]
- SAG-AFTRA Chief Lays Out What AI Protections It Will Be Looking For In Next Studio Contract - Deadline - May 5th, 2025 [May 5th, 2025]
- Johnson Controls rethinks IT for the cloud-native and AI era - cio.com - May 5th, 2025 [May 5th, 2025]
- AI bots are filling users with conspiracy theories, repressed memories - New York Post - May 5th, 2025 [May 5th, 2025]
- IBM Is Back. Now It Must Prove Its Mettle in AI. - WSJ - April 25th, 2025 [April 25th, 2025]
- Googles AI Overviews now reach more than 1.5 billion people every month - The Verge - April 25th, 2025 [April 25th, 2025]
- Alphabet rises as AI bets begin to pay off - Reuters - April 25th, 2025 [April 25th, 2025]
- Microsoft made an ad with generative AI and nobody noticed - The Verge - April 25th, 2025 [April 25th, 2025]
- Apple to Strip Secret Robotics Unit From AI Chief Weeks After Moving Siri - Bloomberg.com - April 25th, 2025 [April 25th, 2025]
- State Bar of California admits it used AI to develop exam questions, triggering new furor - Los Angeles Times - April 25th, 2025 [April 25th, 2025]
- Heres How Big the AI Revolution Really Is, in Four Charts - WSJ - April 25th, 2025 [April 25th, 2025]
- Update: Meta AI Begins Roll Out on Ray-Ban Meta Glasses to Even More Countries in the EU - Meta | Social Metaverse Company - April 25th, 2025 [April 25th, 2025]
- Adobe Revolutionizes AI-Assisted Creativity with Firefly, the All-In-One Home for AI Content Creation, with New Partner and Firefly Models - Adobe... - April 25th, 2025 [April 25th, 2025]
- Unveiling GPT-image-1: Rising to new heights with image generation in Azure AI Foundry - Microsoft Azure - April 25th, 2025 [April 25th, 2025]
- AI Is Spreading Old Stereotypes to New Languages and Cultures - WIRED - April 25th, 2025 [April 25th, 2025]
- In the age of AI, we must protect human creativity as a natural resource - Ars Technica - April 25th, 2025 [April 25th, 2025]
- Spotify Expands AI Playlist in Beta to Premium Listeners in 40+ New Markets - Spotify For the Record - April 25th, 2025 [April 25th, 2025]
- Microsoft says everyone will be a boss in the future of AI employees - The Guardian - April 25th, 2025 [April 25th, 2025]
- Student loans are back, US travel is whack, and, AI, please, step back : The Indicator from Planet Money - NPR - April 25th, 2025 [April 25th, 2025]
- How real-world businesses are transforming with AI with 261 new stories - The Official Microsoft Blog - April 25th, 2025 [April 25th, 2025]
- This Texas mom made $8,000 in 3 weeks training AI at her kitchen table. She says it's 'not easy money.' - Business Insider - April 25th, 2025 [April 25th, 2025]
- Dataminr Announces $100M Investment from Fortress to Accelerate Gen AI and Agentic AI Product Innovation, and to Expand its Reach to Enterprises &... - April 25th, 2025 [April 25th, 2025]
- Pony.ai teams up with Tencent for robotaxi services on WeChat, other apps - CNBC - April 25th, 2025 [April 25th, 2025]
- Alarming rise in AI-powered scams: Microsoft reveals $4 Billion in thwarted fraud - AI News - April 25th, 2025 [April 25th, 2025]
- CalArts, Chanel Launch Center for Artists and Tech With AI Focus - Variety - April 25th, 2025 [April 25th, 2025]
- China isnt trying to win the AI race - Financial Times - April 25th, 2025 [April 25th, 2025]
- WhatsApp defends 'optional' AI tool that cannot be turned off - BBC - April 25th, 2025 [April 25th, 2025]
- Nvidia Thinks It Has a Better Way of Building AI Agents - WSJ - April 25th, 2025 [April 25th, 2025]
- AI was used to write the California bar exam. The law community is outraged. - Mashable - April 25th, 2025 [April 25th, 2025]
- Exclusive: Anthropic warns fully AI employees are a year away - Axios - April 25th, 2025 [April 25th, 2025]
- Should You Forget Nvidia and Buy These 2 Millionaire-Maker AI Stocks Instead? - The Motley Fool - April 25th, 2025 [April 25th, 2025]
- Opinion: Art is a form of communication between human beings. AI wont change that - The Globe and Mail - April 25th, 2025 [April 25th, 2025]
- Adobe Firefly: The next evolution of creative AI is here - Adobe - April 25th, 2025 [April 25th, 2025]
- Adobe to launch mobile app for AI image generation tool as OpenAI steps up rivalry - CNBC - April 25th, 2025 [April 25th, 2025]
- Humanoid workers and surveillance buggies: embodied AI is reshaping daily life in China - The Guardian - April 21st, 2025 [April 21st, 2025]
- TSMC Warns of Limits of Ability to Keep Its AI Chips From China - Bloomberg.com - April 21st, 2025 [April 21st, 2025]
- A customer support AI went rogueand its a warning for every company considering replacing workers with automation - Fortune - April 21st, 2025 [April 21st, 2025]
- Could AI text alerts help save snow leopards from extinction? - BBC - April 21st, 2025 [April 21st, 2025]
- The #1 Skill That Pays More Than Gen AI In 2025 - Forbes - April 21st, 2025 [April 21st, 2025]
- 1 Artificial Intelligence (AI) Stock-Buyback Stock to Buy Hand Over Fist During the Nasdaq Sell-Off - Yahoo Finance - April 21st, 2025 [April 21st, 2025]
- What America Gets Wrong About the AI Race - Foreign Affairs - April 21st, 2025 [April 21st, 2025]
- Use AI as a tool for growth instead of degradation with this strategy. - Psychology Today - April 21st, 2025 [April 21st, 2025]
- Investor Says AI Is Already "Fully Replacing People" - futurism.com - April 21st, 2025 [April 21st, 2025]
- The philosophers machine: my conversation with Peter Singers AI chatbot - The Guardian - April 21st, 2025 [April 21st, 2025]
- With AI slop distorting our reality, the world is sleepwalking into disaster | Nesrine Malik - The Guardian - April 21st, 2025 [April 21st, 2025]
- Viral AI-made art trends are making artists even more worried about their futures - NBC News - April 21st, 2025 [April 21st, 2025]
- OpenAIs o3 AI model scores lower on a benchmark than the company initially implied - TechCrunch - April 21st, 2025 [April 21st, 2025]
- Artists push back against Barbie-like AI dolls with their own creations - BBC - April 21st, 2025 [April 21st, 2025]
- If you use AI to write me that note, dont expect me to read it - Fast Company - April 21st, 2025 [April 21st, 2025]
- Companies can leverage the true value of meetings with AI by building an LLM for Leadership - GeekWire - April 21st, 2025 [April 21st, 2025]
- Using tech, AI to make construction jobs appeal to women - DW - April 21st, 2025 [April 21st, 2025]
- Famed AI researcher launches controversial startup to replace all human workers everywhere - TechCrunch - April 21st, 2025 [April 21st, 2025]
- Impersonal assistant: This vehicle AI drove me to distraction - Detroit Free Press - April 21st, 2025 [April 21st, 2025]
- A 30-year-old AI founder who followed the FIRE movement to build wealth is now the youngest self-made woman billionaire - Fortune - April 21st, 2025 [April 21st, 2025]