Another Side of the A.I. Boom: Detecting What A.I. Makes – The New York Times
Andrey Doronichev was alarmed last year when he saw a video on social media that appeared to show the president of Ukraine surrendering to Russia.
The video was quickly debunked as a synthetically generated deepfake, but to Mr. Doronichev, it was a worrying portent. This year, his fears crept closer to reality, as companies began competing to enhance and release artificial intelligence technology despite the havoc it could cause.
Generative A.I. is now available to anyone, and its increasingly capable of fooling people with text, audio, images and videos that seem to be conceived and captured by humans. The risk of societal gullibility has set off concerns about disinformation, job loss, discrimination, privacy and broad dystopia.
For entrepreneurs like Mr. Doronichev, it has also become a business opportunity. More than a dozen companies now offer tools to identify whether something was made with artificial intelligence, with names like Sensity AI (deepfake detection), Fictitious.AI (plagiarism detection) and Originality.AI (also plagiarism).
Mr. Doronichev, a Russian native, founded a company in San Francisco, Optic, to help identify synthetic or spoofed material to be, in his words, an airport X-ray machine for digital content.
In March, it unveiled a website where users can check images to see if they were made by actual photographs or artificial intelligence. It is working on other services to verify video and audio.
Content authenticity is going to become a major problem for society as a whole, said Mr. Doronichev, who was an investor for a face-swapping app called Reface. Were entering the age of cheap fakes. Since it doesnt cost much to produce fake content, he said, it can be done at scale.
The overall generative A.I. market is expected to exceed $109 billion by 2030, growing 35.6 percent a year on average until then, according to the market research firm Grand View Research. Businesses focused on detecting the technology are a growing part of the industry.
Months after being created by a Princeton University student, GPTZero claims that more than a million people have used its program to suss out computer-generated text. Reality Defender was one of 414 companies chosen from 17,000 applications to be funded by the start-up accelerator Y Combinator this winter.
Copyleaks raised $7.75 million last year in part to expand its anti-plagiarism services for schools and universities to detect artificial intelligence in students work. Sentinel, whose founders specialized in cybersecurity and information warfare for the British Royal Navy and the North Atlantic Treaty Organization, closed a $1.5 million seed round in 2020 that was backed in part by one of Skypes founding engineers to help protect democracies against deepfakes and other malicious synthetic media.
Major tech companies are also involved: Intels FakeCatcher claims to be able to identify deepfake videos with 96 percent accuracy, in part by analyzing pixels for subtle signs of blood flow in human faces.
Within the federal government, the Defense Advanced Research Projects Agency plans to spend nearly $30 million this year to run Semantic Forensics, a program that develops algorithms to automatically detect deepfakes and determine whether they are malicious.
Even OpenAI, which turbocharged the A.I. boom when it released its ChatGPT tool late last year, is working on detection services. The company, based in San Francisco, debuted a free tool in January to help distinguish between text composed by a human and text written by artificial intelligence.
OpenAI stressed that while the tool was an improvement on past iterations, it was still not fully reliable. The tool correctly identified 26 percent of artificially generated text but falsely flagged 9 percent of text from humans as computer generated.
The OpenAI tool is burdened with common flaws in detection programs: It struggles with short texts and writing that is not in English. In educational settings, plagiarism-detection tools such as TurnItIn have been accused of inaccurately classifying essays written by students as being generated by chatbots.
Detection tools inherently lag behind the generative technology they are trying to detect. By the time a defense system is able to recognize the work of a new chatbot or image generator, like Google Bard or Midjourney, developers are already coming up with a new iteration that can evade that defense. The situation has been described as an arms race or a virus-antivirus relationship where one begets the other, over and over.
When Midjourney releases Midjourney 5, my starter gun goes off, and I start working to catch up and while Im doing that, theyre working on Midjourney 6, said Hany Farid, a professor of computer science at the University of California, Berkeley, who specializes in digital forensics and is also involved in the A.I. detection industry. Its an inherently adversarial game where as I work on the detector, somebody is building a better mousetrap, a better synthesizer.
Despite the constant catch-up, many companies have seen demand for A.I. detection from schools and educators, said Joshua Tucker, a professor of politics at New York University and a co-director of its Center for Social Media and Politics. He questioned whether a similar market would emerge ahead of the 2024 election.
Will we see a sort of parallel wing of these companies developing to help protect political candidates so they can know when theyre being sort of targeted by these kinds of things, he said.
Experts said that synthetically generated video was still fairly clunky and easy to identify, but that audio cloning and image-crafting were both highly advanced. Separating real from fake will require digital forensics tactics such as reverse image searches and IP address tracking.
Available detection programs are being tested with examples that are very different than going into the wild, where images that have been making the rounds and have gotten modified and cropped and downsized and transcoded and annotated and God knows what else has happened to them, Mr. Farid said.
That laundering of content makes this a hard task, he added.
The Content Authenticity Initiative, a consortium of 1,000 companies and organizations, is one group trying to make generative technology obvious from the outset. (Its led by Adobe, with members such as The New York Times and artificial intelligence players like Stability A.I.) Rather than piece together the origin of an image or a video later in its life cycle, the group is trying to establish standards that will apply traceable credentials to digital work upon creation.
Adobe said last week that its generative technology Firefly would be integrated into Google Bard, where it will attach nutrition labels to the content it produces, including the date an image was made and the digital tools used to create it.
Jeff Sakasegawa, the trust and safety architect at Persona, a company that helps verify consumer identity, said the challenges raised by artificial intelligence had only begun.
The wave is building momentum, he said. Its heading toward the shore. I dont think its crashed yet.
See the rest here:
Another Side of the A.I. Boom: Detecting What A.I. Makes - The New York Times
- Commentary: Campaigns spent millions on AI in election advertising but was it effective? - Times of San Diego - November 21st, 2026 [November 21st, 2026]
- Goldman Sachs admits the 'AI unwind' has spiraled into something more dangerous and it's watching for 3 signs of bottom - Fortune - November 21st, 2026 [November 21st, 2026]
- Nations at UN talks on AI killer robots agree to more talks but no firm commitment to rein them in - NPR - November 21st, 2026 [November 21st, 2026]
- I was shaking, crying, having trouble breathing: the uncharted trauma of breaking up with AI companions - The Guardian - November 21st, 2026 [November 21st, 2026]
- The doom of humanity: will the quest to make robotic hands render us obsolete? | AI (artificial intelligence) - The Guardian - November 21st, 2026 [November 21st, 2026]
- Here are the top AI agents that can live in your text messages - TechCrunch - November 21st, 2026 [November 21st, 2026]
- Column | Before you use AI to hunt Black Friday deals, keep 5 things in mind - The Washington Post - November 21st, 2026 [November 21st, 2026]
- The AI bust is a growing threat to China's economy and a 'moment of real danger' for President Xi Jinping, analyst warns - Fortune - November 21st, 2026 [November 21st, 2026]
- The AI Skills Gap Is Becoming A Crisis Of Workforce Confidence - Forbes - November 21st, 2026 [November 21st, 2026]
- Attackers' AI Agents Found a Zero-Day in Medical-Imaging Software and Gained Root Access - The Hacker News - November 21st, 2026 [November 21st, 2026]
- Sovereign AI factory in Germany wins startups with no lock-in - SiliconANGLE - November 21st, 2026 [November 21st, 2026]
- AI may have solved the most important problem in mathematics - The Economist - November 21st, 2026 [November 21st, 2026]
- Is selling an AI version of your face to this microdrama startup the future of Hollywood? - TechCrunch - November 21st, 2026 [November 21st, 2026]
- 'This seems like an extreme privacy violation.' Surprising messages from the Muse AI agent are unnerving Meta's own employees, report says - Fortune - November 21st, 2026 [November 21st, 2026]
- "In the future, everyone's a builder." The massive AI experiment playing out in video games - Axios - November 21st, 2026 [November 21st, 2026]
- Using AI, mathematician claims to have solved one of maths great mysteries - The Washington Post - November 21st, 2026 [November 21st, 2026]
- Google told schools to accept AI or lose Search. Now 3 of Americas 4 largest districts are pushing back - Fortune - November 21st, 2026 [November 21st, 2026]
- Signal Blocks AI Agents From Reading Private Chats via Screenshots on Android and iOS - The Hacker News - November 21st, 2026 [November 21st, 2026]
- "Psychologically, it is a mountain to climb." How AI fixes the fear of fundraising. - Axios - November 21st, 2026 [November 21st, 2026]
- CrowdStrikes Talks with Zscaler Show AI-Led Cyber Consolidation - Bloomberg.com - November 21st, 2026 [November 21st, 2026]
- Can teams of AI agents recreate the chain reaction of human decisions? - Tech Xplore - November 21st, 2026 [November 21st, 2026]
- Apple may be developing its own AI agent that runs your Mac - TechCrunch - November 21st, 2026 [November 21st, 2026]
- Even the fastest AI clusters can be held back by their release pipelines - VentureBeat - November 21st, 2026 [November 21st, 2026]
- If AI Chips Become Commoditized, Nvidia Has the Most to Lose, While These 3 Stocks Are Set to Gain - The Motley Fool - November 21st, 2026 [November 21st, 2026]
- Qwen4 Max is live on Together AI - Together AI - November 21st, 2026 [November 21st, 2026]
- Anthropic researcher says he used AI to solve math's greatest riddle - DW.com - November 21st, 2026 [November 21st, 2026]
- Im opening the cage of a monster: Taxi Driver scriptwriter Paul Schrader on unleashing AI at 80 - The Guardian - November 21st, 2026 [November 21st, 2026]
- Dynatrace just laid out its AI observability playbook at KubeCon. Heres why it matters for developers. - The New Stack - November 21st, 2026 [November 21st, 2026]
- Anthropic worker claims to have solved a Holy Grail of math problems with the help of AI - AP News - November 21st, 2026 [November 21st, 2026]
- AI may eliminate jobs, but todays children can still thrive in an uncertain future - CNN - November 21st, 2026 [November 21st, 2026]
- Taco Bell Put AI in 900 Drive-Thrus Heres What Happened to Sales - Entrepreneur - November 10th, 2026 [November 10th, 2026]
- Oura to acquire AI-native primary care startup Counsel Health for $625M - TechCrunch - November 10th, 2026 [November 10th, 2026]
- The AI Race is Putting Patients at Risk - Progressive.org - November 10th, 2026 [November 10th, 2026]
- Gilbert + Tobin rethinks the business of law with AI - OpenAI - November 10th, 2026 [November 10th, 2026]
- AI Has Entered the Boardroom. Whos Overseeing It? - Stanford Graduate School of Business - November 10th, 2026 [November 10th, 2026]
- AI training startup Mercor valued at $20 billion in latest funding round - Reuters - November 10th, 2026 [November 10th, 2026]
- AI is making it harder to detect fake emergency calls - NPR - November 10th, 2026 [November 10th, 2026]
- Helping caregivers use AI in everyday life - OpenAI - November 10th, 2026 [November 10th, 2026]
- Ohio State and Microsoft announced a five-year partnership, expanding AI use in health care - The Lantern - November 10th, 2026 [November 10th, 2026]
- Nvidia CEO Jensen Huang might hang on as CEO. But his influence on U.S. AI policy is over - Fortune - November 10th, 2026 [November 10th, 2026]
- The Honeypot That Might End the AI Boom - The American Prospect - November 10th, 2026 [November 10th, 2026]
- US and China should stay clear-eyed on AI cooperation and competition, Bessent says - Reuters - November 10th, 2026 [November 10th, 2026]
- AI agents are here to help with your online shopping (where they're allowed) - Marketplace.org - November 10th, 2026 [November 10th, 2026]
- Adobe brings AI agents and new creative tools to Photoshop, Premiere, and Firefly - TechCrunch - November 10th, 2026 [November 10th, 2026]
- Spotifys AI DJ gets new voices, personalities, and an option for less chatter - TechCrunch - November 10th, 2026 [November 10th, 2026]
- CoreWeave beats on revenue and lifts guidance, easing AI slowdown concerns - CNBC - November 10th, 2026 [November 10th, 2026]
- Company says engineer stole secrets, asked AI how to get away with it - Reuters - November 10th, 2026 [November 10th, 2026]
- A single AI model simulates the behavior of many substances, from sliding sand to folding proteins - MIT News - November 10th, 2026 [November 10th, 2026]
- OpenAI, Anthropic face new oversight as New Yorks AI safety law takes effect - TechCrunch - November 10th, 2026 [November 10th, 2026]
- AI is becoming an information gateway. Audiences still dont want it making their news. - Nieman Journalism Lab - November 10th, 2026 [November 10th, 2026]
- Bloomington, Indiana, Bans Superintelligent AI, Hoping 350 Other Cities Will Follow - Reason Magazine - November 10th, 2026 [November 10th, 2026]
- Air Force previews AI training as it prepares to deploy new tools - Federal News Network - November 10th, 2026 [November 10th, 2026]
- PSI is trying to make a business out of AI-driven scientific discovery - TechCrunch - November 10th, 2026 [November 10th, 2026]
- Oura to acquire AI virtual primary care partner Counsel Health for $625M - Fierce Healthcare - November 10th, 2026 [November 10th, 2026]
- Teaching Warriors to Think With AI: The Classroom as the First Line of Cognitive Defense - Defense.info - November 10th, 2026 [November 10th, 2026]
- Nvidia-Backed Cohere in a Fight to Secure AI Computing Power - Bloomberg.com - November 10th, 2026 [November 10th, 2026]
- To save Australias economy, Albanese must share the AI gains and budget pains - Politico - November 10th, 2026 [November 10th, 2026]
- Google broadens its AI hardware portfolio with two new specialized chips - TechCrunch - November 10th, 2026 [November 10th, 2026]
- Beyond OpenAI and Anthropic: Where iCapital sees the next wave of AI winners - CNBC - November 10th, 2026 [November 10th, 2026]
- Trust beyond face-to-face contact: AI and the future of finance - CEPR - November 10th, 2026 [November 10th, 2026]
- Pimco Offloads Billions in AI Debt Just in Time to Skirt Losses - Bloomberg.com - October 28th, 2026 [October 28th, 2026]
- As AI agents reshape the web, Google opens Gemini and Search to more apps - TechCrunch - October 28th, 2026 [October 28th, 2026]
- How teachers are remaking classrooms for the AI age - Reuters - October 28th, 2026 [October 28th, 2026]
- The New York Times is adding more AI features to its Cooking app, and users arent thrilled - Nieman Lab - October 28th, 2026 [October 28th, 2026]
- CSN lands nearly $3M federal grant to expand AI, tech training - FOX5 Vegas - October 28th, 2026 [October 28th, 2026]
- I Tested Every Major AI Agent for a Day. Heres the Best One - WIRED - October 28th, 2026 [October 28th, 2026]
- Meet the Baby Boomer whose life changed when 2 Gen Z AI founders walked into her plumbing business. She became their first COO - Fortune - October 28th, 2026 [October 28th, 2026]
- AI governance starts with your data: Building the evidence the EU AI Act and new US rules expect - IAPP - October 28th, 2026 [October 28th, 2026]
- Chromes AI-powered Autofill can now dig through your Gmail to fill out forms - TechCrunch - October 28th, 2026 [October 28th, 2026]
- F5 stock suffers worst day in more than a decade as AI spending shakes investors - GeekWire - October 28th, 2026 [October 28th, 2026]
- AI tools show promise in hospitals, but experts say integration is key - Association of Health Care Journalists - October 28th, 2026 [October 28th, 2026]
- A new physics-informed AI tool aims to predict wildfire spread in real time and assist wildfire response - Phys.org - October 28th, 2026 [October 28th, 2026]
- AI's Financial Reality Check: Are The Billions Paying Off? - Forbes - October 28th, 2026 [October 28th, 2026]
- How federal agencies are adapting to AI hardware acceleration - FedScoop - October 28th, 2026 [October 28th, 2026]
- OSF Keynote: Human Connection in AI Health Care - OSF HealthCare - October 28th, 2026 [October 28th, 2026]
- Your AI Rollout May Be Moving Too Fast for Employees. It Could Cost You $25.5 Million - Inc.com - October 28th, 2026 [October 28th, 2026]
- AI Boom Drives a Jump in Lending, but Bankers Still Sound Cautious - WSJ - October 28th, 2026 [October 28th, 2026]
- New York adopts law restricting harmful AI chatbot features that target children - Syracuse.com - October 28th, 2026 [October 28th, 2026]
- AI filters may be screening out your resume. Heres how to help. - Mirror Indy - October 28th, 2026 [October 28th, 2026]
- In China, the AI bubble has already burst - Reuters - October 28th, 2026 [October 28th, 2026]