AI makes retinal imaging 100 times faster, compared to manual method – National Institutes of Health (NIH) (.gov)
News Release
Wednesday, April 10, 2024
NIH scientists use artificial intelligence called P-GAN to improve next-generation imaging of cells in the back of the eye.
Researchers at the National Institutes of Health applied artificial intelligence (AI) to a technique that produces high-resolution images of cells in the eye. They report that with AI, imaging is 100 times faster and improves image contrast 3.5-fold. The advance, they say, will provide researchers with a better tool to evaluate age-related macular degeneration (AMD) and other retinal diseases.
Artificial intelligence helps overcome a key limitation of imaging cells in the retina, which is time, said Johnny Tam, Ph.D., who leads the Clinical and Translational Imaging Section at NIH's National Eye Institute.
Tam is developing a technology called adaptive optics (AO) to improve imaging devices based on optical coherence tomography (OCT). Like ultrasound, OCT is noninvasive, quick, painless, and standard equipment in most eye clinics.
Adaptive optics takes OCT-based imaging to the next level, said Tam. Its like moving from a balcony seat to a front row seat to image the retina. With AO, we can reveal 3D retinal structures at cellular-scale resolution, enabling us to zoom in on very early signs of
While adding AO to OCT provides a much better view of cells, processing AO-OCT images after theyve been captured takes much longer than OCT without AO.
Tams latest work targets the retinal pigment epithelium (RPE), a layer of tissue behind the light-sensing retina that supports the metabolically active retinal neurons, including the photoreceptors. The retina lines the back of the eye and captures, processes, and converts the light that enters the front of the eye into signals that it then transmits through the optic nerve to the brain. Scientists are interested in the RPE because many diseases of the retina occur when the RPE breaks down.
Imaging RPE cells with AO-OCT comes with new challenges, including a phenomenon called speckle. Speckle interferes with AO-OCT the way clouds interfere with aerial photography. At any given moment, parts of the image may be obscured. Managing speckle is somewhat similar to managing cloud cover. Researchers repeatedly image cells over a long period of time. As time passes, the speckle shifts, which allows different parts of the cells to become visible. The scientists then undertake the laborious and time-consuming task of piecing together many images to create an image of the RPE cells that's speckle-free.
Tam and his team developed a novel AI-based method called parallel discriminator generative adversarialnetwork (P-GAN)a deep learning algorithm. By feeding the P-GAN network nearly 6,000 manually analyzed AO-OCT-acquired images of human RPE, each paired with its corresponding speckled original, the team trained the network to identify and recover speckle-obscured cellular features.
When tested on new images, P-GAN successfully de-speckled the RPE images, recovering cellular details. With one image capture, it generated results comparable to the manual method, which required the acquisition and averaging of 120 images. With a variety of objective performance metrics that assess things like cell shape and structure, P-GAN outperformed other AI techniques. Vineeta Das, Ph.D., a postdoctoral fellow in the Clinical and Translational Imaging Section at NEI, estimates that P-GAN reduced imaging acquisition and processing time by about 100-fold. P-GAN also yielded greater contrast, about 3.5 greater than before.
By integrating AI with AO-OCT, Tam believes that a major obstacle for routine clinical imaging using AO-OCT has been overcome, especially for diseases that affect the RPE, which has traditionally been difficult to image.
Our results suggest that AI can fundamentally change how images are captured, said Tam. Our P-GAN artificial intelligence will make AO imaging more accessible for routine clinical applications and for studies aimed at understanding the structure, function, and pathophysiology of blinding retinal diseases. Thinking about AI as a part of the overall imaging system, as opposed to a tool that is only applied after images have been captured, is a paradigm shift for the field of AI.
More news from the NEI Clinical and Translational Imaging Section.
This press release describes a basic research finding. Basic research increases our understanding of human behavior and biology, which is foundational to advancing new and better ways to prevent, diagnose, and treat disease. Science is an unpredictable and incremental process each research advance builds on past discoveries, often in unexpected ways. Most clinical advances would not be possible without the knowledge of fundamental basic research. To learn more about basic research, visit https://www.nih.gov/news-events/basic-research-digital-media-kit.
NEIleads the federal governments effortsto eliminate vision loss and improve quality of life through vision researchdriving innovation, fostering collaboration, expanding the vision workforce, and educating the public and key stakeholders.NEI supports basic and clinical science programs to develop sight-saving treatments and to broaden opportunities for people with vision impairment.For more information, visithttps://www.nei.nih.gov.
About the National Institutes of Health (NIH): NIH, the nation's medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information about NIH and its programs, visit http://www.nih.gov.
NIHTurning Discovery Into Health
Vineeta Das, Furu Zhang, Andrew Bower, et al. Revealing speckle obscured living human retinal cells with artificial intelligence assisted adaptive optics optical coherence tomography.Communications Medicine. April 10, 2024,https://doi.org/10.1038/s43856-024-00483-1.
###
Original post:
- The Tragedy of AI Coding - The Atlantic - October 12th, 2026 [October 12th, 2026]
- Exclusive | FTXs Old Bitcoin-Mining Assets Are Now Part of the AI Boom - WSJ - October 12th, 2026 [October 12th, 2026]
- US AI testing agency officials to move to White House, The Information reports - Reuters - October 12th, 2026 [October 12th, 2026]
- Army turning to AI in its fight against biological threats - DefenseScoop - October 12th, 2026 [October 12th, 2026]
- I'm a Working Dad Who Built Over 150 AI Agents to Run My Life - Business Insider - October 12th, 2026 [October 12th, 2026]
- Lee Rainie, director of the Imagining the Digital Future Center, on AI and the future of work - NC Newsline - October 12th, 2026 [October 12th, 2026]
- Elon Musk Hopes His New Factory Will Help AI Supplant Life on Earth - Mother Jones - October 12th, 2026 [October 12th, 2026]
- Anthropic says new safeguards sharply reduce AI distillation attacks - Reuters - October 12th, 2026 [October 12th, 2026]
- COMMENTARY: Wall Streets AI bet is now too big to hit - Reuters - October 12th, 2026 [October 12th, 2026]
- Both Russia and Ukraine are using AI-powered drones on the battlefield - NPR - October 12th, 2026 [October 12th, 2026]
- Will AI make work easier or workers obsolete? A new NC survey looks at what workers think - NC Newsline - October 12th, 2026 [October 12th, 2026]
- Applied Materials Will Double Sales, Not Headcount, Thanks to AI - Bloomberg.com - October 12th, 2026 [October 12th, 2026]
- AI boom bolstered growth in global trade, benefiting China and India, IMF says - Reuters - October 12th, 2026 [October 12th, 2026]
- AI less regulated than milk, Microsoft president says in warning over safety - The Guardian - October 12th, 2026 [October 12th, 2026]
- Alphabet President Ruth Porat on how Google is funding AI to win long term, and the biggest risks ahead - Fortune - October 12th, 2026 [October 12th, 2026]
- These 2 AI Stocks Have Stumbled. Now They May Soar Nearly 75%, According to Wall Street. - Yahoo Finance - October 12th, 2026 [October 12th, 2026]
- AI-Powered Bond Rating Startup Says Open AI Debt Is Junk, Anthropic Is Barely Investment Grade - Forbes - October 12th, 2026 [October 12th, 2026]
- Japan's Omron to buy US industrial PC firm Onlogic for $675 million in physical AI push - Reuters - October 12th, 2026 [October 12th, 2026]
- Reddit and Perplexity AI clash over law firm's role in data-scraping case - Reuters - October 12th, 2026 [October 12th, 2026]
- Dario Strangelove, or: How I Learned to Stop Worrying and Love the AI Bomb - Fortune - October 12th, 2026 [October 12th, 2026]
- Palantir CTO says some AI researchers are taking up smoking because they expect AI to cure cancer - Business Insider - October 12th, 2026 [October 12th, 2026]
- Dell and Intel weigh the costs of enterprise AI scalability - SiliconANGLE - October 12th, 2026 [October 12th, 2026]
- AI minister warns it is 'likely' UK's cyber defences will be breached - BBC - October 12th, 2026 [October 12th, 2026]
- 'Its all just kind of slop': California governors race puts AI campaign ads in the spotlight - ABC10 - October 12th, 2026 [October 12th, 2026]
- David Pocock concerned senior Albanese adviser vetted bipartisan AI letter that was sent to PM - The Guardian - October 12th, 2026 [October 12th, 2026]
- Microsoft president says UK is best placed to drive AI regulation - TechCrunch - October 12th, 2026 [October 12th, 2026]
- Learning to use local AI is exciting, overwhelming, and frustrating - The Verge - October 12th, 2026 [October 12th, 2026]
- Microsoft Now Has 3 Generations of Its Own AI Chips. Nvidia Is Still the Chip Stock to Buy. - Yahoo Finance - October 12th, 2026 [October 12th, 2026]
- As US medical debt grows, AI will be used more to collect it - The Guardian - October 12th, 2026 [October 12th, 2026]
- AI agents are changing what CPU performance means - Arm Newsroom - October 12th, 2026 [October 12th, 2026]
- Nicolas Cage on True Detective, AI and Amazon After Spider-Noir - The Hollywood Reporter - October 10th, 2026 [October 10th, 2026]
- A Timeline of Developments in AI Safety Since the Attack on Hugging Face - U.S. News & World Report - October 10th, 2026 [October 10th, 2026]
- What we learned about Lake Countys AI review of medical 911 calls - Cleveland.com - October 10th, 2026 [October 10th, 2026]
- Palantir CEO says only trade workers or those with neurodivergence will succeed in the AI era - Fortune - October 10th, 2026 [October 10th, 2026]
- Stocks saw new highs and big declines: How the volatile AI trade moved last week's market - CNBC - October 10th, 2026 [October 10th, 2026]
- Using AI for just 10 minutes erodes your ability to persist at hard things - University of California, Berkeley - October 10th, 2026 [October 10th, 2026]
- The case for hardware in the AI era is getting more compelling - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- Jon Davis on job titles in the age of AI cartoon - The Guardian - October 10th, 2026 [October 10th, 2026]
- Anthropic Cuts Live Internet Access for Internal AI Tests After Claude Exploits Injection Flaws - The Hacker News - October 10th, 2026 [October 10th, 2026]
- AI is changing how lawyers work and putting the billable hour under pressure - CNBC - October 10th, 2026 [October 10th, 2026]
- Anthropic can't reliably control its AI agents. It's cutting off its internal evals from the live internet instead - TechCrunch - October 10th, 2026 [October 10th, 2026]
- We must recall open-ended AI agents with internet access from the market, now - Marcus on AI | Substack - October 10th, 2026 [October 10th, 2026]
- Anthropic AI agents took unintended actions on government sites - The Washington Post - October 10th, 2026 [October 10th, 2026]
- AI Is Getting Really Good at Messing With Cybercriminals - WIRED - October 10th, 2026 [October 10th, 2026]
- Microsoft's AI Economics Are Quietly Starting To Change (NASDAQ:MSFT) - Seeking Alpha - October 10th, 2026 [October 10th, 2026]
- The economist behind the China shock says AI is a paradoxical skill-disequalizer for Gen Z workers - Fortune - October 10th, 2026 [October 10th, 2026]
- In The AI Race, Theres No American Victory Without Foreign Workers - Forbes - October 10th, 2026 [October 10th, 2026]
- I used to feel embarrassed about graduating from a trade school. But now my career is safe from AI. - Business Insider - October 10th, 2026 [October 10th, 2026]
- The Third-Party Agent Problem: Why Security Built for AI You Chose Misses the Agents You Didn't - The Hacker News - October 10th, 2026 [October 10th, 2026]
- Heres How 12 Top Colleges Are Preparing Students For The AI Era - Forbes - October 10th, 2026 [October 10th, 2026]
- A timeline of developments in AI safety since the attack on Hugging Face - Bozeman Daily Chronicle - October 10th, 2026 [October 10th, 2026]
- AI photos are making it harder to know what you're booking on Airbnb. Here's what to look out for - CBC - October 10th, 2026 [October 10th, 2026]
- In Silicon Valley, AI founders cheer Trumps calls for the industry to police itself on safety - The Seattle Times - October 10th, 2026 [October 10th, 2026]
- Helping teens learn, plan, and shape the future of AI - OpenAI - October 10th, 2026 [October 10th, 2026]
- Big Tech is betting $700 billion on AI. Healthcare will decide whether the bet pays off - Fortune - October 10th, 2026 [October 10th, 2026]
- Trump says anyone who does not refer to AI as super intelligence is THE ENEMY' - Politico - October 10th, 2026 [October 10th, 2026]
- 3 AI Stocks With Earnings Growth Up To 34% - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- Hollywood takes on Zuckerberg, Musk and Altman amid widespread anxiety over AI - CNBC - October 10th, 2026 [October 10th, 2026]
- A timeline of developments in AI safety since the attack on Hugging Face - The Seattle Times - October 10th, 2026 [October 10th, 2026]
- Diversifying Your Portfolio in the Age of AI Is Tricky. How to Do It. - Barron's - October 10th, 2026 [October 10th, 2026]
- Opinion: Why Nvidias stock is dodging the AI credit scare that is crushing Broadcom and Oracle - MarketWatch - October 10th, 2026 [October 10th, 2026]
- I tried OpenAI's new AI agent at work. Cue the corporate IT headaches. - Business Insider - October 10th, 2026 [October 10th, 2026]
- Broadcoms AI Revenue Is Tripling, but the Stock Has Lagged. Is It Time to Load Up? - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- Like Meta's Muse AI Agents? 4 AI Semiconductor Stocks Set to Benefit From the Rise of AI Agents. - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- Startup claims its AI avatar can pass for human in job-interview with creepy new model - New York Post - October 10th, 2026 [October 10th, 2026]
- A timeline of developments in AI safety since the attack on Hugging Face - CT Insider - October 10th, 2026 [October 10th, 2026]
- A timeline of developments in AI safety since the attack on Hugging Face - chronicleonline.com - October 10th, 2026 [October 10th, 2026]
- Landlords have new worry over bad tenants: AI - The Republic News - October 10th, 2026 [October 10th, 2026]
- A timeline of developments in AI safety since the attack on Hugging Face - Oskaloosa Herald - October 10th, 2026 [October 10th, 2026]
- GE Vernova (GEV) Just Turned AI Data Centers Into A $5 Billion Order Tailwind - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- UK must not be beholden to foreign AI, says head of Alan Turing Institute - The Guardian - October 10th, 2026 [October 10th, 2026]
- The world of one trade AI - Financial Times - October 10th, 2026 [October 10th, 2026]
- GPUs in the Wine Cellar: Why Techies Are Hoarding AI Compute in Their Homes - The Information - October 10th, 2026 [October 10th, 2026]
- Prediction: This Will Be the Next Big AI Gold Rush and This Company Will Be the Winner. - Yahoo Finance - October 10th, 2026 [October 10th, 2026]
- How AI Is Transforming Web Development: Tools, Trends, and Best Practices - SitePoint - October 10th, 2026 [October 10th, 2026]
- McDonald's hit with class action alleging AI-powered menu price-fixing - Reuters - October 6th, 2026 [October 6th, 2026]
- McDonalds Hit With Class Action Alleging AI-Powered Menu Price-Fixing - Wide Open Country - October 6th, 2026 [October 6th, 2026]
- Meta joins with group of companies to tame chaos of doing business with AI bots - CNBC - October 6th, 2026 [October 6th, 2026]
- Pull the plug: protesters resort to direct action against AI firms - The Guardian - October 6th, 2026 [October 6th, 2026]
- Evaluators are supposed to keep AI from killing us all. No pressure - CalMatters - October 6th, 2026 [October 6th, 2026]