Ethics, Æsthetics, Ecology, Education

Story of the Hour

Back to All Events

Google’s healthcare AI made up a body part — what happens when doctors don’t notice?

  • The Oregon Institute for Creative Research 1826 Southeast 35th Avenue Portland, OR, 97214 United States (map)

Image: Cath Virginia / The Verge, Getty Images

Google dubbed an error from its Med-Gemini model a typo. Experts say it demonstrates the risks of AI in medicine.
by Hayden Field | Aug 4, 2025, 7:00 AM PDT

Scenario: A radiologist is looking at your brain scan and flags an abnormality in the basal ganglia. It’s an area of the brain that helps you with motor control, learning, and emotional processing. The name sounds a bit like another part of the brain, the basilar artery, which supplies blood to your brainstem — but the radiologist knows not to confuse them. A stroke or abnormality in one is typically treated in a very different way than in the other.

Now imagine your doctor is using an AI model to do the reading. The model says you have a problem with your “basilar ganglia,” conflating the two names into an area of the brain that does not exist. You’d hope your doctor would catch the mistake and double-check the scan. But there’s a chance they don’t.

Though not in a hospital setting, the “basilar ganglia” is a real error that was served up by Google’s healthcare AI model, Med-Gemini. A 2024 research paper introducing Med-Gemini included the hallucination in a section on head CT scans, and nobody at Google caught it, in either that paper or a blog post announcing it. When Bryan Moore, a board-certified neurologist and researcher with expertise in AI, flagged the mistake, he tells The Verge, the company quietly edited the blog post to fix the error with no public acknowledgement — and the paper remained unchanged. Google calls the incident a simple misspelling of “basal ganglia.” Some medical professionals say it’s a dangerous error and an example of the limitations of healthcare AI.

Med-Gemini is a collection of AI models that can summarize health data, create radiology reports, analyze electronic health records, and more.

Read more here