tech

Google removes some AI health summaries after investigation finds “dangerous” flaws

AI Overviews provided false liver test information experts called alarming.

Google removes some AI health summaries after investigation finds “dangerous” flaws

TL;DR

  • Google removed certain AI Overviews after a Guardian investigation found them to be inaccurate and potentially dangerous.
  • The AI feature provided misleading health information, including incorrect advice on liver tests and pancreatic cancer.
  • Experts warned that the AI's summaries could lead patients to believe they are healthy when they are not, delaying necessary medical care.
  • A design flaw where AI Overviews summarize top web results, even if those results are SEO-gamed or contain errors, is identified as a cause of inaccuracies.
  • Despite removals for some queries, other potentially harmful AI Overviews remain accessible.
  • This is not the first controversy for AI Overviews, which has previously provided nonsensical advice.