Can medical AI lie? Large study maps how LLMs handle health misinformation

medicalxpress - Medical artificial intelligence (AI) is often described as a way to make patient care safer by helping clinicians manage information. A new study by the Icahn School of Medicine at Mount Sinai and collaborators confronts a critical vulnerability: when a m…

AI Summary: A broad analysis — including Mount Sinai research — shows large language models and medical AI systems can propagate false or misleading health claims when presented in realistic clinical language. Findings expose safety gaps, underline risks of unchecked deployment, and call for tighter guardrails, validation and clinician oversight before clinical use.