AI Outperforms Doctors in Clinical Reasoning Tasks

An advanced artificial intelligence language model has shown superior performance to physicians across a wide range of clinical reasoning and diagnostic tasks. This new research suggests that advanced AI systems may already exceed human clinicians in certain structured decision-making scenarios, including diagnosis and management planning. The study evaluated an advanced large language model, or LLM, against hundreds of physicians at different training levels. The model consistently outperformed human clinicians across diagnostic cases, management scenarios, and emergency department evaluations. For example, in one set of clinical case conferences, the LLM correctly identified the final diagnosis in up to 78% of cases. In real-world emergency department cases, the AI system identified the correct or near-correct diagnosis in up to 81.6% of cases at hospital admission, outperforming physicians at multiple diagnostic stages. This performance gap was most pronounced during early triage, when clinical information is limited and rapid decision-making is critical. The findings suggest that AI systems are increasingly capable of handling complex clinical reasoning tasks that traditionally rely on extensive medical training and experience. This matters because it points to a significant future role for AI in healthcare and clinical decision-making.