Artificial intelligence versus physician decision-making in acute heart failure: a comparative evaluation of four contemporary AI systems
European Heart Journal - Digital Health

Abstract
Large language models (LLMs) are increasingly used by the public and healthcare professionals for clinical reasoning. However, they were developed as general-purpose language models rather than dedicated clinical decision-support tools, and their performance in real-world acute heart failure (AHF) management remains insufficiently evaluated. We compared four contemporary AI models with physician decision-making.
This single-centre retrospective observational study incorporated a cross-sectional AI evaluation of consecutive patients treated at Sotiria General Hospital between July and November 2025, excluding acute coronary syndrome. ChatGPT, ChatGPT Plus, DeepSeek, and an ESC guideline-based retrieval-augmented generation (RAG) model independently assessed identical standardized cases. Recommendations were compared with physician decisions on diagnosis, treatment, guideline-directed medical therapy, timing, and prognosis using Cohen’s kappa, McNemar’s test, Cochran’s
Contemporary AI models show promise in AHF decision support but substantial task-specific variability, supporting use as complements rather than replacements for physician judgement.
Contributors

Iason- Daniil Zakynthinos
Author

George Dimeas
Author

Theodore G Papaioannou
Author

Gerasimos Siasos
Author
You may be interested in





