Paramedic Papers

Home Cardiac (non-arrest) LLMs unreliable for cath-lab activation ECGs

Cardiac (non-arrest)

LLMs unreliable for cath-lab activation ECGs

Large language models fail to reliably predict emergent catheterization laboratory activation from prehospital electrocardiograms
Heart & Lung · Added 17 September 2026

Retrospective test of three multimodal LLMs against real cardiology cath-lab activation decisions on 615 prehospital ECGs found the best (Gemini, 95.3% sensitivity) had 9.4% specificity, and the standard ECG machine algorithm beat all three LLMs overall — general-purpose LLMs aren't reliable for STEMI pathway activation.

Study type
Other
Design
Retrospective diagnostic accuracy study comparing three multimodal LLMs and ECG machine algorithm against cardiology decisions
Participants
615 prehospital ECGs from 270 EMS encounters
Main finding
Gemini: sensitivity 95.3% but specificity 9.4%; ChatGPT and Claude sensitivity 68.1% and 67.2% with specificity 42.3% and 46.5%; ECG machine algorithm sensitivity 67.7%, specificity 64.2% — outperforming all LLMs overall.
Caveat
Retrospective single reference standard (cardiology activation) and no Australian validation; LLM performance may change with newer models.
Bottom line
Context only

Why it matters in Australia (High relevance). prehospital 12-lead interpretation is core AP scope; a solid caution against using an LLM chatbot as an ECG second opinion.

Learning goal

Weigh the role of emerging decision-support tools against traditional ECG interpretation when activating the catheterisation laboratory.

Open in dashboard Read the paper (DOI) PubMed

More

Related papers on Cardiac (non-arrest)