Skip to main navigation Skip to search Skip to main content

Artificial intelligence echocardiographic interpretation in the emergency department: agreement, interpretation yield and reporting scope

  • Vijay Manivel
  • , Michael Hession
  • , Behzad Mirmiran
  • , Patrick Feeny
  • , Nadi Pandithage
  • , Nasim Erfani
  • , Riaz Humayun
  • , Steven Beatty
  • Nepean Hospital
  • The University of Sydney
  • Blacktown Hospital
  • Royal Adelaide Hospital
  • Royal Darwin Hospital

Research output: Contribution to journal › Article › peer-review

1 Downloads (Pure)

Abstract

Objective: To assess the agreement between artificial intelligence (AI) interpretation and expert emergency physician sonologist review of echocardiograms performed in the Emergency Department (ED). Methods: Retrospective multicentre agreement study in four Australian EDs. A total of 195 echocardiograms (2016–2023) underwent three-stage adjudicated human expert review. Human reports were compared with us2.ai reports. Agreement across 10 validated parameters was reported as percentage exact match with 95% confidence intervals and kappa under two pre-specified tiers: Guideline Compliant (GC; ASE/EACVI multi-view criteria) and Pragmatic (PR; any available measurement). Reference standard reliability was quantified. Results: Pooled agreement was 76% at both tiers (GC n = 875; PR n = 1323); AI returned an interpretation in 46% of evaluations at GC and 70% at PR. Four structural parameters reached 78%–87%: right atrial size 87% (κ = 0.62), right ventricular (RV) contractility 83% (κ = 0.42), left ventricular (LV) size 83% (κ = 0.52) and RV size 78% (κ = 0.37). Binary LV systolic agreement was 79% GC and 83% PR. Expert reviewers agreed on 85% of interpretations. Pericardial effusion, aortic regurgitation and mitral stenosis, present in 7%–20% of patients, are not reported in the current us2.ai algorithm. Conclusion: AI agreed with expert review in about three-quarters of evaluations but provided a guideline-compliant interpretation in less than half; a pragmatic approach raised yield to 70% at the same agreement. The AI withheld classifications that experts could reach; its validated scope covers only part of what ED echocardiography must address, and reports did not mark unassessed parameters. This study reports agreement, not accuracy. For now, human expert review of AI reports is required.

Original languageEnglish
Article numbere70364
Number of pages13
JournalEMA - Emergency Medicine Australasia
Volume38
Issue number5
DOIs
Publication statusPublished - Oct 2026

Keywords

  • artificial intelligence
  • echocardiography
  • emergency medicine
  • point-of-care ultrasound

Fingerprint

Dive into the research topics of 'Artificial intelligence echocardiographic interpretation in the emergency department: agreement, interpretation yield and reporting scope'. Together they form a unique fingerprint.

Cite this