arbiter
JournalsPricingAccount

Situation Awareness Assessment for Anesthesia Residents (SAAAR): Development and Preliminary Evaluation of a Multimodal System

Carolina Daza-Beltrán et al.

Human Factors2026https://doi.org/10.1177/00187208251413484article
AJG 3
Weight
0.50

What the paper says

ObjectiveThis study reports the development and preliminary evaluation of SAAAR, a multimodal system designed to assess and support the development of situation awareness (SA).BackgroundSA is critical in anesthesiology, yet existing assessment methods lack standardized tools tailored to its complexities of anesthetic practice. Systems developed in other domains have limited applicability, highlighting the need for a purpose-built approach for anesthesia residents.MethodThe SAAAR comprises two components: a 16-item behavioral marker scale and a structured debriefing with eye-tracking. Thirteen anesthesiology faculty tested interrater and test-retest reliability, while five experts conducted content validation of the scale. Both components were implemented in a simulation-based training program for preliminary system evaluation.ResultsThe behavioral marker scale demonstrated moderate content validity and high reliability. Internal consistency was strong (McDonald's Ω = 0.928), test-retest reliability high (Spearman's ρ = 0.952), and interrater agreement moderate (Kendall's W = 0.412). Faculty reported the scale to be clear, comprehensive, and easy to use. Pilot implementation showed significant improvements across domains (Wilcoxon signed-rank test), indicating the system's potential to provide targeted feedback and guide educational interventions.ConclusionsGrounded in HFE principles, the SAAAR provides a structured approach to assessing SA in anesthesia residents and demonstrates preliminary potential to inform educational strategies. Further research is required to determine its impact on clinical performance.ApplicationThe SAAAR offers residency programs and human factors experts a practical tool for assessing SA and designing targeted training. Its adaptable framework suggests potential applicability in other high-pressure medical contexts, pending further evaluation.

Open paper page →

Cite this paper

https://doi.org/https://doi.org/10.1177/00187208251413484

Or copy a formatted citation

@article{carolina2026,
  title        = {{Situation Awareness Assessment for Anesthesia Residents (SAAAR): Development and Preliminary Evaluation of a Multimodal System}},
  author       = {Carolina Daza-Beltrán et al.},
  journal      = {Human Factors},
  year         = {2026},
  doi          = {https://doi.org/https://doi.org/10.1177/00187208251413484},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Situation Awareness Assessment for Anesthesia Residents (SAAAR): Development and Preliminary Evaluation of a Multimodal System

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.50

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.50 × 0.4 = 0.20
M · momentum0.50 × 0.15 = 0.07
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.