Li, Mengxing, Phoebe Zhang, Jiazhou Liu, Agnes Haryanto, Kadek Ananta Satriadi, Trung Nguyen, Deval Mehta, Zerina Lokmic-Tomkins, and Tim Dwyer. 'HandovAR: Towards AR and AI Support for ICU Nurse Handover.' Paper presented at the CHI 2026 Workshop on XR for Challenging Environments: Enabling Human Performance and Agency under Stress, 2026.
HandovAR: Towards AR and AI Support for ICU Nurse Handover
Mengxing Li, Phoebe Zhang, Jiazhou Liu, Agnes Haryanto, Kadek Ananta Satriadi, Trung Nguyen, Deval Mehta, Zerina Lokmic-Tomkins, and Tim Dwyer
CHI 2026 Workshop on XR for Challenging Environments: Enabling Human Performance and Agency under Stress. Barcelona, Spain. 2026. Publication type: workshop-position paper.
Effective nurse handover is crucial in high-pressure environments like Intensive Care Units (ICUs), where accurate communication of patient-specific information directly shapes patient care and clinical decision-making. We conducted seven interviews with ICU nurses to understand current handover practices. Preliminary findings reveal significant challenges, including high cognitive load from fragmented EMR data, the risk of technology hindering interpersonal rapport, and the loss of nuanced data during shift transitions. These issues lead to cognitive overload and information omission, particularly during fast-paced shift transitions when staff fatigue is prevalent. We explore the potential for in-situ Augmented Reality (AR) overlays and Artificial Intelligence (AI) agents to support ICU nurse handover by enabling hands-free information access, procedure guidance and documentation assistance.
Tags: chi,AI,digital health, handover,situated visualization
Related Publications
-
MarioChart: Autonomous Tangibles as Active Proxy Interfaces for Embodied Casual Data Exploration
Shaozhang Dai, Kadek Ananta Satriadi, Jim Smiley, Barrett Ens, Lonni Besançon, Tim Dwyer -
When Temples Travel: Towards Understanding Cultural Impacts of Visualizing Sacred Sites in Foreign Contexts
I. G. M. Darmawiguna, Bernhard Jenny, Kadek Ananta Satriadi, Made Windu Antara Kesiman, Thomas Chandler, Putu Hendra Suputra, and Kadek Teguh Dermawan -
Active Proxy Dashboard: Binding Physical Referents and Abstract Data Representations in Situated Visualization through Tangible Interaction
Kadek Ananta Satriadi, Barrett Ens, Sarah Goodwin, Tim Dwyer -
ProxSituated Visualization: An Extended Model of Situated Visualization using Proxies for Physical Referents
Kadek Ananta Satriadi, Andrew Cunningham, Ross T. Smith, Tim Dwyer, Adam Drogemuller, Bruce H. Thomas -
Anxiety-Free Public Dentistry for Adults With Disabilities by Using Head-Mounted Virtual Reality Technology: Protocol for a Feasibility Mixed Methods Study
Dung T Bui, Fiona McAlinden, Alice Urban, Charmine E J Hartel, Kristian Rotaru, Kadek Ananta Satriadi, Tanner Person, Wei Wang, Libby Callaway -
Strollytelling: Coupling Animation with Physical Locomotion to Explore Immersive Data Stories
Radhika Pankaj Jain, Adam Drogemuller, Kadek Ananta Satriadi, Ross Smith, Andrew Cunningham -
That's Rough! Encoding Data into Roughness for Physicalization
Xiaojiao Du, Kadek Ananta Satriadi, Adam Drogemuller, Brandon Matthews, Ross T. Smith, James Walsh, Andrew Cunningham -
Context-Dependent Memory in Situated Visualization
Kadek Ananta Satriadi, Benjamin Tag, Tim Dwyer -
Defining Embodied Provenance for Immersive Sensemaking
Yidan Zhang, Barrett Ens, Kadek Ananta Satriadi, Ying Yang, Sarah Goodwin -
User-Driven Constraints for Layout Optimisation in Augmented Reality
Aziz Niyazov, Barrett Ens, Kadek Ananta Satriadi, Nicolas Mellado, Loïc Barthe, Tim Dwyer, Marcos Serrano -
Visualization Placement for Outdoor Augmented Data Tours
Zeinab Ghaemi, Kadek Ananta Satriadi, Ulrich Engelke, Barrett Ens, Bernhard Jenny -
Augmented Scale Models: Presenting Multivariate Data Around Physical Scale Models in Augmented Reality
Kadek Ananta Satriadi, Andrew Cunningham, Bruce H. Thomas, Adam Drogemuller, Antoine Odi, Niki Patel, Cathlyn Aston, Ross T. Smith -
Tangible Globes for Data Visualisation in Augmented Reality
Kadek Ananta Satriadi, Jim Smiley, Barrett Ens, Maxime Cordeil, Tobias Czauderna, Benjamin Lee, Ying Yang, Tim Dwyer, Bernhard Jenny -
Quantitative Data Visualisation on Virtual Globes
Kadek Ananta Satriadi, Barrett Ens, Tobias Czauderna, Maxime Cordeil, Bernhard Jenny