Li, M., Zhang, P., Liu, J., Haryanto, A., Satriadi, K. A., Nguyen, T., ... & Dwyer, T. (2026). HandovAR: Towards AR and AI Support for ICU Nurse Handover.
Mengxing Li, Phoebe Zhang, Jiazhou Liu, Agnes Haryanto, Kadek Ananta Satriadi, Trung Nguyen, Deval Mehta, Zerina Lokmic-Tomkins, and Tim Dwyer
CHI 2026 Workshop on XR for Challenging Environments: Enabling Human Performance and Agency under Stress. Barcelona, Spain. 2026. Publication type: workshop-position paper.
Effective nurse handover is crucial in high-pressure environments like Intensive Care Units (ICUs), where accurate communication of patient-specific information directly shapes patient care and clinical decision-making. We conducted seven interviews with ICU nurses to understand current handover practices. Preliminary findings reveal significant challenges, including high cognitive load from fragmented EMR data, the risk of technology hindering interpersonal rapport, and the loss of nuanced data during shift transitions. These issues lead to cognitive overload and information omission, particularly during fast-paced shift transitions when staff fatigue is prevalent. We explore the potential for in-situ Augmented Reality (AR) overlays and Artificial Intelligence (AI) agents to support ICU nurse handover by enabling hands-free information access, procedure guidance and documentation assistance.
Preprint: download
Tags: chi,AI,digital health, handover,situated visualization
MarioChart: Autonomous Tangibles as Active Proxy Interfaces for Embodied Casual Data Exploration
When Temples Travel: Towards Understanding Cultural Impacts of Visualizing Sacred Sites in Foreign Contexts
Active Proxy Dashboard: Binding Physical Referents and Abstract Data Representations in Situated Visualization through Tangible Interaction
ProxSituated Visualization: An Extended Model of Situated Visualization using Proxies for Physical Referents
In-Situ Gaussian Splatting-generated 3D Thermal Mesh Visualization for Urban Trees in Augmented Reality
Anxiety-Free Public Dentistry for Adults With Disabilities by Using Head-Mounted Virtual Reality Technology: Protocol for a Feasibility Mixed Methods Study
Strollytelling: Coupling Animation with Physical Locomotion to Explore Immersive Data Stories
That's Rough! Encoding Data into Roughness for Physicalization
Context-Dependent Memory in Situated Visualization
Defining Embodied Provenance for Immersive Sensemaking
User-Driven Constraints for Layout Optimisation in Augmented Reality
Visualization Placement for Outdoor Augmented Data Tours
Augmented Scale Models: Presenting Multivariate Data Around Physical Scale Models in Augmented Reality
Tangible Globes for Data Visualisation in Augmented Reality
Quantitative Data Visualisation on Virtual Globes