Authors:

Robin Strak, Kevin Yu, Frieder Pankratz, Marc Lazarovici, Benedikt Sandmeyer, Julia Reichling, Simon Weidert, Clemens Kraetsch, Barbara Roegele, Nassir Navab, Ulrich Eck, Daniel Roth

Abstract: 

Current teleconsultation solutions for preclinical emergencies can transmit knowledge from a remote expert to a local paramedic using audio and 2D video channels. Such technology lacks precision and efficiency for medical diagnostic tasks, and visual feedback is often missing between participants. We investigate a mixed reality 3D teleconsultation solution for preclinical use, which provides a 3D reconstruction of the local scene to a remote expert, displayed in Virtual Reality. A remote expert can join the local scene virtually as an Augmented Reality avatar. The remote expert can annotate the local scene and guide the local paramedics through the procedure. We explored our system in a user study within a preclinical scenario on a collaborative task of attaching chest lead electrodes of a 12 channel electrocardiogram on a mannequin. We compared the 3D teleconsultation system to a 2D video-mediated teleconsultation via a top-mounted camera. Based on our empirical user study with paramedics with an average of 17 years experience, we observe an improvement in the electrode placement quality using the 3D teleconsultation system. Participants perceived the video-mediated consultation as more usable due to their unfamiliarity with the 3D teleconsultation system. However, participants acknowledge the potential of 3D teleconsultation and believe such a system can significantly improve the preclinical treatment.

News:

We are excited to announce that this work was presented on Tuesday 7th of September at 11:15-11:30 am and received astoundingly positive feedback from the audience. Big thanks for everyone who joined in and supported us!
>> https://muc2021.mensch-und-computer.de/event/mci-se04-mixed-reality/<<

Media: