EAU 2019: Holographic Surgical Planning of Partial Nephrectomy Using a Wearable Mixed Reality Computer

Barcelona, Spain (UroToday.com) Mixed reality is an emerging technology that overlays virtual objects anchored to the physical environment, and it can be a new tool for medical image data visualization that facilitates the anatomic understanding of surgeons.

Dr. Yoshida with colleagues analyzed the utility of mixed reality for surgical planning of partial nephrectomy.

Preoperative dynamic contrast-enhanced CT images of patients with renal tumors were acquired and reconstructed at a 0.3-mm slice interval, including arterial, venous, and excretory phases. Dr. Yoshida with colleagues developed full-scale 3D computational graphic kidney models using HoloEyes XR software. Surgical teams discussed procedural planning for a partial nephrectomy based on the information conveyed through the 3D holographic mixed reality models using HoloLens. After surgery, participants completed an anonymous questionnaire assessing the usefulness of holographic surgical planning.

In this proof of concept study, Dr. Yoshida and colleagues used mixed reality models for partial nephrectomy planning were enrolled in this study and completed the questionnaire. All participants reported that, for partial nephrectomy, holographic surgical planning using HoloLens headsets contributed to an excellent or good improvement of intra-operative spatial awareness, and 7 (88%) reported an excellent or good contribution for a better understanding of the surgical anatomy around the tumor. All participants reported that the Xbox controller was useful to translate or rotate MR models, while the gesture-controlled manipulation by the hands was expected to be useful in a sterilized environment.

Dr. Yoshida demonstrated, that holographic surgical planning using a wearable mixed reality computer facilitates surgical awareness during partial nephrectomy. This new technology has the potential to enhance surgical decision-making in a variety of procedures.

Presented by Soichiro Yoshida, MD, PhD, Tokyo Medical and Dental University, Dept. of Urology, Tokyo, Japan

Written by: Olesya Snurnitsyna, MD, Fellow, Department of Urology and Reproductive Health Sechenov University, Moscow, Russia at the 34th European Association of Urology (EAU 2019) #EAU19 conference in Barcelona, Spain, March 15-19, 2019.