Holomedicine VSI - Virtual Surgery Intelligence

VSI HoloMedicine® is a medical imaging software device for display of medical images and allowing the visualization of 3D imaging holograms reconstructed from scanned images from different modalities including CT, MRI, CBCT, PET CT, and SPECT CT. VSI system is the combination of VSI HoloMedicine® Microsoft HoloLens application and VSI Manager System (running on Azure cloud). This system combination of head mounted augmented reality display and VSI HoloMedicine® allows the users to visualize and interact with medical images and/or 3D imaging holograms with gesture methods such as hold gesture and air tap gesture.

VSI HoloMedicine® utilizes the augmented reality technology along with Microsoft HoloLens 2 that enables the user to visualize 3D imaging holograms for pre-operative planning, as well as patient education, and medical teaching outside and/or inside the surgical room. This methodology allows the user to see both the patient and through them, with dynamic holograms of the patient’s internal anatomy. Some of VSI HoloMedicine® tools/features include:

• 3D volume visibility, interaction and adjustment: Ability to view 3D models on HoloLens. Brightness, contrast, opacity, and threshold can be adjusted. Ability to cut through 3D volume renderings of DICOM images to display the internal anatomical structures. Ability to interact with the displayed 3D volume renderings, 3D models, and 2D pictures/videos, including dragging, scaling and rotation.
• Pre-operative planning tools: Ability to define the color, thickness and style of 3D drawings. Ability to place and remove pre-defined 3D shapes (torus, arrow) in the 3D space on HoloLens
• 2D review tools: dragging, scaling and rotation
• Documentation tools: Ability to create and view documentation on the HoloLens device, including pictures, videos, and speech to text notes.

The device takes pre-acquired 2D medical images and reconstructs 3D models that users can then view on a stereoscopic, holographic display.