2016 Summer Project Week/AR with a tablet device in the surgical room
Contents
Key Investigators
- David García-Mato (Universidad Carlos III de Madrid, Spain)
- Javier Pascau (Universidad Carlos III de Madrid, Spain)
- Mónica García-Sevilla (Universidad Carlos III de Madrid, Spain)
- Simon Drouin (Montreal Neurological Institute, Canada)
Gallery
Navigation
System Diagram
Slicer Module
New System Diagram
Background
The navigation information during image-guided surgeries is usually displayed in external screens which force surgeons to switch views between the surgical field and the screen during surgery. Augmented reality (AR) technology has been applied to surgeries in order to improve the navigation workflow. However, the existing AR systems are really complex and expensive, and they present important drawbacks. A new AR navigation system based on a movable tablet display and a multi-camera optical tracking system has been implemented using Slicer. Firstly, the movable tablet device allows to show the navigation information within the actual surgical field, thanks to a wireless connection with the computer. Moreover, another available functionality of this system is the possibility of showing the anatomical structures of interest from the tablet viewpoint, as looking through a window into the internal anatomy of the patient.
Project Description
Objectives
- To combine tablet camera view with Slicer virtual models.
- To include guidelets.
- Improvement of existing Slicer module.
Approach, Plan
- Tablet-based AR Navigation System using a tablet movable display and a multi-camera optical tracking system.
- Steps:
- Generation of virtual anatomical models from preoperative image.
- Registration between virtual and real space.
- Tablet viewpoint calibration.
- Navigation
Progress
- Basic Slicer module already implemented.
- Able to receive tablet camera images in Slicer using PLUS.
- Calibration procedure based on chessboard.
- Able to improve slicer module visualization using Slicelets.
