2016 Summer Project Week/Auditory Display

• 

  Projects List

Key Investigators

• David Black, University of Bremen, Fraunhofer MEVIS
• Sarah Frisken, BWH/HMS
• Christian Hansen, Uni Magdeburg
• Longquan Chen, BWH/HMS

Related Work

Existing methods for intraoperative navigation guidance already implemented in Puredata, see

• VIDEO: for ureteroscopy, with BWH/HMS and with Slicerdownload link
• VIDEO: for ablation needle insertion, with Univeristy of Magdeburg
• VIDEO: Auditory Display for Liver Resection Paper
• Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
• D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. PDF

Possible application areas / IDEAS

• Acquiring 3D data sets for US, did we acquire all we need?
• Uncertainty in navigation information
• Brain / Structure Shift
• reduce complexity of displays by offloading to audio
• Depth cues for 3D data (shown on 2D screens)

Project Description

Objective

• Explore possibilities of auditory display for intraoperative use
• Find opportunities for extending existing projects with auditory display

Approach, Plan

• Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as PureData, Max, or SuperCollider
• libraries for OpenSoundControl include liblo, PyLiblo

Progress

• Existing methods for intraoperative navigation guidance already implemented in Puredata, see for ureteroscopydownload link, for ablation needle insertion

Code from Jay Jagadeesan for OgenIGTLink, here as zip.

Simplified version from Longquan Chen