2016 Summer Project Week/Auditory Display

• 

  Projects List

Key Investigators

• David Black, University of Bremen, Fraunhofer MEVIS
• Sarah Frisken, BWH/HMS
• Christian Hansen, Uni Magdeburg
• Longquan Chen, BWH/HMS
• Tamas Ungi
• Rocio Lopez
• Elvis Chen
• Julian Hettig

Related Work

Existing methods for intraoperative navigation guidance already implemented in Puredata, see

• VIDEO: for ureteroscopy, with BWH/HMS and with Slicerdownload link
• VIDEO: for ablation needle insertion, with Univeristy of Magdeburg
• VIDEO: Auditory Display for Liver Resection Paper
• Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)
• D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. PDF

Possible application areas / IDEAS

• Acquiring 3D data sets for US, did we acquire all we need?
• Uncertainty in navigation information
• Brain / Structure Shift
• reduce complexity of displays by offloading to audio
• Depth cues for 3D data (shown on 2D screens)

Project Description

Objective

• Explore possibilities of auditory display for intraoperative use
• Find opportunities for extending existing projects with auditory display

Approach, Plan

• common sound synthesis software: PureData, Max, or SuperCollider DOWNLOAD PUREDATA EXTENDED>>> here
• Test program for Puredata to listen for incoming OSC messages: link
• libraries for OpenSoundControl include C++: liblo, Python: PyLiblo

Progress

• Existing methods for intraoperative navigation guidance already implemented in Puredata, see for ureteroscopydownload link, for ablation needle insertion
• Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
• Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
• Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)

Code from Jay Jagadeesan for OgenIGTLink, here as zip.

Simplified version from Longquan Chen