Difference between revisions of "2016 Summer Project Week/Auditory Display"

From NAMIC Wiki
Jump to: navigation, search
Line 45: Line 45:
 
<h3>Progress</h3>
 
<h3>Progress</h3>
 
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]
 
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]
 +
* Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
 +
* Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
 +
* Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)
  
  

Revision as of 14:00, 24 June 2016

Home < 2016 Summer Project Week < Auditory Display

Key Investigators

  • David Black, University of Bremen, Fraunhofer MEVIS
  • Sarah Frisken, BWH/HMS
  • Christian Hansen, Uni Magdeburg
  • Longquan Chen, BWH/HMS

Related Work

Existing methods for intraoperative navigation guidance already implemented in Puredata, see

Possible application areas / IDEAS

  • Acquiring 3D data sets for US, did we acquire all we need?
  • Uncertainty in navigation information
  • Brain / Structure Shift
  • reduce complexity of displays by offloading to audio
  • Depth cues for 3D data (shown on 2D screens)

Project Description

Objective

  • Explore possibilities of auditory display for intraoperative use
  • Find opportunities for extending existing projects with auditory display

Approach, Plan

  • common sound synthesis software: PureData, Max, or SuperCollider DOWNLOAD PUREDATA EXTENDED>>> here
  • Test program for Puredata to listen for incoming OSC messages: link
  • libraries for OpenSoundControl include C++: liblo, Python: PyLiblo

Progress

  • Existing methods for intraoperative navigation guidance already implemented in Puredata, see for ureteroscopydownload link, for ablation needle insertion
  • Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
  • Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
  • Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)


Code from Jay Jagadeesan for OgenIGTLink, here as zip.

Simplified version from Longquan Chen