Difference between revisions of "2016 Summer Project Week/Auditory Display"
From NAMIC Wiki
Line 55: | Line 55: | ||
− | [[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.] | + | *[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.] |
− | Only for Linux and Mac system, as the "lo" library has some build issue with visual studio. For windows user, it is recommended to use the python version of lo [http://das.nasophon.de/pyliblo/ Python library for lo] | + | *Only for Linux and Mac system, as the "lo" library has some build issue with visual studio. For windows user, it is recommended to use the python version of lo [http://das.nasophon.de/pyliblo/ Python library for lo] |
− | [http://www.na-mic.org/Wiki/index.php/File:AudioSimulator.zip | + | *[http://www.na-mic.org/Wiki/index.php/File:AudioSimulator.zip A small lo simulator from Longquan Chen] |
+ | ** This simulator use the lo library, sends note to the local/remote server running PD-Extended | ||
</div> | </div> | ||
</div> | </div> |
Revision as of 09:54, 27 June 2016
Home < 2016 Summer Project Week < Auditory DisplayKey Investigators
- David Black, University of Bremen, Fraunhofer MEVIS
- Sarah Frisken, BWH/HMS
- Christian Hansen, Uni Magdeburg
- Longquan Chen, BWH/HMS
- Tamas Ungi
- Rocio Lopez
- Elvis Chen
- Julian Hettig
Related Work
Existing methods for intraoperative navigation guidance already implemented in Puredata, see
- VIDEO: for ureteroscopy, with BWH/HMS and with Slicerdownload link
- VIDEO: for ablation needle insertion, with Univeristy of Magdeburg
- VIDEO: Auditory Display for Liver Resection Paper
- Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)
- D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. PDF
Possible application areas / IDEAS
- Acquiring 3D data sets for US, did we acquire all we need?
- Uncertainty in navigation information
- Brain / Structure Shift
- reduce complexity of displays by offloading to audio
- Depth cues for 3D data (shown on 2D screens)
- coverage of needle in US
Project Description
Objective
- Explore possibilities of auditory display for intraoperative use
- Find opportunities for extending existing projects with auditory display
Approach, Plan
Progress
- Existing methods for intraoperative navigation guidance already implemented in Puredata, see for ureteroscopydownload link, for ablation needle insertion
- Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
- Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
- Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)
- Code from Jay Jagadeesan for OgenIGTLink, here as zip.
- Only for Linux and Mac system, as the "lo" library has some build issue with visual studio. For windows user, it is recommended to use the python version of lo Python library for lo
- A small lo simulator from Longquan Chen
- This simulator use the lo library, sends note to the local/remote server running PD-Extended