NAMIC Wiki - User contributions [en]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T13:23:37Z

Dblack:

__TOC__
Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://perk.cs.queensu.ca/users/lasso Andras Lasso] (PerkLab, Queen's)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)

|


# Connected Slicer to OSC: added SlicerSoundControl extension (https://github.com/SlicerIGT/SlicerSoundControl), see below for necessary OSC message names
# Tested avoidance warning with experimental integration into breast lumpectomy navigation module (LumpNav): https://youtu.be/gSz8IHmogMo
# tried using gestures to zoom windows in and out

|}

==Previous Work==
Demo Videos
* ablation needle or general tool placement, with U. Magdeburg and U. Hannover, [https://www.dropbox.com/s/35xzp51tk0rui6x/Singing.m4v?dl=0 “singing" method] and [https://www.dropbox.com/s/05et9abov10yvmk/AblationDemoVideo1.m4v?dl=0 synthetic sounds]
* [https://www.dropbox.com/s/ullaaab4gp9pucq/BWH_Dual-frequency-feedback.mp4?dl=0 ureteroscopy], with Harvard Surgical Planning Lab
* [https://www.dropbox.com/s/cdfc77ugjgg8o96/LIM%20Short.mp4?dl=0 sacral neuromodulation], with University Carlos III Madrid
* [https://www.dropbox.com/s/bn0u0g22yu14uvt/AD%20Resection%20short.m4v?dl=0 resection guidance], with Robert Bosch Hospital Stuttgart ([https://www.youtube.com/watch?v=gCg5nJSI2pY longer version with explanation])

In addition, please see the following articles:
* [https://link.springer.com/article/10.1007/s11548-017-1537-1 Auditory feedback to support image-guided medical needle placement]
* [https://link.springer.com/article/10.1007/s11548-017-1547-z A Survey of auditory display in image-guided interventions]
* [https://www.researchgate.net/publication/233791033_Auditory_support_for_resection_guidance_in_navigated_liver_surgery Auditory support for resection guidance in navigated liver surgery.]

==Illustrations==

{| class="wikitable"
! style="text-align: left; width:50%" | [[image:OpenSoundControl.png|400px]] OpenSoundControl module for configuring and testing OpenSoundControl server communication
! style="text-align: left; width:50%" | [[image:SoundNavigation.png|400px]] SoundNavigation module for automatically generating OpenSoundControl messages for tool navigation, from tool and reference transform nodes
|- style="vertical-align:top;"
|}

<embedvideo service="youtube">https://youtu.be/gSz8IHmogMo</embedvideo>

==SlicerSoundControl==
see https://github.com/SlicerIGT/SlicerSoundControl

=== Environment for Testing Slicer Sound Control ===

OSC Message names:

Base name: /SoundNav/Instrument/

Translation: each fro 0 to 100 mm
* /TranslationX
* /TranslationY
* /TranslationZ
* /Distance (absolute distance)

Translation: each from 0 to 180 degrees
* /OrientationX
* /OrientationY
* /OrientationZ
* /Orientation (overall orientation)

GUI for test:
[[File:OSCTest GUI.png|500px|frameless|OSCTest GUI]]

=== Environment for Sterile Gestures (planned, not yet implemented) ===
* In/ out
** --> "/InOut 0" out
** --> "/InOut 1" in
* Edge distance (0 to 3 cm?)
** --> "/EdgeDist x" where x is float between 0 and 3

=== Ambient ===
* Overall acceleration
** --> "/OverallAccel x" where x is float between 0 and 1
* Background noise
* Absolute position (x/y, not depth) to show current selected window
** --> "/AbsPolX x" where x is float between 0 and 1
** --> "/AbsPolY x" where x is float between 0 and 1

=== Gestures ===
* select image
** --> "/SelectGesture x" where x is gesture number
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T12:07:06Z

Dblack: /* Environment for Testing Slicer Sound Control */

__TOC__
Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://perk.cs.queensu.ca/users/lasso Andras Lasso] (PerkLab, Queen's)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)

|


# Connected Slicer to OSC: added SlicerSoundControl extension (https://github.com/SlicerIGT/SlicerSoundControl), see below for necessary OSC message names
# Tested avoidance warning with experimental integration into breast lumpectomy navigation module (LumpNav): https://youtu.be/gSz8IHmogMo
# tried using gestures to zoom windows in and out

|}

==SlicerSoundControl==
see https://github.com/SlicerIGT/SlicerSoundControl

=== Environment for Testing Slicer Sound Control ===

OSC Message names:

Base name: /SoundNav/Instrument/

Translation: each fro 0 to 100 mm
* /TranslationX
* /TranslationY
* /TranslationZ
* /Distance (absolute distance)

Translation: each from 0 to 180 degrees
* /OrientationX
* /OrientationY
* /OrientationZ
* /Orientation (overall orientation)

GUI for test:
[[File:OSCTest GUI.png|500px|frameless|OSCTest GUI]]

=== Environment for Sterile Gestures (planned, not yet implemented) ===
* In/ out
** --> "/InOut 0" out
** --> "/InOut 1" in
* Edge distance (0 to 3 cm?)
** --> "/EdgeDist x" where x is float between 0 and 3

=== Ambient ===
* Overall acceleration
** --> "/OverallAccel x" where x is float between 0 and 1
* Background noise
* Absolute position (x/y, not depth) to show current selected window
** --> "/AbsPolX x" where x is float between 0 and 1
** --> "/AbsPolY x" where x is float between 0 and 1

=== Gestures ===
* select image
** --> "/SelectGesture x" where x is gesture number
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

File:OSCTest GUI.png

2017-06-30T12:06:23Z

Dblack:

OSCTest GUI

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T12:04:54Z

Dblack: /* Project Description */

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T12:04:07Z

Dblack: /* Environment for Testing Slicer Sound Control */

__TOC__
Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://perk.cs.queensu.ca/users/lasso Andras Lasso] (PerkLab, Queen's)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


# Connected Slicer to OSC: added SlicerSoundControl extension (https://github.com/SlicerIGT/SlicerSoundControl)
# Tested avoidance warning with experimental integration into breast lumpectomy navigation module (LumpNav): https://youtu.be/gSz8IHmogMo
# tried using gestures to zoom windows in and out

|}

==SlicerSoundControl==
see https://github.com/SlicerIGT/SlicerSoundControl

=== Environment for Testing Slicer Sound Control ===

OSC Message names:

Base name: /SoundNav/Instrument/

Translation: each fro 0 to 100 mm
* /TranslationX
* /TranslationY
* /TranslationZ
* /Distance (absolute distance)

Translation: each from 0 to 180 degrees
* /OrientationX
* /OrientationY
* /OrientationZ
* /Orientation (overall orientation)

=== Environment for Sterile Gestures (planned, not yet implemented) ===
* In/ out
** --> "/InOut 0" out
** --> "/InOut 1" in
* Edge distance (0 to 3 cm?)
** --> "/EdgeDist x" where x is float between 0 and 3

=== Ambient ===
* Overall acceleration
** --> "/OverallAccel x" where x is float between 0 and 1
* Background noise
* Absolute position (x/y, not depth) to show current selected window
** --> "/AbsPolX x" where x is float between 0 and 1
** --> "/AbsPolY x" where x is float between 0 and 1

=== Gestures ===
* select image
** --> "/SelectGesture x" where x is gesture number
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T12:03:58Z

Dblack: /* Environment for Testing Slicer Sound Control */

__TOC__
Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://perk.cs.queensu.ca/users/lasso Andras Lasso] (PerkLab, Queen's)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


# Connected Slicer to OSC: added SlicerSoundControl extension (https://github.com/SlicerIGT/SlicerSoundControl)
# Tested avoidance warning with experimental integration into breast lumpectomy navigation module (LumpNav): https://youtu.be/gSz8IHmogMo
# tried using gestures to zoom windows in and out

|}

==SlicerSoundControl==
see https://github.com/SlicerIGT/SlicerSoundControl

=== Environment for Testing Slicer Sound Control ===

OSC Message names:

Base name: /SoundNav/Instrument/

Translation: each fro 0 to 100 mm
* /TranslationX
* /TranslationY
* /TranslationZ
* /Distance (absolute distance)

Translation: each from 0 to 180 degrees
* /OrientationX
* /OrientationY
* /OrientationZ
* /Orientation (overall orientation)
*

=== Environment for Sterile Gestures (planned, not yet implemented) ===
* In/ out
** --> "/InOut 0" out
** --> "/InOut 1" in
* Edge distance (0 to 3 cm?)
** --> "/EdgeDist x" where x is float between 0 and 3

=== Ambient ===
* Overall acceleration
** --> "/OverallAccel x" where x is float between 0 and 1
* Background noise
* Absolute position (x/y, not depth) to show current selected window
** --> "/AbsPolX x" where x is float between 0 and 1
** --> "/AbsPolY x" where x is float between 0 and 1

=== Gestures ===
* select image
** --> "/SelectGesture x" where x is gesture number
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T12:03:40Z

Dblack:

__TOC__
Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://perk.cs.queensu.ca/users/lasso Andras Lasso] (PerkLab, Queen's)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


# Connected Slicer to OSC: added SlicerSoundControl extension (https://github.com/SlicerIGT/SlicerSoundControl)
# Tested avoidance warning with experimental integration into breast lumpectomy navigation module (LumpNav): https://youtu.be/gSz8IHmogMo
# tried using gestures to zoom windows in and out

|}

==SlicerSoundControl==
see https://github.com/SlicerIGT/SlicerSoundControl

=== Environment for Testing Slicer Sound Control ===

OSC Message names:

Base name: /SoundNav/Instrument/

Translation: each fro 0 to 100 mm
/TranslationX
/TranslationY
/TranslationZ
/Distance (absolute distance)

Translation: each from 0 to 180 degrees
/OrientationX
/OrientationY
/OrientationZ
/Orientation (overall orientation)

=== Environment for Sterile Gestures (planned, not yet implemented) ===
* In/ out
** --> "/InOut 0" out
** --> "/InOut 1" in
* Edge distance (0 to 3 cm?)
** --> "/EdgeDist x" where x is float between 0 and 3

=== Ambient ===
* Overall acceleration
** --> "/OverallAccel x" where x is float between 0 and 1
* Background noise
* Absolute position (x/y, not depth) to show current selected window
** --> "/AbsPolX x" where x is float between 0 and 1
** --> "/AbsPolY x" where x is float between 0 and 1

=== Gestures ===
* select image
** --> "/SelectGesture x" where x is gesture number
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T10:22:30Z

Dblack: /* Project Description */

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-30T08:30:11Z

Dblack: /* Necessary Parameters */

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-28T10:58:10Z

Dblack: /* Necessary Parameters */

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-28T10:54:22Z

Dblack:

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-28T10:53:49Z

Dblack: /* Necessary Parameters */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


|}

==Necessary Parameters==

=== Environment ===
* In/ out
* Edge distance (0 to 3 cm?)

=== Ambient ===
* Overall acceleration
* Background noise
* Absolute position (x/y, not depth) to show current selected window

=== Gestures ===
* select image
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-28T10:53:08Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] ("Magna Graecia" University - ASL Vercelli, Italy)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


|}

==Necessary Parameters==

# Environment
* In/ out
* Edge distance (0 to 3 cm?)

# Ambient
* Overall acceleration
* Background noise
* Absolute position (x/y, not depth) to show current selected window

# Gestures
* select image
* zoom to left window
* zoom to right window
* put back into small viewer

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T15:35:11Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]
##Here is a test patch for incoming messages, also makes sound. Need to [https://puredata.info/downloads/pd-extended download PD-Extended] to use this.

|


|}

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

File:OSC Test Input.pd.zip

2017-06-26T15:33:32Z

Dblack: Dblack uploaded a new version of File:OSC Test Input.pd.zip

Test input for USC using Puredata

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T10:20:50Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]

|


|}

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|500px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T10:17:24Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]

|


|}

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|400px|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T10:15:52Z

Dblack: /* Background */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]

|


|}

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T10:15:38Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]

|


|}

==Background==
[[File:Screen Shot 2017-06-26 at 12.14.57.png|thumb|example HCI with freehand gestures for sound]]


Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

File:Screen Shot 2017-06-26 at 12.14.57.png

2017-06-26T10:15:26Z

Dblack:

example HCI with freehand gesture

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-26T09:55:07Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Julian Hettig] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Benjamin Hatscher] (University of Magdeburg, Germany)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Human-Computer Interaction under Sterile Conditions.
* Review of state of the art (tochless interaction)
* Development of new user interfaces to support surgical interterventions

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory/visual feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods
## foot/eye interaction (?)
# [[File:OSC Test Input.pd.zip|thumb|Test incoming OSC messages using PureData]]

|


|}

==Background==

Example of previous related work using standard surgical gloves and OR compatible plastic draping confirmed to be compatible with sterile requirements at BWH AMIGO:
]
<embedvideo service="youtube">https://www.youtube.com/watch?v=zSqO2pUEodw</embedvideo>

== References==

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_IJCARS_MewesHensenWackerHansen.pdf Mewes et al. (2017) Touchless Interaction with Software in Interventional Radiology and Surgery: A Systematic Literature Review]

[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Hettig_JCARS.pdf Hettig et al. (2017) Comparison of Gesture and Conventional Interaction Techniques for Interventional Neuroradiology]

File:OSC Test Input.pd.zip

2017-06-26T09:54:26Z

Dblack:

Test input for USC using Puredata

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-12T14:25:00Z

Dblack: /* Project Description */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*Simon Drouin (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[https://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*Christian Hansen (Universität Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|

|

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-12T14:23:37Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*Christian Hansen (Universität Magdeburg, Germany)
*Julian Hettig (Universität Magdeburg, Germany)
*Benjamin Hatscher (Universität Magdeburg, Germany)
*[https://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*Marco Nolden (DKFZ, Germany)
*Juan Ruiz Alzola (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

Human-Computer Interaction under Sterile Conditions.
* Use with glove
* drapable display

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods

|


|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-12T14:23:20Z

Dblack: /* Key Investigators */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*Simon Drouin (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[https://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*Christian Hansen (Universität Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

|

|

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-11T16:41:03Z

Dblack: Created page with "__NOTOC__ Back to Projects List ==Key Investigators==  *Simon Drouin (NeuroImaging and Surgical Technolo..."

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*Simon Drouin (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*David Black (Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*Christian Hansen (Universität Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

|

|

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25

2017-06-11T16:39:56Z

Dblack: /* Projects */

__NOTOC__
Back to [[Events]]

A summary of all past [[Project_Events#Past_Project_Weeks|Project Events]].

[[image:PW25.png|300px]] [[image:IEL_logo.png|225px]]
<br>

=Welcome to the web page for the 25th Project Week!=
It is a pleasure to announce that the 25th Project week will be held in [https://goo.gl/maps/b9CpkFxNyWN2 Catanzaro Lido] (Calabria, Italy) on June 26-30, 2017. This is the first time in Italy for the Slicer Community, and the event is organized in cooperation with [http://www.imagenglab.com ImagEngLab]. Catanzaro Lido is a city on the Ionian Sea, in the middle of Squillace Gulf where, according to the ancient legend, Odysseus started his journey back to Ithaca. Of course bring your swimsuit...the conference room and the hotel are 20 meters far away from the beach!

This project week is an event [[Post-NCBC-2014|endorsed]] by the MICCAI society.

Please make sure that you are on the NA-MIC Project Week [http://public.kitware.com/mailman/listinfo/na-mic-project-week mailing list].

===Local Organizing Committee===
*[http://www.imagenglab.com/newsite/mf_spadea/ Maria Francesca Spadea, PhD]
*[http://www.imagenglab.com/newsite/paolo_zaffino/ Paolo Zaffino, PhD].

==Videoconferences for preparation==
Time: Wednesday 9am EDT (GMT -4), April 15 to June 21, 2017
URL: [https://zoom.us/j/879371330 click here] to join the videoconference (zoom is the tool as of May 31)

#(Tina Kapur) Hangout #1: April 5 ([[PW25 Hangouts Notes|Notes]])
#(Steve Pieper) Hangout #2: April 12: Web browser based computing: Dockerized Slicer with remote computing and GPU computing; Cornerstone/LesionTracker OHIF; XTK->AMI (threejs); ePad; vtk.js; QWebEngine;
#(Andras Lasso) Hangout #3: April 19: Connecting devices such as surgical navigation, ultrasound, 3D Slicer, PLUS, OpenIGTLink, Augmented reality;
#(Tina Kapur) Hangout #4: April 26: Deep Learning for Detection of Cancer and Instruments;
#(Simon Drouin) Hangout #5: May 3: Volume Rendering, Augmented Reality, and Virtual Reality. [https://docs.google.com/document/d/1UwdSzjnDm1yEeQ44OEhXWbH6V83Uo1Cd4KngxoyrRdI/edit Notes];
#(Tina Kapur) Hangout #6: May 10: For new participants: What is project week and how to get the most out of participating in it?
#(Andrey Fedorov) Hangout #7: May 17:DICOM for Quantitative Imaging and integration with processing applications. ([http://bit.ly/2017NSPW-DICOM notes])
#(Tina Kapur) Hangout #8: May 24:Discussion of Projects and teams that have been provided on the wiki page by participants, internationalization strategy for Slicer.
#(Francesca Spadea) Hangout #9: May 31: Review of local logistics -- all registered attendees should join
#(Tina Kapur) Hangout #10: June 7: Discussion of Projects, Project Pages
#(TBD) Hangout #11: June 14: Review of Project Pages
#(Francesca Spadea) Hangout #12: June 21: Review of local logistics -- all registered attendees with questions should join

==Logistics==
*'''Dates:''' June 26-30, 2017. Consider staying for one more day (leaving Sunday morning), as a day off in a gorgeous sea place is planned on July 1st. More details in the calendar below.
*'''Location:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]
**[mailto:prenotazioni@hotelperladelporto.it Booking]. Subject line: "Slicer Summer Project Week 2017".
***Special rates are:
****Single room, full bed, 79 € per night (1 person)
****Single room, queen bed 89 € per night (1 person)
****Double room, queen bed 99 € per night (2 people)
****Triple room, 110 € (3 people)
*'''Registration:''' To register please visit this [http://www.imagenglab.com/newsite/project-week page]
*'''Registration Fee:''' 320€ and it includes lunches, coffee breaks and airport connections
*'''Hotel:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]. The closest airport is [http://www.lameziaairport.it/english/ Lamezia Terme Airport (IATA: SUF)].
*'''Transportation from Airport to Hotel:''' Your registration fee includes ground transportation [https://www.google.com/maps/dir/Lamezia+Terme+International+Airport,+Via+Aeroporto,+88046+Lamezia+Terme+CZ,+Italy/BEST+WESTERN+PLUS+Hotel+Perla+Del+Porto,+Via+Martiri+di+Cefalonia,+64,+88100+Catanzaro,+Italy/@38.868758,16.1564814,10z/data=!3m1!4b1!4m14!4m13!1m5!1m1!1s0x133fe15a3cbed47f:0x544ab120c3de78a6!2m2!1d16.2434017!2d38.9065845!1m5!1m1!1s0x134003d668252a13:0x2989caf676f45a72!2m2!1d16.6312407!2d38.827712!3e0 to/from the hotel and airport].
** Please fill out this [https://goo.gl/forms/7vmhxZSHy8Z1A62z2 form] to request transportation
*'''Local points of interest (pubs, restaurants, bar):''' [https://www.google.com/maps/d/viewer?mid=1FU63ik9Do3zzP6K2kvLVTtM2at8&ll=38.86221979925013%2C16.44292274999998&z=12 map] (constantly updated)

==Calendar==
{{#widget:Google Calendar
|id=kitware.com_sb07i171olac9aavh46ir495c4@group.calendar.google.com
|timezone=America/New_York&dates=20170108%2F20170114
|title=NA-MIC Project Week (Timezone is Italy / GMT+02.)
|view=WEEK
|dates=20170626/20170701
}}

iCal (.ics) link: https://calendar.google.com/calendar/ical/kitware.com_sb07i171olac9aavh46ir495c4%40group.calendar.google.com/public/basic.ics

=Projects=

<big>Please duplicate [https://na-mic.org/wiki/Project_Week_Template this template] to create a page for your project. </big>

Please put a brief preliminary title for your project here with some names in parenthesis for potential team members

#[[Project_Week_25/NeedleSegmentation | Needle Segmentation]]
#[[Project_Week_25/Human-Computer_Interaction_under_sterile_conditions |Human-Computer Interaction under Sterile Conditions]]
# [[Project_Week_25/Next_Generation_GPU_Volume_Rendering | Next Generation of Volume Rendering in VTK ]]
# [[Project_Week_25/Tracked-Ultrasound-Standardization-IV | Tracked Ultrasound Standardization IV: Controlling US Acquisition]]
#[[Project_Week_25/Intra-operative deformable_registration_based_on_dense_point_cloud_reconstruction |Intra-operative Deformable Registration Based on Dense Point Cloud Reconstruction]]
#[[Project_Week_25/Segmentation for improving image registration of preoperative MRI with intraoperative ultrasound images for neuro-navigation |Segmentation for Improving Image Registration of Preoperative MRI with Intraoperative Ultrasound Images for Neuro-navigation]]
#[[Project_Week_25/Deep_Learning_Data_augmentation_for_prostate_segmentation | Deep Learning: Data Augmentation for Prostate Segmentation]]
#DICOM Segmentation Support for Cornerstone / OHIF Viewer (Erik Ziegler, Steve Pieper, Marco Nolden, Tina Kapur)
#[[Project_Week_25/Conversion of DICOM Single Frame MR to Enhanced Multiframe | Conversion of DICOM Single Frame MR to Enhanced Multiframe]]
#[[Project_Week_25/Development_and_Evaluation_of_New_AR_Visualization_Techniques_to_Support_Radiological_Interventions | Development and Evaluation of New AR Visualization Techniques to Support Radiological Interventions]]
#[[Project_Week_25/Interactive_Manipulation_of_Plots_and_Graphs | Interactive Manipulation of Plots and Graphs]]
#Steerable Catheters Path Planner Extension for Brain Surgery Applications (Alberto Favaro, Marlene Pinzi)
#[[Project_Week_25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification | Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification]] (Simon Drouin, Christian Hansen, David Black)
#DICOM for Quantitative Imaging and Integration with Processing Applications (Jasmin Metzger, Marco Nolden, Steve Pieper)
#CNN for PseudoCT Generation from T1/T2 MRI (Giampaolo Pileggi, Paolo Zaffino, Salvatore Scaramuzzino, Maria Francesca Spadea, Gino Gulamhussene, Anneke Meyer)
#Internationalizing Slicer Modules (Juan Ruiz Alzola)
#Interfacing Slicer to Mobile Phone-controlled Sensors (Juan Ruiz Alzola)
#Slicer and 3D Printing (Juan Ruiz Alzola, Mike Halle, Christian Hansen)
#Slicer Export to VR (Juan Ruiz Alzola, Mike Halle)
#2D Slice to 3D Volume Registration to Support Radiologic Interventions (Gino Gulamhussene)
#[[Project_Week_25/SALT_Spatiotemporal_Modeling: | Slicer SALT Validation: Spatiotemporal Modeling of Subcortical Structures ]]
#[[Project_Week_25/Wrist_Kinematics: | Kinematic Analysis of the Wrist from Dynamic MRI]]

=Registrants=

Do not add your name to this list - it is maintained by the organizers based on your paid registration. To register, visit this [http://www.imagenglab.com/newsite/project-week/ registration site].

# Kikinis, Ron :: Brigham and Women's Hospital, Harvard Medical School, USA
# Pieper, Steve :: Isomics, Inc., USA
# Kapur, Tina :: Brigham and Women's Hospital, Harvard Medical School, USA
# Spadea, Maria Francesca :: Magna Graecia University, Italy
# Zaffino, Paolo :: Magna Graecia University, Italy
# Scaramuzzino, Salvatore :: Magna Graecia University/ASL Vercelli, Italy
# Pileggi, Giampaolo :: Magna Graecia University, Italy/DKFZ, Germany
# Rackerseder, Julia :: Technische Universität München, Germany
# Pinter, Csaba :: Queen's University, Canada
# Kraß, Scheherazade :: University of Bremen, Germany
# Gerig, Guido :: NYU Tandon School of Engineering, USA
# Punzo, Davide :: Kapteyn Astronomical Institute, University of Groningen, The Nederlands
# Drouin, Simon :: NeuroImaging and Surgical Technologies (NIST) Lab, Canada
# Lasso, Andras :: School of Computing, Queen's University, Canada
# Favaro, Alberto :: Politecnico di Milano, Italy
# Leger, Etienne :: Concordia University, Canada
# Ziegler, Erik :: Ziegler Consult SAS
# Onken, Michael :: Open Connections GmbH, Germany
# Pinzi, Marlene :: Imperial College, UK
# Nitsch, Jennifer :: University Of Bremen, Germany
# Moccia, Sara :: Politecnico di Milano, Italy
# Black, David :: Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany
# Penzkofer, Tobias :: Charité Universitätsmedizin, Berlin, Germany
# Hansen, Christian :: Universität Magdeburg, Germany
# Vegard Solberg, Ole :: Norway
# Heinrich, Florian :: Universität Magdeburg, Germany
# Mewes, André :: Universität Magdeburg, Germany
# Hatscher, Benjamin :: Universität Magdeburg, Germany
# Hettig, Julian :: Universität Magdeburg, Germany
# Meyer, Anneke :: Universität Magdeburg, Germany
# Gulamhussene, Gino :: Universität Magdeburg, Germany
# Cassetta, Roberto :: Politecnico di Milano, Italy
# Fillion-Robin, Jean-Christophe :: Kitware, USA
# Metzger, Jasmin :: DKFZ, Germany
# Fishbaugh, James :: NYU Tandon School of Engineering, USA
# Nolden, Marco :: DKFZ, Germany
# Jorge Quintero Nehrkorn :: Canary Islands, Spain

Project Week 25

2017-06-11T16:39:27Z

Dblack: /* Projects */

__NOTOC__
Back to [[Events]]

A summary of all past [[Project_Events#Past_Project_Weeks|Project Events]].

[[image:PW25.png|300px]] [[image:IEL_logo.png|225px]]
<br>

=Welcome to the web page for the 25th Project Week!=
It is a pleasure to announce that the 25th Project week will be held in [https://goo.gl/maps/b9CpkFxNyWN2 Catanzaro Lido] (Calabria, Italy) on June 26-30, 2017. This is the first time in Italy for the Slicer Community, and the event is organized in cooperation with [http://www.imagenglab.com ImagEngLab]. Catanzaro Lido is a city on the Ionian Sea, in the middle of Squillace Gulf where, according to the ancient legend, Odysseus started his journey back to Ithaca. Of course bring your swimsuit...the conference room and the hotel are 20 meters far away from the beach!

This project week is an event [[Post-NCBC-2014|endorsed]] by the MICCAI society.

Please make sure that you are on the NA-MIC Project Week [http://public.kitware.com/mailman/listinfo/na-mic-project-week mailing list].

===Local Organizing Committee===
*[http://www.imagenglab.com/newsite/mf_spadea/ Maria Francesca Spadea, PhD]
*[http://www.imagenglab.com/newsite/paolo_zaffino/ Paolo Zaffino, PhD].

==Videoconferences for preparation==
Time: Wednesday 9am EDT (GMT -4), April 15 to June 21, 2017
URL: [https://zoom.us/j/879371330 click here] to join the videoconference (zoom is the tool as of May 31)

#(Tina Kapur) Hangout #1: April 5 ([[PW25 Hangouts Notes|Notes]])
#(Steve Pieper) Hangout #2: April 12: Web browser based computing: Dockerized Slicer with remote computing and GPU computing; Cornerstone/LesionTracker OHIF; XTK->AMI (threejs); ePad; vtk.js; QWebEngine;
#(Andras Lasso) Hangout #3: April 19: Connecting devices such as surgical navigation, ultrasound, 3D Slicer, PLUS, OpenIGTLink, Augmented reality;
#(Tina Kapur) Hangout #4: April 26: Deep Learning for Detection of Cancer and Instruments;
#(Simon Drouin) Hangout #5: May 3: Volume Rendering, Augmented Reality, and Virtual Reality. [https://docs.google.com/document/d/1UwdSzjnDm1yEeQ44OEhXWbH6V83Uo1Cd4KngxoyrRdI/edit Notes];
#(Tina Kapur) Hangout #6: May 10: For new participants: What is project week and how to get the most out of participating in it?
#(Andrey Fedorov) Hangout #7: May 17:DICOM for Quantitative Imaging and integration with processing applications. ([http://bit.ly/2017NSPW-DICOM notes])
#(Tina Kapur) Hangout #8: May 24:Discussion of Projects and teams that have been provided on the wiki page by participants, internationalization strategy for Slicer.
#(Francesca Spadea) Hangout #9: May 31: Review of local logistics -- all registered attendees should join
#(Tina Kapur) Hangout #10: June 7: Discussion of Projects, Project Pages
#(TBD) Hangout #11: June 14: Review of Project Pages
#(Francesca Spadea) Hangout #12: June 21: Review of local logistics -- all registered attendees with questions should join

==Logistics==
*'''Dates:''' June 26-30, 2017. Consider staying for one more day (leaving Sunday morning), as a day off in a gorgeous sea place is planned on July 1st. More details in the calendar below.
*'''Location:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]
**[mailto:prenotazioni@hotelperladelporto.it Booking]. Subject line: "Slicer Summer Project Week 2017".
***Special rates are:
****Single room, full bed, 79 € per night (1 person)
****Single room, queen bed 89 € per night (1 person)
****Double room, queen bed 99 € per night (2 people)
****Triple room, 110 € (3 people)
*'''Registration:''' To register please visit this [http://www.imagenglab.com/newsite/project-week page]
*'''Registration Fee:''' 320€ and it includes lunches, coffee breaks and airport connections
*'''Hotel:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]. The closest airport is [http://www.lameziaairport.it/english/ Lamezia Terme Airport (IATA: SUF)].
*'''Transportation from Airport to Hotel:''' Your registration fee includes ground transportation [https://www.google.com/maps/dir/Lamezia+Terme+International+Airport,+Via+Aeroporto,+88046+Lamezia+Terme+CZ,+Italy/BEST+WESTERN+PLUS+Hotel+Perla+Del+Porto,+Via+Martiri+di+Cefalonia,+64,+88100+Catanzaro,+Italy/@38.868758,16.1564814,10z/data=!3m1!4b1!4m14!4m13!1m5!1m1!1s0x133fe15a3cbed47f:0x544ab120c3de78a6!2m2!1d16.2434017!2d38.9065845!1m5!1m1!1s0x134003d668252a13:0x2989caf676f45a72!2m2!1d16.6312407!2d38.827712!3e0 to/from the hotel and airport].
** Please fill out this [https://goo.gl/forms/7vmhxZSHy8Z1A62z2 form] to request transportation
*'''Local points of interest (pubs, restaurants, bar):''' [https://www.google.com/maps/d/viewer?mid=1FU63ik9Do3zzP6K2kvLVTtM2at8&ll=38.86221979925013%2C16.44292274999998&z=12 map] (constantly updated)

==Calendar==
{{#widget:Google Calendar
|id=kitware.com_sb07i171olac9aavh46ir495c4@group.calendar.google.com
|timezone=America/New_York&dates=20170108%2F20170114
|title=NA-MIC Project Week (Timezone is Italy / GMT+02.)
|view=WEEK
|dates=20170626/20170701
}}

iCal (.ics) link: https://calendar.google.com/calendar/ical/kitware.com_sb07i171olac9aavh46ir495c4%40group.calendar.google.com/public/basic.ics

=Projects=

<big>Please duplicate [https://na-mic.org/wiki/Project_Week_Template this template] to create a page for your project. </big>

Please put a brief preliminary title for your project here with some names in parenthesis for potential team members

#[[Project_Week_25/NeedleSegmentation | Needle Segmentation]]
#[[Project_Week_25/Human-Computer_Interaction_under_sterile_conditions |Human-Computer Interaction under Sterile Conditions]]
# [[Project_Week_25/Next_Generation_GPU_Volume_Rendering | Next Generation of Volume Rendering in VTK ]]
# [[Project_Week_25/Tracked-Ultrasound-Standardization-IV | Tracked Ultrasound Standardization IV: Controlling US Acquisition]]
#[[Project_Week_25/Intra-operative deformable_registration_based_on_dense_point_cloud_reconstruction |Intra-operative Deformable Registration Based on Dense Point Cloud Reconstruction]]
#[[Project_Week_25/Segmentation for improving image registration of preoperative MRI with intraoperative ultrasound images for neuro-navigation |Segmentation for Improving Image Registration of Preoperative MRI with Intraoperative Ultrasound Images for Neuro-navigation]]
#[[Project_Week_25/Deep_Learning_Data_augmentation_for_prostate_segmentation | Deep Learning: Data Augmentation for Prostate Segmentation]]
#DICOM Segmentation Support for Cornerstone / OHIF Viewer (Erik Ziegler, Steve Pieper, Marco Nolden, Tina Kapur)
#[[Project_Week_25/Conversion of DICOM Single Frame MR to Enhanced Multiframe | Conversion of DICOM Single Frame MR to Enhanced Multiframe]]
#[[Project_Week_25/Development_and_Evaluation_of_New_AR_Visualization_Techniques_to_Support_Radiological_Interventions | Development and Evaluation of New AR Visualization Techniques to Support Radiological Interventions]]
#[[Project_Week_25/Interactive_Manipulation_of_Plots_and_Graphs | Interactive Manipulation of Plots and Graphs]]
#Steerable Catheters Path Planner Extension for Brain Surgery Applications (Alberto Favaro, Marlene Pinzi)
#[[Project_Week_25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification]] (Simon Drouin, Christian Hansen, David Black)
#DICOM for Quantitative Imaging and Integration with Processing Applications (Jasmin Metzger, Marco Nolden, Steve Pieper)
#CNN for PseudoCT Generation from T1/T2 MRI (Giampaolo Pileggi, Paolo Zaffino, Salvatore Scaramuzzino, Maria Francesca Spadea, Gino Gulamhussene, Anneke Meyer)
#Internationalizing Slicer Modules (Juan Ruiz Alzola)
#Interfacing Slicer to Mobile Phone-controlled Sensors (Juan Ruiz Alzola)
#Slicer and 3D Printing (Juan Ruiz Alzola, Mike Halle, Christian Hansen)
#Slicer Export to VR (Juan Ruiz Alzola, Mike Halle)
#2D Slice to 3D Volume Registration to Support Radiologic Interventions (Gino Gulamhussene)
#[[Project_Week_25/SALT_Spatiotemporal_Modeling: | Slicer SALT Validation: Spatiotemporal Modeling of Subcortical Structures ]]
#[[Project_Week_25/Wrist_Kinematics: | Kinematic Analysis of the Wrist from Dynamic MRI]]

=Registrants=

Do not add your name to this list - it is maintained by the organizers based on your paid registration. To register, visit this [http://www.imagenglab.com/newsite/project-week/ registration site].

# Kikinis, Ron :: Brigham and Women's Hospital, Harvard Medical School, USA
# Pieper, Steve :: Isomics, Inc., USA
# Kapur, Tina :: Brigham and Women's Hospital, Harvard Medical School, USA
# Spadea, Maria Francesca :: Magna Graecia University, Italy
# Zaffino, Paolo :: Magna Graecia University, Italy
# Scaramuzzino, Salvatore :: Magna Graecia University/ASL Vercelli, Italy
# Pileggi, Giampaolo :: Magna Graecia University, Italy/DKFZ, Germany
# Rackerseder, Julia :: Technische Universität München, Germany
# Pinter, Csaba :: Queen's University, Canada
# Kraß, Scheherazade :: University of Bremen, Germany
# Gerig, Guido :: NYU Tandon School of Engineering, USA
# Punzo, Davide :: Kapteyn Astronomical Institute, University of Groningen, The Nederlands
# Drouin, Simon :: NeuroImaging and Surgical Technologies (NIST) Lab, Canada
# Lasso, Andras :: School of Computing, Queen's University, Canada
# Favaro, Alberto :: Politecnico di Milano, Italy
# Leger, Etienne :: Concordia University, Canada
# Ziegler, Erik :: Ziegler Consult SAS
# Onken, Michael :: Open Connections GmbH, Germany
# Pinzi, Marlene :: Imperial College, UK
# Nitsch, Jennifer :: University Of Bremen, Germany
# Moccia, Sara :: Politecnico di Milano, Italy
# Black, David :: Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany
# Penzkofer, Tobias :: Charité Universitätsmedizin, Berlin, Germany
# Hansen, Christian :: Universität Magdeburg, Germany
# Vegard Solberg, Ole :: Norway
# Heinrich, Florian :: Universität Magdeburg, Germany
# Mewes, André :: Universität Magdeburg, Germany
# Hatscher, Benjamin :: Universität Magdeburg, Germany
# Hettig, Julian :: Universität Magdeburg, Germany
# Meyer, Anneke :: Universität Magdeburg, Germany
# Gulamhussene, Gino :: Universität Magdeburg, Germany
# Cassetta, Roberto :: Politecnico di Milano, Italy
# Fillion-Robin, Jean-Christophe :: Kitware, USA
# Metzger, Jasmin :: DKFZ, Germany
# Fishbaugh, James :: NYU Tandon School of Engineering, USA
# Nolden, Marco :: DKFZ, Germany
# Jorge Quintero Nehrkorn :: Canary Islands, Spain

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-08T11:37:21Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
{|
|-
Christian Hansen, Julian Hettig, Benjamin Hatscher, [https://www.researchgate.net/profile/David_Black11 David Black], Marco Nolden, Juan Ruiz
|-
| Investigator 4 || Investigator 5 || Investigator 6
|}

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

Human-Computer Interaction under sterile conditions.
* Use with glove
* drapable display

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods

|

Please start each sentence in a new line.

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-08T11:34:30Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
{|
|-
| [http://www.spl.harvard.edu/pages/People/tkapur Christian Hansen] || [http://nist.mni.mcgill.ca/?page_id=369 Julian Hettig] || [http://www.spl.harvard.edu/pages/People/kikinis Benjamin Hatscher]
Christian Hansen, Julian Hettig, Benjamin Hatscher, [https://www.researchgate.net/profile/David_Black11 David Black], Marco Nolden, Juan Ruiz
|-
| Investigator 4 || Investigator 5 || Investigator 6
|}

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

Human-Computer Interaction under sterile conditions.
* Use with glove
* drapable display

|

# Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it
## We will need moderation kit (paper, pencil, markers, etc)
# Prototypes of possible auditory feedback based on conceptualization
## With OSC communication protocol, David will make quick, flexible sound methods

|

Please start each sentence in a new line.

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-08T11:32:23Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
{|
|-
| [http://www.spl.harvard.edu/pages/People/tkapur Christian Hansen] || [http://nist.mni.mcgill.ca/?page_id=369 Julian Hettig] || [http://www.spl.harvard.edu/pages/People/kikinis Benjamin Hatscher]
Christian Hansen, Julian Hettig, Benjamin Hatscher, [https://www.researchgate.net/profile/David_Black11 David Black], Marco Nolden, Juan Ruiz
|-
| Investigator 4 || Investigator 5 || Investigator 6
|}

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

Human-Computer Interaction under sterile conditions.
* Use with glove
* drapable display

|

* Long, intensive conceptualization (2 days) of possibilities for gesture interaction and audio feedback for it

|

Please start each sentence in a new line.

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25/Human-Computer Interaction under sterile conditions

2017-06-08T11:19:32Z

Dblack:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
{|
|-
| [http://www.spl.harvard.edu/pages/People/tkapur Christian Hansen] || [http://nist.mni.mcgill.ca/?page_id=369 Julian Hettig] || [http://www.spl.harvard.edu/pages/People/kikinis Benjamin Hatscher]
Christian Hansen, Julian Hettig, Benjamin Hatscher, [https://www.researchgate.net/profile/David_Black11 David Black], Marco Nolden, Juan Ruiz
|-
| Investigator 4 || Investigator 5 || Investigator 6
|}

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

Human-Computer Interaction under sterile conditions.
* Use with glove
* drapable display

|

* experiment

|

Please start each sentence in a new line.

|}

==Illustrations==

https://www.slicer.org/img/Slicer4Announcement-HiRes.png

<embedvideo service="youtube">https://www.youtube.com/watch?v=MKLWzD0PiIc</embedvideo>

==Background and References==

Project Week 25

2017-05-18T06:50:23Z

Dblack: /* Projects */

__NOTOC__
Back to [[Events]]

A summary of all past [[Project_Events#Past_Project_Weeks|Project Events]].

[[image:PW-Summer2017.png|300px]] [[image:IEL_logo.png|225px]]
<br>

=Welcome to the web page for the 25th Project Week!=

It is a pleasure to announce that the 25th Project week will be held in [https://goo.gl/maps/b9CpkFxNyWN2 Catanzaro Lido] (Calabria, Italy) on June 26-30, 2017. This is the first time in Italy for the Slicer Community, and the event is organized in cooperation with [http://www.imagenglab.com ImagEngLab]. Catanzaro Lido is a city on the Ionian Sea, in the middle of Squillace Gulf where, according to the ancient legend, Odysseus started his journey back to Ithaca. Of course bring your swimsuit...the conference room and the hotel are 20 meters far away from the beach!

This project week is an event [[Post-NCBC-2014|endorsed]] by the MICCAI society.

Please make sure that you are on the NA-MIC Project Week [http://public.kitware.com/mailman/listinfo/na-mic-project-week mailing list].

===Local Organizing Committee===
*[http://www.imagenglab.com/newsite/mf_spadea/ Maria Francesca Spadea, PhD]
*[http://www.imagenglab.com/newsite/paolo_zaffino/ Paolo Zaffino, PhD].

==Hangouts for preparation==
#(Tina Kapur) Hangout #1: April 5th, 2017 - 9.00 AM Boston time: [https://plus.google.com/events/cjh9ag37hm1e7peplatphl7kh2g?authkey=COWc5cKc77jymgE event page] ([[PW25 Hangouts Notes|Notes]])
#(Steve Pieper) Hangout #2: Wednesday April 12, 2017, 9am EDT (GMT-4): Web browser based computing: Dockerized Slicer with remote computing and GPU computing; Cornerstone/LesionTracker OHIF; XTK->AMI (threejs); ePad; vtk.js; QWebEngine; [https://plus.google.com/hangouts/_/kitware.com/pw-25?hceid=a2l0d2FyZS5jb21fc2IwN2kxNzFvbGFjOWFhdmg0NmlyNDk1YzRAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ.fffs75fitbu0mvpl3vvmrcqf3s&authuser=0 hangout page]
#(Andras Lasso) Hangout #3: Wednesday April 19, 2017, 9am EDT (GMT-4) Connecting devices such as surgical navigation, ultrasound, 3D Slicer, PLUS, OpenIGTLink, Augmented reality; [https://hangouts.google.com/hangouts/_/kitware.com/pw-25?authuser=0 hangout page]
#(Tina Kapur) Hangout #4: Wednesday April 26, 2017, 9am EDT (GMT-4) Deep Learning for Detection of Cancer and Instruments; [https://hangouts.google.com/hangouts/_/kitware.com/pw-25?authuser=0 hangout page];
#(Simon Drouin) Hangout #5: Wednesday May 3, 2017, 9am EDT (GMT-4)Volume Rendering, Augmented Reality, and Virtual Reality. [https://docs.google.com/document/d/1UwdSzjnDm1yEeQ44OEhXWbH6V83Uo1Cd4KngxoyrRdI/edit Notes];[https://plus.google.com/hangouts/_/kitware.com/pw-25?hceid=a2l0d2FyZS5jb21fc2IwN2kxNzFvbGFjOWFhdmg0NmlyNDk1YzRAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ.fffs75fitbu0mvpl3vvmrcqf3s&authuser=0 hangout page]
#(Tina Kapur) Hangout #6: Wednesday May 10, 2017, 9am EDT (GMT-4) For new participants: What is project week and how to get the most out of participating in it? [https://hangouts.google.com/hangouts/_/kitware.com/pw-25?authuser=0 hangout page]
#(Andrey Fedorov) Hangout #7: Wednesday May 17, 2017, 9am EDT (GMT-4) DICOM for Quantitative Imaging and integration with processing applications. [https://hangouts.google.com/hangouts/_/kitware.com/pw-25?authuser=0 hangout page]
#(Tina Kapur) Hangout #8: Wednesday May 24, 2017, 9am EDT (GMT-4) Review of Projects and teams that have been provided on the wiki page by participants
#(Francesca Spadea) Hangout #9: Wednesday May 31, 2017, 9am EDT (GMT-4) Review of local logistics -- all registered attendees should join
#(TBD) Hangout #10: Wednesday June 7, 2017, 9am EDT (GMT-4) TBD
#(TBD) Hangout #11: Wednesday June 14, 2017, 9am EDT (GMT-4) TBD
#(Francesca Spadea) Hangout #12: Wednesday June 21, 2017, 9am EDT (GMT-4) Review of local logistics -- all registered attendees with questions should join

==Logistics==

*'''Dates:''' June 26-30, 2017. Consider staying for one more day (leaving Sunday morning), as a day off in a gorgeous sea place is planned on July 1st. More details will be posted soon.
*'''Location:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]
**[mailto:prenotazioni@hotelperladelporto.it Booking]. Subject line: "Slicer Summer Project Week 2017".
***Special rates are:
****Single room, full bed, 79 € per night (1 person)
****Single room, queen bed 89 € per night (1 person)
****Double room, queen bed 99 € per night (2 people)
****Triple room, 110 € (3 people)
*'''REGISTRATION:''' To register please visit this [http://www.imagenglab.com/newsite/project-week page]
*'''Registration Fee:''' 320€ and it includes lunches, coffee breaks and airport connections
*'''Hotel:''' [http://www.hotelperladelporto.it/en/home-page.aspx Perla del Porto Hotel]. The closest airport is [http://www.lameziaairport.it/english/ Lamezia Terme Airport (IATA: SUF)].
*'''Transportation from Airport to Hotel''' Your registration fee includes ground transportation [https://www.google.com/maps/dir/Lamezia+Terme+International+Airport,+Via+Aeroporto,+88046+Lamezia+Terme+CZ,+Italy/BEST+WESTERN+PLUS+Hotel+Perla+Del+Porto,+Via+Martiri+di+Cefalonia,+64,+88100+Catanzaro,+Italy/@38.868758,16.1564814,10z/data=!3m1!4b1!4m14!4m13!1m5!1m1!1s0x133fe15a3cbed47f:0x544ab120c3de78a6!2m2!1d16.2434017!2d38.9065845!1m5!1m1!1s0x134003d668252a13:0x2989caf676f45a72!2m2!1d16.6312407!2d38.827712!3e0 to/from the hotel and airport].
** Please fill out this form to request transportation https://goo.gl/forms/7vmhxZSHy8Z1A62z2
*'''Local points of interest (pubs, restaurants, bar):''' [https://www.google.com/maps/d/viewer?mid=1FU63ik9Do3zzP6K2kvLVTtM2at8&ll=38.86221979925013%2C16.44292274999998&z=12 map (constantly updated)]

==Calendar==

'''''<font color="maroon">The events are listed in the calendar below. Note that due to a current known limitation of our infrastructure, you will need to manually navigate to the week of June 26, 2017 to see the relevant events.</font>'''''<br>

{{#widget:Google Calendar
|id=kitware.com_sb07i171olac9aavh46ir495c4@group.calendar.google.com
|timezone=America/New_York&dates=20170108%2F20170114
|title=NA-MIC Project Week
|view=WEEK
|dates=20170626/20170701
}}

iCal (.ics) link: https://calendar.google.com/calendar/ical/kitware.com_sb07i171olac9aavh46ir495c4%40group.calendar.google.com/public/basic.ics

=Projects=

Please put a brief preliminary title for your project here with some names in parenthesis for potential team members

#Needle segmentation Project 1 (Guillaume Pernelle, Tina Kapur, Paolo Zaffino, Salvatore Scaramuzzino, Francesca Spadea)
#Needle segmentation Project 2 (Paolo Zaffino, Salvatore Scaramuzzino, Francesca Spadea, Guillaume Pernelle, Tina Kapur)
#DICOM Segmentation support for Cornerstone / OHIF Viewer (Erik Ziegler)
#Conversion of DICOM single frame MR to Enhanced Multiframe (Michael Onken, Steve Pieper)
#Human-Computer Interaction under sterile conditions (Christian Hansen, Julian Hettig, Benjamin Hatscher, David Black)
#Development and evaluation of new AR visualization technniques to support radiological interventions (Christian Hansen, Florian Heinrich, Andrè Mewes)
#Interactive manipulation of plots and graphs: i) panning; ii) click and drag; iii) data selection (Davide Punzo, Steve Pieper)
#Next generation of volume rendering in VTK (Simon Drouin, Steve Pieper, Ole Vegard Solberg)
#Tracked Ultrasound Standardization IV: Controlling US acquisition (Simon Drouin, Ole Vegard Solberg, Andras Lasso, Longquan Chen, Adam Rankin?)
#Steerable catheters path planner extension for brain surgery applications (Alberto Favaro, Marlene Pinzi)
#Improving depth perception in interventional Augmented Reality visualization/(+sonification?) (Simon Drouin, Christian Hansen, David Black)

=Registrants=

Do not add your name to this list - it is maintained by the organizers based on your paid registration. To register, visit this [http://www.imagenglab.com/newsite/project-week/ registration site].

# Kikinis, Ron :: Brigham and Women's Hospital, Harvard Medical School, USA
# Pieper, Steve :: Isomics, Inc., USA
# Kapur, Tina :: Brigham and Women's Hospital, Harvard Medical School, USA
# Spadea, Maria Francesca :: Magna Graecia University, Italy
# Zaffino, Paolo :: Magna Graecia University, Italy
# Scaramuzzino, Salvatore :: Magna Graecia University/ASL Vercelli, Italy
# Pileggi, Giampaolo :: Magna Graecia University, Italy/DKFZ, Germany
# Rackerseder, Julia :: Technische Universität München, Germany
# Pinter, Csaba :: Queen's University, Canada
# Kraß, Scheherazade :: University of Bremen, Germany
# Gerig, Guido :: NYU Tandon School of Engineering, USA
# Punzo, Davide :: Kapteyn Astronomical Institute, Netherlands
# Drouin, Simon :: NeuroImaging and Surgical Technologies (NIST) Lab, Canada
# Lasso, Andras :: School of Computing, Queen's University, Canada
# Favaro, Alberto :: Politecnico di Milano, Italy
# Leger, Etienne :: Concordia University, Canada
# Ziegler, Erik :: Ziegler Consult SAS
# Onken, Michael :: Open Connections GmbH, Germany
# Pinzi, Marlene :: Imperial College, UK
# Nitsch, Jennifer :: University Of Bremen, Germany
# Moccia, Sara :: Politecnico di Milano, Italy
# Black, David :: Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany
# Penzkofer, Tobias :: Charité Universitätsmedizin, Berlin, Germany

2016 Summer Project Week/Auditory Display

2016-06-25T08:57:29Z

Dblack: /* Possible application areas / IDEAS */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS
* Tamas Ungi
* Rocio Lopez
* Elvis Chen
*Julian Hettig

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)
*coverage of needle in US

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* Test program for Puredata to listen for incoming OSC messages: [http://wiki.na-mic.org/Wiki/images/8/81/Test_incoming_OSC.zip link]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]
* Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
* Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
* Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-25T08:40:40Z

Dblack:

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS
* Tamas Ungi
* Rocio Lopez
* Elvis Chen
*Julian Hettig

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* Test program for Puredata to listen for incoming OSC messages: [http://wiki.na-mic.org/Wiki/images/8/81/Test_incoming_OSC.zip link]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]
* Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
* Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
* Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-24T14:00:22Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* Test program for Puredata to listen for incoming OSC messages: [http://wiki.na-mic.org/Wiki/images/8/81/Test_incoming_OSC.zip link]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]
* Tried out iplementing liblo library for OSC messages, this workson Mac but not well on Windows.
* Switched to python-based library, which works well. Rocio tried this out but not enough time to integrate with their existing apps.
* Friendly contact between groups who are interested in working together (Rocio, Tamas, Elvis, Longquan)

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-23T14:19:33Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* Test program for Puredata to listen for incoming OSC messages: [http://wiki.na-mic.org/Wiki/images/8/81/Test_incoming_OSC.zip link]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

File:Test incoming OSC.zip

2016-06-23T14:19:00Z

Dblack: test incoming OSC messages for auditory display support

test incoming OSC messages for auditory display support

2016 Summer Project Week/Auditory Display

2016-06-23T08:07:17Z

Dblack: /* Related Work */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-23T08:07:04Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* common sound synthesis software: [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider] DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
* libraries for OpenSoundControl include C++: [http://liblo.sourceforge.net/ liblo], Python: [http://das.nasophon.de/pyliblo/ PyLiblo]

</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-23T07:53:52Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]

DOWNLOAD PUREDATA EXTENDED>>> [https://puredata.info/downloads/pd-extended here]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-22T14:10:17Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]
</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-22T14:10:03Z

Dblack: /* Project Description */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg
*Longquan Chen, BWH/HMS

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

[[http://www.na-mic.org/Wiki/images/9/98/ReceiveClient.txt Simplified version from Longquan Chen]]
</div>
</div>

2016 Summer Project Week/Workshop on Shared Software Platform for Ultrasound-Guided Medical Interventions

2016-06-22T08:31:30Z

Dblack: /* Participants */

= Introduction =

Several groups have developed ultrasound-guided intervention systems in the last two decades but until recently these groups have worked mostly in parallel, independently from each other. The Image Guided Systems Inter-Operability (IGSIO) group was founded in 2016 January after lengthy discussions regarding the standardization of tracked ultrasound communication to work towards improving the interoperability between industrial products and research software platforms. See more information about this effort at http://igsio.github.io/.

The goal of this workshop is to promote the concept and practice of a shared software platform for ultrasound-guided interventions. Participants will learn, in practice, to build clinical applications using software platform tools.

= Tentative agenda (keep checking this page for more details) =

* 9-10am: Introduction of existing open-source infrastructure for building ultrasound-guided intervention systems
** Plus/SlicerIGT/3DSlicer (Andras Lasso)
** CustusX
** IBIS
* 10.30am-12pm: Bring your own problem - discussion of implementation options for specific clinical procedures using open-source platforms.
** EM needle guidance in breast brachytherapy (Thomas Vaughan)
** Tracked ultrasound guided lumpectomy (Tamas Ungi)
** <add your name and clinical application here>
* Afternoon: Hands-on session for setting up prototype systems for ultrasound guidance and tool navigation.

= Registration =

No registration is required, just add your name to the participant list below or send an email to Andras Lasso (lasso@queensu.ca).

= Participants =
* Christian Askeland
* Janne Beate Bakeng
* Longquan Chen
* Simon Drouin
* Jon Eiesland
* Thomas Kirchner
* Adam Rankin
* Ole Vegard Solberg
* Junichi Tokuda
* Sarah Frisken
* Bojan Kocev
* Ines Machado
* Tamas Ungi
* David Black

User talk:Dblack

2016-06-22T08:31:19Z

Dblack:

'''Welcome to ''NAMIC''!'''
We hope you will contribute much and well.
You will probably want to read the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents help pages].
Again, welcome and have fun! [[User:Marianna|Marianna]] ([[User talk:Marianna|talk]]) 13:30, 17 May 2016 (EDT)

== Namic project week possible projects and notes ==

http://wiki.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/Guided_Ultrasound_Calibration

http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/Sacral_Neuromodulation

http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/Fusion_of_Electromagnetic_and_Surface_Scanner_Data

http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/AR_with_a_tablet_device_in_the_surgical_room

http://wiki.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/Integrating_PLUS_in_applications_using_OpenIGTLink SImon Drouin

Frank... Sandy's Orbit?

Alexandra Golby http://golbylab.bwh.harvard.edu/

2016 Summer Project Week/Auditory Display

2016-06-20T14:56:44Z

Dblack: /* Possible application areas / IDEAS */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio
*Depth cues for 3D data (shown on 2D screens)

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

</div>
</div>

Code from Jay Jagadeesan for OgenIGTLink

2016-06-20T14:48:15Z

Dblack:

<pre>
/*=========================================================================

Program: Open IGT Link -- Example for Data Receiving Client Program
Module: $RCSfile: $
Language: C++
Date: $Date: $
Version: $Revision: $

Copyright (c) Insight Software Consortium. All rights reserved.

This software is distributed WITHOUT ANY WARRANTY; without even
the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR
PURPOSE. See the above copyright notices for more information.

=========================================================================*/

#include <iostream>
#include <iomanip>
#include <math.h>
#include <cstdlib>
#include <cstring>
#include <stdio.h>
#include <stdlib.h>
#include <unistd.h>

//Sound input files

#include <lo/lo.h>

#include "igtlOSUtil.h"
#include "igtlMessageHeader.h"
#include "igtlTransformMessage.h"
#include "igtlPositionMessage.h"
#include "igtlImageMessage.h"
#include "igtlClientSocket.h"
#include "igtlStatusMessage.h"

#if OpenIGTLink_PROTOCOL_VERSION >= 2
#include "igtlPointMessage.h"
#include "igtlTrajectoryMessage.h"
#include "igtlStringMessage.h"
#include "igtlTrackingDataMessage.h"
#include "igtlQuaternionTrackingDataMessage.h"
#include "igtlCapabilityMessage.h"
#endif // OpenIGTLink_PROTOCOL_VERSION >= 2

int ReceiveTransform(igtl::Socket * socket, igtl::MessageHeader::Pointer& header, igtl::Matrix4x4 transformMatrix);
int ReceivePosition(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
int ReceiveImage(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
int ReceiveStatus(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
void ObtainPosOrFromTx(igtl::Matrix4x4 txMatrix, double pos[3], double orient[3]);

#if OpenIGTLink_PROTOCOL_VERSION >= 2
int ReceivePoint(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
int ReceiveTrajectory(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
int ReceiveString(igtl::Socket * socket, igtl::MessageHeader::Pointer& header);
int ReceiveTrackingData(igtl::ClientSocket::Pointer& socket, igtl::MessageHeader::Pointer& header);
int ReceiveQuaternionTrackingData(igtl::ClientSocket::Pointer& socket, igtl::MessageHeader::Pointer& header);
int ReceiveCapability(igtl::Socket * socket, igtl::MessageHeader * header);
#endif //OpenIGTLink_PROTOCOL_VERSION >= 2

// Sound related stuff
const char testdata[6] = "ABCDE";

int main(int argc, char* argv[])
{
//------------------------------------------------------------
// Sound related stuff - initialization
//------------------------------------------------------------

/* build a blob object from some data */
lo_blob btest = lo_blob_new(sizeof(testdata), testdata);

/* an address to send messages to. sometimes it is better to let the server
* pick a port number for you by passing NULL as the last argument */
// lo_address t = lo_address_new_from_url( "osc.unix://localhost/tmp/mysocket" );
lo_address t = lo_address_new("169.123.1.5", "7400");

/* send a message to /a/b/c/d with a mixtrure of float and string
* arguments */
//lo_send(t, "/a/b/c/d", "sfsff", "one", 0.12345678f, "three",
// -0.00000023001f, 1.0);

/* send a 'blob' object to /a/b/c/d */
//lo_send(t, "/a/b/c/d", "b", btest);

/* send a jamin scene change instruction with a 32bit integer argument */
//lo_send(t, "/jamin/scene", "i", 3);

//------------------------------------------------------------
// Parse Arguments

if (argc != 3) // check number of arguments
{
// If not correct, print usage
std::cerr << " <hostname> : IP or host name" << std::endl;
std::cerr << " <port> : Port # (18944 in Slicer default)" << std::endl;
exit(0);
}

char* hostname = argv[1];
int port = atoi(argv[2]);

//------------------------------------------------------------
// Establish Connection

igtl::ClientSocket::Pointer socket;
socket = igtl::ClientSocket::New();
int r = socket->ConnectToServer(hostname, port);

if (r != 0)
{
std::cerr << "Cannot connect to the server." << std::endl;
exit(0);
}

//------------------------------------------------------------
// Create a message buffer to receive header
igtl::MessageHeader::Pointer headerMsg;
headerMsg = igtl::MessageHeader::New();

//------------------------------------------------------------
// Allocate a time stamp
igtl::TimeStamp::Pointer ts;
ts = igtl::TimeStamp::New();

double pos[3], orient[3];

while (1)
{
//------------------------------------------------------------
// loop
//for (int i = 0; i < 100; i ++)
{

// Initialize receive buffer
headerMsg->InitPack();

// Receive generic header from the socket
int r = socket->Receive(headerMsg->GetPackPointer(), headerMsg->GetPackSize());
if (r == 0)
{
socket->CloseSocket();
exit(0);
}
if (r != headerMsg->GetPackSize())
{
continue;
}

// Deserialize the header
headerMsg->Unpack();

// Get time stamp
igtlUint32 sec;
igtlUint32 nanosec;

headerMsg->GetTimeStamp(ts);
ts->GetTimeStamp(&sec, &nanosec);
igtl::Matrix4x4 transformMatrix;

std::cerr << "Time stamp: "
<< sec << "." << std::setw(9) << std::setfill('0')
<< nanosec << std::endl;

// Check data type and receive data body
if (strcmp(headerMsg->GetDeviceType(), "TRANSFORM") == 0)
{
ReceiveTransform(socket, headerMsg, transformMatrix);
}
else if (strcmp(headerMsg->GetDeviceType(), "POSITION") == 0)
{
ReceivePosition(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "IMAGE") == 0)
{
ReceiveImage(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "STATUS") == 0)
{
ReceiveStatus(socket, headerMsg);
}
#if OpenIGTLink_PROTOCOL_VERSION >= 2
else if (strcmp(headerMsg->GetDeviceType(), "POINT") == 0)
{
ReceivePoint(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "TRAJ") == 0)
{
ReceiveTrajectory(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "STRING") == 0)
{
ReceiveString(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "TDATA") == 0)
{
ReceiveTrackingData(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "QTDATA") == 0)
{
ReceiveQuaternionTrackingData(socket, headerMsg);
}
else if (strcmp(headerMsg->GetDeviceType(), "CAPABILITY") == 0)
{
ReceiveCapability(socket, headerMsg);;
}
#endif //OpenIGTLink_PROTOCOL_VERSION >= 2
else
{
std::cerr << "Receiving : " << headerMsg->GetDeviceType() << std::endl;
socket->Skip(headerMsg->GetBodySizeToRead(), 0);
}

// Obtaining the position and orientation information
ObtainPosOrFromTx(transformMatrix, pos, orient);

// Sending the information to the audiolink
/* send a jamin scene change instruction with a 32bit integer argument */
lo_send(t, "/dumpOSC/Distance", "i", int(pos[0]));
//lo_send(t, "/jamin/scene", "i", int(pos[1]));
//lo_send(t, "/jamin/scene", "i", int(pos[2]));

lo_send(t, "/dumpOSC/Alpha", "i", int((pos[1]*180/3.1418)*100.0/90.0 )); //Elevation
lo_send(t, "/dumpOSC/Beta", "i", int((pos[2]*180/3.1418)*100.0/90.0) ); // Azimuth
//lo_send(t, "/jamin/scene", "i", int(orient[2]*180/3.1418));

//std::cout << "Transform position = " << pos[0] << " " << pos[1] << " " << pos[2] << std::endl;
std::cout << "Transform orientation = " << orient[0] << " " << orient[1] << " " << orient[2] << std::endl;
}
}

//------------------------------------------------------------
// Close connection (The example code never reaches this section ...)

socket->CloseSocket();

}

int ReceiveTransform(igtl::Socket * socket, igtl::MessageHeader::Pointer& header, igtl::Matrix4x4 transformMatrix)
{
std::cerr << "Receiving TRANSFORM data type." << std::endl;

// Create a message buffer to receive transform data
igtl::TransformMessage::Pointer transMsg;
transMsg = igtl::TransformMessage::New();
transMsg->SetMessageHeader(header);
transMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(transMsg->GetPackBodyPointer(), transMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = transMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
// Retrive the transform data
igtl::Matrix4x4 matrix;
transMsg->GetMatrix(matrix);
igtl::PrintMatrix(matrix);
std::cerr << std::endl;
for (int i = 0; i < 4; i++)
{
for (int j =0; j < 4; j++)
{
transformMatrix[i][j] = matrix[i][j];
}
}
return 1;
}

return 0;
}

void ObtainPosOrFromTx(igtl::Matrix4x4 txMatrix, double pos[3], double orient[3])
{

pos[0] = txMatrix[0][3];
pos[1] = txMatrix[1][3];
pos[2] = txMatrix[2][3];

orient[1] = atan2(-txMatrix[2][0],pow(pow(txMatrix[0][0],2)+pow(txMatrix[1][0],2),0.5) ); //beta
orient[2] = atan2(txMatrix[2][1]/cos(orient[1]),txMatrix[2][2]/cos(orient[1]) ); // gamma
orient[0] = atan2(txMatrix[1][0]/cos(orient[1]),txMatrix[0][0]/cos(orient[1]) ); //alpha

}

int ReceivePosition(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{
std::cerr << "Receiving POSITION data type." << std::endl;

// Create a message buffer to receive transform data
igtl::PositionMessage::Pointer positionMsg;
positionMsg = igtl::PositionMessage::New();
positionMsg->SetMessageHeader(header);
positionMsg->AllocatePack();

// Receive position position data from the socket
socket->Receive(positionMsg->GetPackBodyPointer(), positionMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = positionMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
// Retrive the transform data
float position[3];
float quaternion[4];

positionMsg->GetPosition(position);
positionMsg->GetQuaternion(quaternion);

std::cerr << "position = (" << position[0] << ", " << position[1] << ", " << position[2] << ")" << std::endl;
std::cerr << "quaternion = (" << quaternion[0] << ", " << quaternion[1] << ", "
<< quaternion[2] << ", " << quaternion[3] << ")" << std::endl << std::endl;

return 1;
}

return 0;
}

int ReceiveImage(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{
std::cerr << "Receiving IMAGE data type." << std::endl;

// Create a message buffer to receive transform data
igtl::ImageMessage::Pointer imgMsg;
imgMsg = igtl::ImageMessage::New();
imgMsg->SetMessageHeader(header);
imgMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(imgMsg->GetPackBodyPointer(), imgMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = imgMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
// Retrive the image data
int size[3]; // image dimension
float spacing[3]; // spacing (mm/pixel)
int svsize[3]; // sub-volume size
int svoffset[3]; // sub-volume offset
int scalarType; // scalar type

scalarType = imgMsg->GetScalarType();
imgMsg->GetDimensions(size);
imgMsg->GetSpacing(spacing);
imgMsg->GetSubVolume(svsize, svoffset);

std::cerr << "Device Name : " << imgMsg->GetDeviceName() << std::endl;
std::cerr << "Scalar Type : " << scalarType << std::endl;
std::cerr << "Dimensions : ("
<< size[0] << ", " << size[1] << ", " << size[2] << ")" << std::endl;
std::cerr << "Spacing : ("
<< spacing[0] << ", " << spacing[1] << ", " << spacing[2] << ")" << std::endl;
std::cerr << "Sub-Volume dimensions : ("
<< svsize[0] << ", " << svsize[1] << ", " << svsize[2] << ")" << std::endl;
std::cerr << "Sub-Volume offset : ("
<< svoffset[0] << ", " << svoffset[1] << ", " << svoffset[2] << ")" << std::endl << std::endl;
return 1;
}

return 0;

}

int ReceiveStatus(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{

std::cerr << "Receiving STATUS data type." << std::endl;

// Create a message buffer to receive transform data
igtl::StatusMessage::Pointer statusMsg;
statusMsg = igtl::StatusMessage::New();
statusMsg->SetMessageHeader(header);
statusMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(statusMsg->GetPackBodyPointer(), statusMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = statusMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
std::cerr << "========== STATUS ==========" << std::endl;
std::cerr << " Code : " << statusMsg->GetCode() << std::endl;
std::cerr << " SubCode : " << statusMsg->GetSubCode() << std::endl;
std::cerr << " Error Name: " << statusMsg->GetErrorName() << std::endl;
std::cerr << " Status : " << statusMsg->GetStatusString() << std::endl;
std::cerr << "============================" << std::endl << std::endl;
}

return 0;

}

#if OpenIGTLink_PROTOCOL_VERSION >= 2
int ReceivePoint(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{

std::cerr << "Receiving POINT data type." << std::endl;

// Create a message buffer to receive transform data
igtl::PointMessage::Pointer pointMsg;
pointMsg = igtl::PointMessage::New();
pointMsg->SetMessageHeader(header);
pointMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(pointMsg->GetPackBodyPointer(), pointMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = pointMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
int nElements = pointMsg->GetNumberOfPointElement();
for (int i = 0; i < nElements; i ++)
{
igtl::PointElement::Pointer pointElement;
pointMsg->GetPointElement(i, pointElement);

igtlUint8 rgba[4];
pointElement->GetRGBA(rgba);

igtlFloat32 pos[3];
pointElement->GetPosition(pos);

std::cerr << "========== Element #" << i << " ==========" << std::endl;
std::cerr << " Name : " << pointElement->GetName() << std::endl;
std::cerr << " GroupName : " << pointElement->GetGroupName() << std::endl;
std::cerr << " RGBA : ( " << (int)rgba[0] << ", " << (int)rgba[1] << ", " << (int)rgba[2] << ", " << (int)rgba[3] << " )" << std::endl;
std::cerr << " Position : ( " << std::fixed << pos[0] << ", " << pos[1] << ", " << pos[2] << " )" << std::endl;
std::cerr << " Radius : " << std::fixed << pointElement->GetRadius() << std::endl;
std::cerr << " Owner : " << pointElement->GetOwner() << std::endl;
std::cerr << "================================" << std::endl << std::endl;
}
}

return 1;
}

int ReceiveTrajectory(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{

std::cerr << "Receiving TRAJECTORY data type." << std::endl;

// Create a message buffer to receive transform data
igtl::TrajectoryMessage::Pointer trajectoryMsg;
trajectoryMsg = igtl::TrajectoryMessage::New();
trajectoryMsg->SetMessageHeader(header);
trajectoryMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(trajectoryMsg->GetPackBodyPointer(), trajectoryMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = trajectoryMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
int nElements = trajectoryMsg->GetNumberOfTrajectoryElement();
for (int i = 0; i < nElements; i ++)
{
igtl::TrajectoryElement::Pointer trajectoryElement;
trajectoryMsg->GetTrajectoryElement(i, trajectoryElement);

igtlUint8 rgba[4];
trajectoryElement->GetRGBA(rgba);

igtlFloat32 entry[3];
igtlFloat32 target[3];
trajectoryElement->GetEntryPosition(entry);
trajectoryElement->GetTargetPosition(target);

std::cerr << "========== Element #" << i << " ==========" << std::endl;
std::cerr << " Name : " << trajectoryElement->GetName() << std::endl;
std::cerr << " GroupName : " << trajectoryElement->GetGroupName() << std::endl;
std::cerr << " RGBA : ( " << (int)rgba[0] << ", " << (int)rgba[1] << ", " << (int)rgba[2] << ", " << (int)rgba[3] << " )" << std::endl;
std::cerr << " Entry Pt : ( " << std::fixed << entry[0] << ", " << entry[1] << ", " << entry[2] << " )" << std::endl;
std::cerr << " Target Pt : ( " << std::fixed << target[0] << ", " << target[1] << ", " << target[2] << " )" << std::endl;
std::cerr << " Radius : " << std::fixed << trajectoryElement->GetRadius() << std::endl;
std::cerr << " Owner : " << trajectoryElement->GetOwner() << std::endl;
std::cerr << "================================" << std::endl << std::endl;
}
}

return 1;
}

int ReceiveString(igtl::Socket * socket, igtl::MessageHeader::Pointer& header)
{

std::cerr << "Receiving STRING data type." << std::endl;

// Create a message buffer to receive transform data
igtl::StringMessage::Pointer stringMsg;
stringMsg = igtl::StringMessage::New();
stringMsg->SetMessageHeader(header);
stringMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(stringMsg->GetPackBodyPointer(), stringMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = stringMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
std::cerr << "Encoding: " << stringMsg->GetEncoding() << "; "
<< "String: " << stringMsg->GetString() << std::endl << std::endl;
}

return 1;
}

int ReceiveTrackingData(igtl::ClientSocket::Pointer& socket, igtl::MessageHeader::Pointer& header)
{
std::cerr << "Receiving TDATA data type." << std::endl;

// Create a message buffer to receive transform data
igtl::TrackingDataMessage::Pointer trackingData;
trackingData = igtl::TrackingDataMessage::New();
trackingData->SetMessageHeader(header);
trackingData->AllocatePack();

// Receive body from the socket
socket->Receive(trackingData->GetPackBodyPointer(), trackingData->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = trackingData->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
int nElements = trackingData->GetNumberOfTrackingDataElements();
for (int i = 0; i < nElements; i ++)
{
igtl::TrackingDataElement::Pointer trackingElement;
trackingData->GetTrackingDataElement(i, trackingElement);

igtl::Matrix4x4 matrix;
trackingElement->GetMatrix(matrix);

std::cerr << "========== Element #" << i << " ==========" << std::endl;
std::cerr << " Name : " << trackingElement->GetName() << std::endl;
std::cerr << " Type : " << (int) trackingElement->GetType() << std::endl;
std::cerr << " Matrix : " << std::endl;
igtl::PrintMatrix(matrix);
std::cerr << "================================" << std::endl << std::endl;
}
return 1;
}
return 0;
}

int ReceiveQuaternionTrackingData(igtl::ClientSocket::Pointer& socket, igtl::MessageHeader::Pointer& header)
{
std::cerr << "Receiving QTDATA data type." << std::endl;

// Create a message buffer to receive transform data
igtl::QuaternionTrackingDataMessage::Pointer quaternionTrackingData;
quaternionTrackingData = igtl::QuaternionTrackingDataMessage::New();
quaternionTrackingData->SetMessageHeader(header);
quaternionTrackingData->AllocatePack();

// Receive body from the socket
socket->Receive(quaternionTrackingData->GetPackBodyPointer(), quaternionTrackingData->GetPackBodySize());

// Deserialize position and quaternion (orientation) data
// If you want to skip CRC check, call Unpack() without argument.
int c = quaternionTrackingData->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
int nElements = quaternionTrackingData->GetNumberOfQuaternionTrackingDataElements();
for (int i = 0; i < nElements; i ++)
{
igtl::QuaternionTrackingDataElement::Pointer quaternionTrackingElement;
quaternionTrackingData->GetQuaternionTrackingDataElement(i, quaternionTrackingElement);

float position[3];
float quaternion[4];
quaternionTrackingElement->GetPosition(position);
quaternionTrackingElement->GetQuaternion(quaternion);

std::cerr << "========== Element #" << i << " ==========" << std::endl;
std::cerr << " Name : " << quaternionTrackingElement->GetName() << std::endl;
std::cerr << " Type : " << (int) quaternionTrackingElement->GetType() << std::endl;
std::cerr << " Position : "; igtl::PrintVector3(position);
std::cerr << " Quaternion : "; igtl::PrintVector4(quaternion);
std::cerr << "================================" << std::endl << std::endl;
}
return 1;
}
return 0;
}

int ReceiveCapability(igtl::Socket * socket, igtl::MessageHeader * header)
{

std::cerr << "Receiving CAPABILITY data type." << std::endl;

// Create a message buffer to receive transform data
igtl::CapabilityMessage::Pointer capabilMsg;
capabilMsg = igtl::CapabilityMessage::New();
capabilMsg->SetMessageHeader(header);
capabilMsg->AllocatePack();

// Receive transform data from the socket
socket->Receive(capabilMsg->GetPackBodyPointer(), capabilMsg->GetPackBodySize());

// Deserialize the transform data
// If you want to skip CRC check, call Unpack() without argument.
int c = capabilMsg->Unpack(1);

if (c & igtl::MessageHeader::UNPACK_BODY) // if CRC check is OK
{
int nTypes = capabilMsg->GetNumberOfTypes();
for (int i = 0; i < nTypes; i ++)
{
std::cerr << "Typename #" << i << ": " << capabilMsg->GetType(i) << std::endl;
}
}

return 1;

}

#endif //OpenIGTLink_PROTOCOL_VERSION >= 2
</pre>

2016 Summer Project Week/Auditory Display

2016-06-20T14:37:44Z

Dblack: /* Possible application areas */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas / IDEAS==
*Acquiring 3D data sets for US, did we acquire all we need?
* Uncertainty in navigation information
*Brain / Structure Shift
* reduce complexity of displays by offloading to audio

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-20T14:35:56Z

Dblack: /* Key Investigators */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, University of Bremen, Fraunhofer MEVIS
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas==

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

</div>
</div>

2016 Summer Project Week/Auditory Display

2016-06-20T14:31:31Z

Dblack: /* Related Work */

__NOTOC__
<gallery>
Image:PW-Summer2016.png|[[2016_Summer_Project_Week#Projects|Projects List]]
</gallery>

==Key Investigators==
*David Black, Bremen
*Sarah Frisken, BWH/HMS
*Christian Hansen, Uni Magdeburg

==Related Work==
Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see

*VIDEO: [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy, with BWH/HMS and with Slicer][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link]
*VIDEO: [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion, with Univeristy of Magdeburg]
*VIDEO: [https://www.youtube.com/watch?v=gCg5nJSI2pY Auditory Display for Liver Resection] [http://www.ncbi.nlm.nih.gov/pubmed/23192891 Paper]
*[http://ioi.cs.uni-bremen.de/?page_id=780 Towards Uncertainty-Aware Auditory Display for Surgical Navigation (CARS 2016)]]
*D. Black, J. Al Issawi, C. Rieder, and H. Hahn. Enhancing medical needle placement with auditory display. In Mensch & Computer 2013: Interaktive Vielfalt, pages 289–292, 2013. [http://www.na-mic.org/Wiki/images/7/7d/Curac2013_dblack_Auditory_support_for_Navigated_Radiofrequency_Ablation_FINAL.pdf PDF ]

==Possible application areas==

==Project Description==

<div style="margin: 20px;">
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
* Explore possibilities of auditory display for intraoperative use
* Find opportunities for extending existing projects with auditory display
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Approach, Plan</h3>
* Connect OpenIGTLink to OpenSoundcontrol for use in common sound synthesis software such as [https://puredata.info PureData], [https://cycling74.com/products/max/ Max], or [http://supercollider.github.io/ SuperCollider]
* libraries for OpenSoundControl include [http://liblo.sourceforge.net/ liblo], [http://das.nasophon.de/pyliblo/ PyLiblo]
</div>
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Progress</h3>
* Existing methods for intraoperative navigation guidance already implemented in [https://puredata.info Puredata], see [https://www.dropbox.com/s/6wfrklm8by4fx29/Dual-frequency-feedback.mov?dl=0 for ureteroscopy][http://wiki.na-mic.org/Wiki/index.php/File:Dual-frequency-feedback.mov download link], [https://www.dropbox.com/s/35rvm7kx30hwl08/WirbelBeispielMitAudio.mov?dl=0 for ablation needle insertion]

[[Code from Jay Jagadeesan for OgenIGTLink]], [http://www.na-mic.org/Wiki/images/3/3d/ReceiveClient.cxx.zip here as zip.]

</div>
</div>