NAMIC Wiki - User contributions [en]

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-30T12:06:06Z

A mewes:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|
* Discussion about possibilties to support depth persception (visually and auditory)
* Implementation of new depth cues
|
* Enabled kinetic depth cues for Needle Navigation Software: direct control of scene camera movement with head position tracking
* Sound connection could not be implemented during this week (had to rework parts the own code base first, took much time)
* Started to implement head tracking -> need some different hardware
* Next steps will further focus on head tracking and fusion with sonification
|}
[[File:System setup.svg|frame|left]]

{|
|[[image:Depth Cues for projective AR Needle Navigation.png|left|600px]]
|-
|Depth Cues for projective AR Needle Navigation
|}

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

File:System setup.svg

2017-06-30T12:05:50Z

A mewes:

System setup

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-30T12:05:05Z

A mewes: /* Project Description */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|
* Discussion about possibilties to support depth persception (visually and auditory)
* Implementation of new depth cues
|
* Enabled kinetic depth cues for Needle Navigation Software: direct control of scene camera movement with head position tracking
* Sound connection could not be implemented during this week (had to rework parts the own code base first, took much time)
* Started to implement head tracking -> need some different hardware
* Next steps will further focus on head tracking and fusion with sonification
|}
[[File:System setup-eps-converted-to.pdf|frame|left|AR Setup in the MRi]]

{|
|[[image:Depth Cues for projective AR Needle Navigation.png|left|600px]]
|-
|Depth Cues for projective AR Needle Navigation
|}

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

File:System setup-eps-converted-to.pdf

2017-06-30T12:04:34Z

A mewes:

System setup

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-30T10:19:36Z

A mewes: add pic

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|
* Discussion about possibilties to support depth persception (visually and auditory)
* Implementation of new depth cues
|
* Enabled kinetic depth cues for Needle Navigation Software: direct control of scene camera movement with head position tracking
* Sound connection could not be implemented during this week (had to rework parts the own code base first, took much time)
* Started to implement head tracking -> need some different hardware
* Next steps will further focus on head tracking and fusion with sonification
|}

[[File:Depth Cues for projective AR Needle Navigation.png|frame|Depth Cues for projective AR Needle Navigation]]

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

File:Depth Cues for projective AR Needle Navigation.png

2017-06-30T10:17:48Z

A mewes:

Depth Cues for projective AR Needle Navigation

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-30T08:58:31Z

A mewes:

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|
* Discussion about possibilties to support depth persception (visually and auditory)
* Implementation of new depth cues
|
* Enabled kinetic depth cues for Needle Navigation Software: direct control of scene camera movement with head position tracking
* Sound connection could not be implemented during this week (had to rework parts the own code base first, took much time)
* Started to implement head tracking -> need some different hardware
* Next steps will further focus on head tracking and fusion with sonification
|}

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-30T08:51:56Z

A mewes: /* Project Description */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|
* Discussion about possibilties to support depth persception
* Implementation of new depth cues
|
* Enabled kinetic depth cues for Needle Navigation Software: direct control of scene camera movement with head position tracking
* Sound connection could not be implemented during this week (had to rework parts the own code base first)
* Started to implement head tracking -> need some different hardware
* Next steps will focus on head tracking and fusion with sonification
|}

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

Project Week 25/Improving Depth Perception in Interventional Augmented Reality Visualization/Sonification

2017-06-26T12:54:49Z

A mewes: /* Key Investigators */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==

*[http://nist.mni.mcgill.ca/?page_id=369 Simon Drouin] (NeuroImaging and Surgical Technologies (NIST) Lab, Canada)
*[http://www.researchgate.net/profile/David_Black11 David Black] (University of Bremen; Fraunhofer Institute for Medical Image Computing MEVIS, Bremen, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|

* Disuss state of the art of "visual" AR for interventional radiology/surgery
* Find and prototype appropriate auditory display methods for efficient depth perception feedback
* Discover optimal mix between auditory and visual feedback methods for depth perception

|

|

|}

==Background and References==
[http://isgwww.cs.uni-magdeburg.de/cas/pub/2017_Black_IJCARS-Survey.pdf A Survey of Auditory Display in Image-Guided Interventions]

[http://www.sciencedirect.com/science/article/pii/S0097849317300171 Improving spatial perception of vascular models using supporting anchors and illustrative visualization]

Project Week 25/Development and Evaluation of New AR Visualization Techniques to Support Radiological Interventions

2017-06-26T08:54:10Z

A mewes: /* Project Description */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Development and valuation of new (projected or mobile) AR visualization techniques
* Supporting radiological interventions
* Exchange of ideas and idea engineering
|
* Extensive discussion about possibilities of and demand for new techniques
** Setting of goals (kind of treatment, organ of interest etc..)
** Discussion of requirements
** Conceptualization of different approaches
** Planning of tasks and work packages
** Assessment of existing visualization approaches
* '''Prototypical Implementation'''
|

|}

==Illustrations==


==Background and References==

Project Week 25/Development and Evaluation of New AR Visualization Techniques to Support Radiological Interventions

2017-06-26T08:52:07Z

A mewes: /* Project Description */

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*[http://isgwww.cs.uni-magdeburg.de/cas/ Christian Hansen] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php Florian Heinrich] (University of Magdeburg, Germany)
*[http://isgwww.cs.uni-magdeburg.de/cas/team.php André Mewes] (University of Magdeburg, Germany)
*[http://www.dkfz.de/en/mic/team/people/Marco_Nolden.html Marco Nolden] (German Cancer Research Center (DKFZ), Germany)
*[http://juanruizalzola.com/about-juan/ Juan Ruiz Alzola] (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Development and valuation of new (projected or mobile) AR visualization techniques
* Supporting radiological interventions
* Exchange of ideas and idea engineering
|
* Extensive discussion about possibilities of and demand for new techniques
** Discussion of requirements
** Conceptualization of different approaches
** Planning of tasks and work packages
** Assessment of existing visualization approaches
* Prototypical Implementation
|

|}

==Illustrations==


==Background and References==

Project Week 25/Development and Evaluation of New AR Visualization Techniques to Support Radiological Interventions

2017-06-14T12:18:53Z

A mewes: approach and plan

__NOTOC__

Back to [[Project_Week_25#Projects|Projects List]]

==Key Investigators==
*Christian Hansen (Universität Magdeburg, Germany)
*Florian Heinrich (Universität Magdeburg, Germany)
*André Mewes (Universität Magdeburg, Germany)
*Marco Nolden (DKFZ, Germany)
*Juan Ruiz Alzola (University of Las Palmas de Gran Canaria, Spain)

==Project Description==
{| class="wikitable"
! style="text-align: left; width:27%" | Objective
! style="text-align: left; width:27%" | Approach and Plan
! style="text-align: left; width:27%" | Progress and Next Steps
|- style="vertical-align:top;"
|
Development and Evaluation of new (projected or mobile) AR Visualization Techniques.
* Supporting radiological interventions
* Exchange of ideas and idea engineering
|
* Extensive discussion about possibilities of and demand for new techniques
* Discussion of requirements
* Conceptualization of different approaches
* Planning of tasks and work packages
* Prototypical Implementation
* Assessment of visualization
|

|}

==Illustrations==



==Background and References==