Difference between revisions of "Gestural Point of Care Interface for IGT"

From NAMIC Wiki
Jump to: navigation, search
 
(19 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
 
<gallery>
 
<gallery>
Image:PW-MIT2014.png|[[2014_Summer_Project_Week#Projects|Projects List]]
+
Image:Leap.PNG| Menu for controlling various functions
Image:Leap.PNG
+
Image:GestureMenuPhoto_1.jpg|Radial gesture menu
Image:LeapMotionSlicerDemo01.png|Slicer controlled by Leap Motion http://www.youtube.com/watch?v=BG8udCVo1gg
+
Image:GestureMenuScreenshot_1.png|Screenshot view of radial menu
 +
Image:DicomExplorerScreenshot_1.png|Leap controlled DICOM browser
 +
File:DicomExplorer_1.ogg|Video of prototype DICOM browser
 
</gallery>
 
</gallery>
 +
  
 
==Key Investigators==
 
==Key Investigators==
Line 11: Line 14:
 
* Steve Pieper
 
* Steve Pieper
 
* Tobias Penzkofer
 
* Tobias Penzkofer
 +
* Andras Lasso
  
 
==Project Description==
 
==Project Description==
 
<div style="margin: 20px;">
 
<div style="margin: 20px;">
 
<div style="width: 27%; float: left; padding-right: 3%;">
 
<div style="width: 27%; float: left; padding-right: 3%;">
<h3>Objective</h3>
+
<h3>Objective</h3>Multimodal interventions have to deal with an increased amount of information that needs to be consumed during the intervention. The sterile conditions during the procedures prevent the surgeon/interventionalist from using traditional input devices like mice or conventional touch screens. This project aims to investigate new input devices, which can be used touchless or can be sterilized for use during IGT cases with Slicer 4.
* To investigate new input devices (touchless, sterile) for use during IGT cases with Slicer 4
 
 
</div>
 
</div>
 
<div style="width: 27%; float: left; padding-right: 3%;">
 
<div style="width: 27%; float: left; padding-right: 3%;">
 
<h3>Approach, Plan</h3>
 
<h3>Approach, Plan</h3>
 
* Common interface, testing and evaluation of devices
 
* Common interface, testing and evaluation of devices
 +
* Create prototype implementations of touchless interfaces using the Leap Motion Controller
 +
* Evaluate gestures to select the most effective movements for a touchless interface
 +
* Evaluate potential tasks that may benefit from a touchless interface
 
</div>
 
</div>
 
<div style="width: 27%; float: left; padding-right: 3%;">
 
<div style="width: 27%; float: left; padding-right: 3%;">
 
<h3>Progress</h3>
 
<h3>Progress</h3>
* tbd
+
* Prototype interfaces for actions within Slicer have been developed
 +
* Investigated use of Leap Motion for DICOM browsing
 +
** Prototype Leap-controlled DICOM browsers created
 +
* Set up parameters for quantitative evaluation of gesture control implementations
 
</div>
 
</div>
 
</div>
 
</div>

Latest revision as of 02:20, 27 June 2014

Home < Gestural Point of Care Interface for IGT


Key Investigators

  • Saskia Camps
  • Franklin King
  • Steve Pieper
  • Tobias Penzkofer
  • Andras Lasso

Project Description

Objective

Multimodal interventions have to deal with an increased amount of information that needs to be consumed during the intervention. The sterile conditions during the procedures prevent the surgeon/interventionalist from using traditional input devices like mice or conventional touch screens. This project aims to investigate new input devices, which can be used touchless or can be sterilized for use during IGT cases with Slicer 4.

Approach, Plan

  • Common interface, testing and evaluation of devices
  • Create prototype implementations of touchless interfaces using the Leap Motion Controller
  • Evaluate gestures to select the most effective movements for a touchless interface
  • Evaluate potential tasks that may benefit from a touchless interface

Progress

  • Prototype interfaces for actions within Slicer have been developed
  • Investigated use of Leap Motion for DICOM browsing
    • Prototype Leap-controlled DICOM browsers created
  • Set up parameters for quantitative evaluation of gesture control implementations