Difference between revisions of "OpenIGTLink/Slicer"

From NAMIC Wiki
Jump to: navigation, search
 
(146 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
[[OpenIGTLink | << OpenIGTLink]]
 
[[OpenIGTLink | << OpenIGTLink]]
  
=Introduction=
+
=Overview=
The OpenIGTLink module for Slicer 3 provides network communication with various kinds of imaging devices and manipulators that comply [[OpenIGTLink]] protocol to support real-time image display, device monitoring and device control. The module works with MRML to exchange coordinate and image data with other clinical modules e.g. NeuroNav and ProstateNav in the Slicer. The module has a dedicated graphical user interface to manage and control multiple connections.
 
  
=How to Get Started=
+
The 3D Slicer OpenIGTLink Interface Module is a program module that can handle network communications between  [http://www.slicer.org 3D Slicer] and external software / hardware using [[OpenIGTLink]] protocol. The module provides following functions:
The OpenIGTLink module is currently available in the svn branch repository named IGT2 (http://www.na-mic.org/svn/Slicer3/branches/IGT2).
 
The module is activated in default configuration and you don't need to change any setting to use it. The module is being developed on Mac OS X and Linux. It should also work on Windows, but has not sufficiently tested yet.
 
  
First, get source code using SVN. On Linux and Mac OS X, run following commands:
+
*Data import: The module can import position, linear transform and image data from [[OpenIGTLink/List| OpenIGTLink-compliant software / hardware]] to the [[NA-MIC/Projects/NA-MIC_Kit/MRML| MRML]] scene.
$ mkdir <working directory>
+
*Data export: The module can export linear transform and image data from the MRML scene.
$ cd <working directory>
+
*Multi-connection: The module can manage multiple OpenIGTLink connections at the same time.
$ svn co http://www.na-mic.org/svn/Slicer3/branches/IGT2 Slicer3
+
*Locator visualization: The user can choose one of linear transforms in the MRML scene to visualize its position and orientation in the 3D space.
 +
*Slice driving: The module can control volume re-slicing plane based on linear transform in the MRML scene.
  
Run building script:
 
$ cd Slicer3
 
$ ./Scripts/getbuildtest.tcl
 
  
It takes about 20-30 min. to complete the building process (in case of Intel Core 2 Duo 2.0 GHz).
+
[[Image:OpenIGTLink_Slicer_Screenshot.png]]
Once the building process is completed, you can lunch the Slicer by:
 
$ cd ..
 
$ cd Slicer3-build
 
$ ./Slicer3
 
  
=How to Test It=
+
=Install the Software=
You need to have OpenIGTLink server or client. We offer scanner and tracker simulator program, which can be obtained from NA-MIC SandBox.
 
  
To get the source code, run following commands:
+
==From binaries==
$ mkdir <working directory>
+
The module is available only in Slicer 3.3 source distribution.
$ svn co http://www.na-mic.org/svn/NAMICSandBox/trunk/BRPTools BRPTools
+
For Slicer 3.2, please see [[OpenIGTLink/Slicer_3_2| old page]].
  
Then configure the source code
+
==From source==
$ cd BRPTools
 
$ ccmake .
 
  
Usually, you don't need to change any setting. Just press 'c' key to configure followed by 'g' key to generate Makefiles. Press 'q' to quit the ccmake interface. Now you are ready to build the program.
+
Building instruction can be found in [[OpenIGTLink/Slicer/Build]].
$ make
 
  
  
=TODO=
+
<br>
*OpenIGTLink Client
+
 
**Most of devices (e.g. MR scanner, robot) are waiting for connection from navigation software
+
=Tutorial (for users)=
**Slicer needs GUI interface to set up address/port for OpenIGTLink connection
+
==Simulators==
*Data export through OpenIGTLink
+
 
**Each module send out image/coordinate data through MRML node
+
To test the OpenIGTLink interface module (or other OpenIGTLinkcomplaint devices and software), tracking simulator software is provided as an example program of the OpenIGTLink library (note that the OpenIGTLink library is different from the OpenIGTLink interface module in 3D Slicer).
***OpenIGTLink module monitors MRML nodes
+
 
*Connection Management Interface on Slicer 3
+
===From binaries===
*Connection to IGSTK
+
Obtain a binary file for your environment.
**IGSTK only supports Tracker Daemon
+
* [[Media:OpenIGTLinkExamples_Linux_x86_32.tgz|For Linux (x86, 32-bit)]].
*Integration with clinical modules
+
* [[Media:OpenIGTLinkExamples_Linux_x86_64.tgz|For Linux (x86, 64-bit)]].
**NeuroNav
+
* [[Media:OpenIGTLinkExamples_Win_x86_32.zip|For Windows (32-bit)]].
**ProstateNav
+
* [[Media:OpenIGTLinkExamples_Darwin_x86.tgz |For Mac OS X (x86)]].
 +
* [[Media:OpenIGTLinkExamples_Darwin_ppc.tgz |For Mac OS X (PPC)]].
 +
 
 +
===From Source===
 +
 
 +
The instruction can be found in [[OpenIGTLink/Library/Build]]. Please make sure that you enable "build examples" option.
 +
 
 +
<br>
 +
 
 +
==Show Tracking Device in the 3D Slicer==
 +
 
 +
===Set up Open IGT Link Module===
 +
 
 +
# Select "OpenIGTLinkIF" from "Modules:" menu
 +
# Open "Connector Browser" frame, and press "Add" button below the "Connectors" list to add a new connector
 +
# Configure and start the connector. Choose "Server" check box in the "Type" option, then clinck "Active" check box. Now the Slicer is ready to accept connections through Open IGT Link.
 +
 
 +
===Run Tracker Simulator===
 +
Go to OpenIGTLink binary directory.
 +
$ cd <path to OpenIGTLink-build>/bin
 +
 
 +
To send dummy coordinate data to the Slicer running on localhost with frame rate of 10 fps, run:
 +
$ ./TrackerClient  localhost 18944 10
 +
 
 +
===Visualize Tracker Position===
 +
To see the coordinate from the Tracker Simulator,
 +
# Open "Visualization / Slice Control" frame in the OpenIGTLink module interface.
 +
# Choose "Tracker (LinearTransform) from Locator Source menu in Locator Display frame.
 +
# Click the "Show Locator" check button. A locator model shows up on the 3D viewer.
 +
 
 +
<br>
 +
 
 +
=Architecture (for developers)=
 +
==Overview==
 +
The OpenIGTLink Interface module is designed to adapt to the 3D Slicer’s scene graph mechanism called Medical Reality Modeling Language (MRML) architecture. MRML provides a unified way to handle various kinds of data including images, transforms, and models in the IGT setting as MRML nodes. In order to manage multiple nodes, all MRML nodes have a tree structure. For example, the user can apply a transform to an image by placing it under the transform node as a child node. When the OpenIGTLink module receives an OpenIGTLink message, it creates a MRML node with the same name as the "device name" in the message and imports the data to the node. If a node with the same name and data type already exists, the module simply updates the data. The module also can export the data from a MRML node through the OpenIGTLink interface. This mechanism maximizes the flexibility to import/export data to/from 3D Slicer, since users can configure the MRML node tree interactively without changing the source code of the software. In addition, this mechanism makes it easy for other software modules to exchange data with external software or hardware through OpenIGTLink.
 +
 
 +
=="Connectors"==
 +
To manage multiple OpenIGTLink communications simultaneously, the OpenIGTLink Interface module handles an OpenIGTLink connection as a "connector". One connector can establish only one connection, and the user can add as many connectors as needed from the graphical user interface (GUI). Each connector can be configured as either server or client independently (Figure 1). Note that this does not mean directions of data stream; it just determines whether the module or the external software / hardware waits for (listens to) the other side to initiate the connection. Once the connection is established, there is no difference between server and client connectors.
 +
 
 +
[[image:Slicer3_OpenIGTLinkIF_Architecture.png|thumb|center|500px|'''Figure 1.''' The figure shows an example schematic diagram where multiple devices are communicating with 3D Slicer through the OpenIGTLink Interface. Each connector is assigned to one of the external devices for TCP/IP connection. The connectors serve as interfaces between the external devices and the MRML scene to convert an OpenIGTLink message to a MRML node or vice versa. ]]
 +
 
 +
From the developers' point of view, a connector is handled as an instance of vtkIGTLConnector class, which is defined in Modules/OpenIGTLinkIF/vtkIGTLConnector.cxx and vtkIGTLConnectors.h. Each instance has a thread to monitor communication with an external hardware / software.
 +
 
 +
==Event-driven==
 +
The OpenIGTLink Interface module is driven by two types of events: arrivals of OpenIGTLink messages and update events in the MRML scene. The module monitors incoming messages, and once it receives a message, it starts a deserialization process to import the data into the MRML scene as a MRML node.  Other software modules in 3D Slicer can recognize that the data has been imported into the MRML scene by catching the MRML event. The module also monitors events from MRML nodes, which the user has registered as nodes to export. When one of the nodes is updated from elsewhere in 3D Slicer, the module catches the update event and starts serializing the data into an OpenIGTLink message. The serialized data is transfered to the device through an OpenIGTLink connection.
 +
This event-driven architecture allows other software modules in 3D Slicer to exchange various kinds of data with external hardware and software without accessing the API of the OpenIGTLink interface (in other words, with little modification of the code).
 +
 
 +
=="Plug-in" OpenIGTLink-vtkMRMLNode message converter==
 +
The module has "plug-in" OpenIGTLink-vtkMRMLNode converter mechanisms, where OpenIGTLink-vtkMRMLNode converting routines are defined as classes independent from the connectors. Thus the developers can add a new data type that is handled by the OpenIGTLink interface module without modifying the module itself. All OpenIGTLink-vtkMRMLNode converting classes are child classes of '''vtkIGTLToMRMLBase''', which defines several virtual functions called by the OpenIGTLink interface module. Instances of those classes are registered before receiving OpenIGTLink messages or exporting vtkMRMLnode.
 +
 
 +
The following member functions are defined in classes derived from vtkIGTLToMRMLBase class:
 +
 
 +
  virtual const char*  GetIGTLName();
 +
  virtual const char* GetMRMLName();
 +
  virtual vtkIntArray* GetNodeEvents();
 +
  virtual vtkMRMLNode* CreateNewNode(vtkMRMLScene* scene, const char* name);
 +
  virtual int          IGTLToMRML(igtl::MessageBase::Pointer buffer, vtkMRMLNode* node);
 +
  virtual int          MRMLToIGTL(unsigned long event, vtkMRMLNode* mrmlNode, int* size, void** igtlMsg);
 +
 
 +
'''GetIGTLName()''' and '''GetMRMLName()''' are functions to get the character strings of "device name" of OpenIGTLink messages and "node tag name" of MRML nodes handled by the class. For example, in the case of the position data type, GetIGTLName() returns "POSITION" and GetMRMLName() returns "vtkMRMLLinearTransform", meaning that the class can convert an OpenIGTLink message with the device name "POSITION" into a MRML node with tag name '''LinearTransform''' and vice versa. '''GetNodeEvents()''' is a function to get a list of events to invoke the routine to convert the MRML node into an OpenIGTLink message, which is defined in '''MRMLToIGTL()'''. '''CreateNewNode()''' function defines a routine to create a new MRML node, when the OpenIGTLink module cannot find a MRML node to store the received data. Data conversion from OpenIGTLink message to MRML node and MRML node to OpenIGTLink message are defined as '''IGTLToMRML()''' and '''MRMLToIGTL()'''.
 +
 
 +
OpenIGTLink-vtkMRMLNode converter classes can be registered from other program modules using a member function of vtkOpenIGTLinkIFLogic class as (NOTE "IGTLLogic is a pointer to the OpenIGTLinkIFLogic class):
 +
 
 +
  vtkIGTLToMRMLLinearTransform* LinearTransformConverter = vtkIGTLToMRMLLinearTransform::New();
 +
  vtkIGTLToMRMLImage* ImageConverter = vtkIGTLToMRMLImage::New();
 +
  vtkIGTLToMRMLPosition* PositionConverter = vtkIGTLToMRMLPosition::New();
 +
  IGTLLogic->RegisterMessageConverter(LinearTransformConverter);
 +
  IGTLLogic->RegisterMessageConverter(ImageConverter);
 +
  IGTLLogic->RegisterMessageConverter(PositionConverter);
 +
 
 +
=Loadmap/Action items=
 +
*Abstracted I/O -- allows users to switch between network I/O and file I/O. It can be useful to support logging function.
 +
 
 +
<BR>
 +
 
 +
=Other Resources=
 +
*[[OpenIGTLink/Simulators]]
  
 
=People=
 
=People=
 
*[http://www.spl.harvard.edu/pages/People/tokuda  Junichi Tokuda]
 
*[http://www.spl.harvard.edu/pages/People/tokuda  Junichi Tokuda]
 
*[http://www.spl.harvard.edu/pages/People/hliu Haiying Liu]
 
*[http://www.spl.harvard.edu/pages/People/hliu Haiying Liu]

Latest revision as of 01:38, 23 December 2008

Home < OpenIGTLink < Slicer

<< OpenIGTLink

Overview

The 3D Slicer OpenIGTLink Interface Module is a program module that can handle network communications between 3D Slicer and external software / hardware using OpenIGTLink protocol. The module provides following functions:

  • Data import: The module can import position, linear transform and image data from OpenIGTLink-compliant software / hardware to the MRML scene.
  • Data export: The module can export linear transform and image data from the MRML scene.
  • Multi-connection: The module can manage multiple OpenIGTLink connections at the same time.
  • Locator visualization: The user can choose one of linear transforms in the MRML scene to visualize its position and orientation in the 3D space.
  • Slice driving: The module can control volume re-slicing plane based on linear transform in the MRML scene.


OpenIGTLink Slicer Screenshot.png

Install the Software

From binaries

The module is available only in Slicer 3.3 source distribution. For Slicer 3.2, please see old page.

From source

Building instruction can be found in OpenIGTLink/Slicer/Build.



Tutorial (for users)

Simulators

To test the OpenIGTLink interface module (or other OpenIGTLinkcomplaint devices and software), tracking simulator software is provided as an example program of the OpenIGTLink library (note that the OpenIGTLink library is different from the OpenIGTLink interface module in 3D Slicer).

From binaries

Obtain a binary file for your environment.

From Source

The instruction can be found in OpenIGTLink/Library/Build. Please make sure that you enable "build examples" option.


Show Tracking Device in the 3D Slicer

Set up Open IGT Link Module

  1. Select "OpenIGTLinkIF" from "Modules:" menu
  2. Open "Connector Browser" frame, and press "Add" button below the "Connectors" list to add a new connector
  3. Configure and start the connector. Choose "Server" check box in the "Type" option, then clinck "Active" check box. Now the Slicer is ready to accept connections through Open IGT Link.

Run Tracker Simulator

Go to OpenIGTLink binary directory.

$ cd <path to OpenIGTLink-build>/bin

To send dummy coordinate data to the Slicer running on localhost with frame rate of 10 fps, run:

$ ./TrackerClient  localhost 18944 10

Visualize Tracker Position

To see the coordinate from the Tracker Simulator,

  1. Open "Visualization / Slice Control" frame in the OpenIGTLink module interface.
  2. Choose "Tracker (LinearTransform) from Locator Source menu in Locator Display frame.
  3. Click the "Show Locator" check button. A locator model shows up on the 3D viewer.


Architecture (for developers)

Overview

The OpenIGTLink Interface module is designed to adapt to the 3D Slicer’s scene graph mechanism called Medical Reality Modeling Language (MRML) architecture. MRML provides a unified way to handle various kinds of data including images, transforms, and models in the IGT setting as MRML nodes. In order to manage multiple nodes, all MRML nodes have a tree structure. For example, the user can apply a transform to an image by placing it under the transform node as a child node. When the OpenIGTLink module receives an OpenIGTLink message, it creates a MRML node with the same name as the "device name" in the message and imports the data to the node. If a node with the same name and data type already exists, the module simply updates the data. The module also can export the data from a MRML node through the OpenIGTLink interface. This mechanism maximizes the flexibility to import/export data to/from 3D Slicer, since users can configure the MRML node tree interactively without changing the source code of the software. In addition, this mechanism makes it easy for other software modules to exchange data with external software or hardware through OpenIGTLink.

"Connectors"

To manage multiple OpenIGTLink communications simultaneously, the OpenIGTLink Interface module handles an OpenIGTLink connection as a "connector". One connector can establish only one connection, and the user can add as many connectors as needed from the graphical user interface (GUI). Each connector can be configured as either server or client independently (Figure 1). Note that this does not mean directions of data stream; it just determines whether the module or the external software / hardware waits for (listens to) the other side to initiate the connection. Once the connection is established, there is no difference between server and client connectors.

Figure 1. The figure shows an example schematic diagram where multiple devices are communicating with 3D Slicer through the OpenIGTLink Interface. Each connector is assigned to one of the external devices for TCP/IP connection. The connectors serve as interfaces between the external devices and the MRML scene to convert an OpenIGTLink message to a MRML node or vice versa.

From the developers' point of view, a connector is handled as an instance of vtkIGTLConnector class, which is defined in Modules/OpenIGTLinkIF/vtkIGTLConnector.cxx and vtkIGTLConnectors.h. Each instance has a thread to monitor communication with an external hardware / software.

Event-driven

The OpenIGTLink Interface module is driven by two types of events: arrivals of OpenIGTLink messages and update events in the MRML scene. The module monitors incoming messages, and once it receives a message, it starts a deserialization process to import the data into the MRML scene as a MRML node. Other software modules in 3D Slicer can recognize that the data has been imported into the MRML scene by catching the MRML event. The module also monitors events from MRML nodes, which the user has registered as nodes to export. When one of the nodes is updated from elsewhere in 3D Slicer, the module catches the update event and starts serializing the data into an OpenIGTLink message. The serialized data is transfered to the device through an OpenIGTLink connection. This event-driven architecture allows other software modules in 3D Slicer to exchange various kinds of data with external hardware and software without accessing the API of the OpenIGTLink interface (in other words, with little modification of the code).

"Plug-in" OpenIGTLink-vtkMRMLNode message converter

The module has "plug-in" OpenIGTLink-vtkMRMLNode converter mechanisms, where OpenIGTLink-vtkMRMLNode converting routines are defined as classes independent from the connectors. Thus the developers can add a new data type that is handled by the OpenIGTLink interface module without modifying the module itself. All OpenIGTLink-vtkMRMLNode converting classes are child classes of vtkIGTLToMRMLBase, which defines several virtual functions called by the OpenIGTLink interface module. Instances of those classes are registered before receiving OpenIGTLink messages or exporting vtkMRMLnode.

The following member functions are defined in classes derived from vtkIGTLToMRMLBase class:

 virtual const char*  GetIGTLName();
 virtual const char*  GetMRMLName();
 virtual vtkIntArray* GetNodeEvents();
 virtual vtkMRMLNode* CreateNewNode(vtkMRMLScene* scene, const char* name);
 virtual int          IGTLToMRML(igtl::MessageBase::Pointer buffer, vtkMRMLNode* node);
 virtual int          MRMLToIGTL(unsigned long event, vtkMRMLNode* mrmlNode, int* size, void** igtlMsg);

GetIGTLName() and GetMRMLName() are functions to get the character strings of "device name" of OpenIGTLink messages and "node tag name" of MRML nodes handled by the class. For example, in the case of the position data type, GetIGTLName() returns "POSITION" and GetMRMLName() returns "vtkMRMLLinearTransform", meaning that the class can convert an OpenIGTLink message with the device name "POSITION" into a MRML node with tag name LinearTransform and vice versa. GetNodeEvents() is a function to get a list of events to invoke the routine to convert the MRML node into an OpenIGTLink message, which is defined in MRMLToIGTL(). CreateNewNode() function defines a routine to create a new MRML node, when the OpenIGTLink module cannot find a MRML node to store the received data. Data conversion from OpenIGTLink message to MRML node and MRML node to OpenIGTLink message are defined as IGTLToMRML() and MRMLToIGTL().

OpenIGTLink-vtkMRMLNode converter classes can be registered from other program modules using a member function of vtkOpenIGTLinkIFLogic class as (NOTE "IGTLLogic is a pointer to the OpenIGTLinkIFLogic class):

 vtkIGTLToMRMLLinearTransform* LinearTransformConverter = vtkIGTLToMRMLLinearTransform::New();
 vtkIGTLToMRMLImage* ImageConverter = vtkIGTLToMRMLImage::New();
 vtkIGTLToMRMLPosition* PositionConverter = vtkIGTLToMRMLPosition::New();
 IGTLLogic->RegisterMessageConverter(LinearTransformConverter);
 IGTLLogic->RegisterMessageConverter(ImageConverter);
 IGTLLogic->RegisterMessageConverter(PositionConverter);

Loadmap/Action items

  • Abstracted I/O -- allows users to switch between network I/O and file I/O. It can be useful to support logging function.


Other Resources

People