Difference between revisions of "2013 Project Week:SteeredRegistration"

From NAMIC Wiki
Jump to: navigation, search
 
(27 intermediate revisions by 2 users not shown)
Line 8: Line 8:
 
Image:translate-after.png‎|After translation from user input
 
Image:translate-after.png‎|After translation from user input
 
</gallery>
 
</gallery>
−
 
−
 
  
 
==Key Investigators==
 
==Key Investigators==
−
*Technical University of Munich: Guillaume Pernelle
+
* GRC: Dirk Padfield, Jim Miller
−
* BWH: [http://www.spl.harvard.edu/pages/People/gpernelle Guillaume Pernelle], Jan Egger, Tina Kapur
 
 
* Isomics: Steve Pieper
 
* Isomics: Steve Pieper
−
* GRC: Kunlin Cao, Jim Miller
+
* BWH: Tina Kapur, Ron Kikinis
−
 
 
  
 
<div style="margin: 20px;">
 
<div style="margin: 20px;">
Line 22: Line 18:
  
 
<h3>Objective</h3>
 
<h3>Objective</h3>
−
We are developing methods to perform interactive registration in 3D Slicer. The final goal is to provide user an interface to interact with the registration program during the matching progress, in case the result from automatic registration is not satisfactory.  
+
We are developing methods to perform interactive registration in 3D Slicer. The final goal is to provide the user an interface to interact with the registration program during the matching progress.  This will enable the user to run the automated registration and to correct it real-time through gestures.
−
 
 
−
 
 
−
 
 
  
  
Line 34: Line 27:
 
<h3>Approach, Plan</h3>
 
<h3>Approach, Plan</h3>
  
−
Our approach for developing interactive registration module is to first construct the loadable extension to perform intensity-based registration, display the intermediate results, and allow user to pause the progress if the intermediate results are visually unsatisfactory. User inputs such as translation and rotation by dragging the mouse will be fed into the registration, and be used to correct the current transformation.  Registration will continue to run starting from the corrected transform.
+
Our approach for developing the interactive registration module is to first construct the loadable extension to perform intensity-based registration, display the intermediate results, and allow the user to correct the progress at any point if the intermediate results are visually unsatisfactory. Providing translation, rotation, and scale for rigid registration and perhaps landmarks or directional markers for deformable registration will be enabled by mouse click and drag gestures.  These will be used to correct/update the current transformation, which will then be fed back as the update to the automated registration algorithm.  The goal is to have short delays in the user interaction by continually running short automated registration iterations followed by any user interactions waiting in the event cue.  As a test the user could drag the images apart, watch them become aligned again, and then drag them apart again.  The module is particuarly useful when the registration algorithm goes astray since the user can then quickly bring the images back into approximate alignment and let the automated algorithm compute the fine registration.
  
 
</div>
 
</div>
Line 41: Line 34:
  
 
<h3>Progress</h3>
 
<h3>Progress</h3>
−
At the end of this week, we have a better understanding of the problems we are facing. We accomplished to have the first step of the steered registration which is the translation (illustrated above: "Interaction: Translate").  
+
So far, we have implemented user interaction for translation, rotation, and scale.  To avoid having to move back and forth from the image to the GUI in order to switch between translation, rotation, and scale, we tested a vtkAffineWidget that represents these interactions in a widget that feeds back to the images (see figures).  We also looked at the interactive registration available in Slicer2 to see which parts of that framework could be replicated in Slicer4.  In the next step, we plan to have a first version of the interaction loop that integrates the automated registration with the manual feedback.  
  
 +
</div>
 +
</div>
 +
 +
<gallery widths=240px heights=240px caption="vtkAffineWidget">
 +
Image:AffineWidgetStart.bmp | Affine widget
 +
Image:AffineWidgetRotate.bmp | Rotation
 +
Image:AffineWidgetScale.bmp | Scaling
 +
Image:AffineWidgetTranslate.bmp | Translation
 +
Image:AffineWidgetEnd.bmp | End
 +
</gallery>
 +
 +
 +
<gallery widths=500px heights=500px caption="Previous Interactive Registration">
 +
Image:InteractiveRegistration.png | Previous interaction
 +
</gallery>
  
  
−
</div>
+
<gallery widths=500px heights=500px caption="Slicer2 Interactive Registration">
−
</div>
+
Image:Slicer2InteractiveRegistration1.jpg | Interaction GUI
 +
Image:Slicer2InteractiveRegistration2.jpg | Viewer
 +
</gallery>
  
 
==Delivery Mechanism==
 
==Delivery Mechanism==

Latest revision as of 17:12, 11 January 2013

Home < 2013 Project Week:SteeredRegistration

  • Interaction: Translate

  • Interaction: Rotate

  • Interaction: Landmark marking

  • Before translation from user input

  • After translation from user input

Key Investigators

  • GRC: Dirk Padfield, Jim Miller
  • Isomics: Steve Pieper
  • BWH: Tina Kapur, Ron Kikinis

Objective

We are developing methods to perform interactive registration in 3D Slicer. The final goal is to provide the user an interface to interact with the registration program during the matching progress. This will enable the user to run the automated registration and to correct it real-time through gestures.


Approach, Plan

Our approach for developing the interactive registration module is to first construct the loadable extension to perform intensity-based registration, display the intermediate results, and allow the user to correct the progress at any point if the intermediate results are visually unsatisfactory. Providing translation, rotation, and scale for rigid registration and perhaps landmarks or directional markers for deformable registration will be enabled by mouse click and drag gestures. These will be used to correct/update the current transformation, which will then be fed back as the update to the automated registration algorithm. The goal is to have short delays in the user interaction by continually running short automated registration iterations followed by any user interactions waiting in the event cue. As a test the user could drag the images apart, watch them become aligned again, and then drag them apart again. The module is particuarly useful when the registration algorithm goes astray since the user can then quickly bring the images back into approximate alignment and let the automated algorithm compute the fine registration.

Progress

So far, we have implemented user interaction for translation, rotation, and scale. To avoid having to move back and forth from the image to the GUI in order to switch between translation, rotation, and scale, we tested a vtkAffineWidget that represents these interactions in a widget that feeds back to the images (see figures). We also looked at the interactive registration available in Slicer2 to see which parts of that framework could be replicated in Slicer4. In the next step, we plan to have a first version of the interaction loop that integrates the automated registration with the manual feedback.

  • vtkAffineWidget

  • Affine widget

  • Rotation

  • Scaling

  • Translation

  • End


  • Previous Interactive Registration

  • Previous interaction


  • Slicer2 Interactive Registration

  • Interaction GUI

  • Viewer

Delivery Mechanism

This work will be delivered to the NA-MIC Kit as a (please select the appropriate options by noting YES against them below)

  1. ITK Module
  2. Slicer Module
    1. Built-in
    2. Extension -- commandline
    3. Extension -- loadable YES
  3. Other (Please specify)

References

Retrieved from "https://www.na-mic.org/w/index.php?title=2013_Project_Week:SteeredRegistration&oldid=80086"