Difference between revisions of "Projects:RegistrationLibrary:RegLib C12"

From NAMIC Wiki
Jump to: navigation, search
m (Text replacement - "http://www.slicer.org/slicerWiki/index.php/" to "https://www.slicer.org/wiki/")
 
(20 intermediate revisions by one other user not shown)
Line 3: Line 3:
 
[[Projects:RegistrationDocumentation:UseCaseInventory|Back to Registration Use-case Inventory]] <br>
 
[[Projects:RegistrationDocumentation:UseCaseInventory|Back to Registration Use-case Inventory]] <br>
  
−
==Slicer Registration Use Case Exampe #12: Liver Tumor Cryoablation ==
+
==<small>updated for '''v4.1'''</small> [[Image:Slicer4_RegLibLogo.png|150px]] <br>  Slicer Registration Library Case #12: Liver Tumor Cryoablation ==
  
−
{| style="color:#bbbbbb; background-color:#333333;" cellpadding="10" cellspacing="0" border="0"
+
=== Input ===
−
|[[Image:RegLib_C12_LiverTumor_MRI.png|200px|lleft|this is the fixed reference image. All images are aligned into this space]]  
+
{| style="color:#bbbbbb; " cellpadding="10" cellspacing="0" border="0"
−
|[[Image:Arrow_left_gray.jpg|100px|lleft]]  
+
|[[Image:RegLib_C12_Thumb1.png|150px|lleft|this is a pre-op CT + contrast reference image. All images are aligned into this space]]  
−
|[[Image:RegLib_C12_LiverTumor_CTpre.png|200px|lleft|this is the moving image. The transform is calculated by matching this to the reference image]]
+
|[[Image:RegArrow_NonRigid.png|100px|lleft]]  
−
|[[Image:RegLib_C12_LiverTumor_CTcontrast-pre.png|200px|lleft|this is the moving image. The transform is calculated by matching this to the reference image]]
+
|[[Image:RegLib_C12_Thumb2.png|150px|lleft|this is the pre-op MRI we seek to align with the CT]]
−
|align="left"|LEGEND<br>
 
−
[[Image:Button_red_fixed.jpg|20px|lleft]]  this indicates the reference image that is fixed and does not move. All other images are aligned into this space and resolution<br>
 
−
[[Image:Button_green_moving.jpg|20px|lleft]] this indicates the moving image that determines the registration transform.  <br>
 
 
|-
 
|-
−
|[[Image:Button_red_fixed.jpg|40px|lleft]]  intra-op MRI
+
|fixed image/target
 
|
 
|
−
|[[Image:Button_green_moving.jpg|40px|lleft]] pre-op CT
+
|moving image
−
|[[Image:Button_green_moving.jpg|40px|lleft]] pre-op CT+contrast
 
−
|-
 
−
|0.78 x 0.78 x 2.5 mm<br> 512 x 512 x 96<br>RAS
 
−
|
 
−
|0.95 x 0.95 x 5 mm<br> 512 x 512 x 41<br>RAS
 
−
|0.95 x 0.95 x 5 mm<br> 512 x 512 x 42<br>RAS
 
 
|}
 
|}
 +
 +
=== Slicer4 Modules used ===
 +
* [http://wiki.slicer.org/slicerWiki/index.php/Documentation/4.1/Modules/BRAINSFit General Registration (BRAINS) module]
 +
 +
===Download ===
 +
*[[Media:RegLib_C12_Data.zip|'''download input image data'''  <small> (Input Data, Masks, Solution Transforms, Resampled results (NRRD images,  zip file 65 MB) </small>]]
 +
 
===Objective / Background ===
 
===Objective / Background ===
−
We seek to align the pre-operative CT with the intra-operative MRI.  
+
We seek to align a pre-operative MRI with a contrast enhanced CT for surgical guidance.
  
 
=== Keywords ===
 
=== Keywords ===
Line 31: Line 29:
  
 
===Input Data===
 
===Input Data===
−
*[[Image:Button_red_fixed_white.jpg|20px]]reference/fixed : intra-op MRI, 0.78 x 0.78 x 2.5 mm axial, RAS orientation.
+
*reference/fixed : pr-op CT, 0.95 x 0.95 x 5 mm voxel size
−
*[[Image:Button_green_moving_white.jpg|20px]] moving: pr-op CT, 0.95 x 0.95 x 5 mm voxel size, axial, RAS orientation.
+
*moving: intra-op MRI, 0.78 x 0.78 x 2.5 mm axial,  
−
 
 
−
=== Methods ===
 
−
#
 
−
=== Registration Results===
 
−
[
 
−
===Download ===
 
−
*'''[[Media:RegLib_C12_LiverTumor_DATA.zip|download input image data  <small> (Input Data, NRRD images,  zip file 42 MB) </small>]]'''
 
−
*'''[[Media:RegLib_C12_LiverTumorAblation1_ParameterPresets.mrml|download registration parameter presets file  <small> (.mrml  file 20 kB) </small>]]'''
 
−
*'''[[Media:RegLib_C12_LiverTumorAblation1_Tutorial.ppt|download guided tutorial  <small> (PowerPoint,  xx MB) </small>]]'''
 
−
*'''[[Media:RegLib_C12_LiverTumorAblation1_Set.zip| download full tutorial set  <small> (Input Data, presets, results, tutorial,  zip file xx MB) </small>]]'''
 
−
 
 
−
[[Projects:RegistrationDocumentation:ParameterPresetsTutorial|Link to User Guide: How to Load/Save Registration Parameter Presets]]
 
−
 
 
−
<!--
 
−
comment
 
−
-->
 
  
 
=== Discussion: Registration Challenges ===
 
=== Discussion: Registration Challenges ===
Line 56: Line 38:
 
*we have strongly anisotropic voxel sizes with much less through-plane resolution
 
*we have strongly anisotropic voxel sizes with much less through-plane resolution
  
−
=== Discussion: Key Strategies ===
+
=== Notes / Overall Strategy ===
−
*
+
*masking is required to focus the registration algorithm on the structure of interest
 +
*Overall strategy:
 +
:#obtain (manual) a coarse segmentation of the liver in both MRI and CT. Dilate by a few pixels to include the organ boundary
 +
:#perform a manual initial alignment of MR to CT. Use this alignment as starting point for the automated registration
 +
:#run an affine registration with above masks and intial alignment
 +
#run a non-rigid BSpline registration with above affine alignment as starting point
 +
 
 +
 
 +
=== Procedures ===
 +
*'''Phase I: Build Masks'''
 +
: Note: for illustration the example set contains 2 masks: one with only the liver and one also including spleen and kidney (Mask2).  As shown in the results below, the liver-only mask is insufficiently constraining the registration, yielding a result that at first glance looks ok for the liver, but has significant misalignment in the remaining abdominal area. Hence it is advisable to stabilize the registration further by including more structures with good contrast in both images (Spleen, Kidney).
 +
#open the [http://wiki.slicer.org/slicerWiki/index.php/Documentation/4.1/Modules/Editor Editor module]
 +
#select  "MRI" as the master volume ; a new "MRI_label" is created
 +
#using the Brush tool, trace the liver contour from axial slices. Also include kidneys and spleen.
 +
#repeat the same for the CT.
 +
#you should end up with 2 label maps similar to those included in the example dataset. See snapshots in Result section below.
 +
#save the label maps as "MRI-label.nrrd" or similar
 +
#registration masks ideally extend beyond the structure boundary:
 +
#select the ''Dilate'' tool and click ''Apply'' 3-4 times to extend the mask area
 +
#repeat for both masks
 +
#In the  [https://www.slicer.org/wiki/Modules:Editor-Documentation-3.6 ''Editor'' module], use the ''Dilate'' function to expand the outline by 2-3 pixels (click on ''Apply'' button 2-3 times)
 +
#save dilated labelmasks under new name (e.g. CT_mask.nrrd)
 +
*'''Phase II: MR-CTpre registration''' (Affine)
 +
#open the [http://wiki.slicer.org/slicerWiki/index.php/Documentation/4.1/Modules/BRAINSFit General Registration (BRAINS) module]
 +
##''Fixed Image Volume'': CT
 +
##''Moving Image Volume'': MRI
 +
##Output Settings:
 +
###''Slicer BSpline Transform": none
 +
###''Slicer Linear Transform'': create new transform, rename to "Xf1_MRI-CT_Affine"
 +
###''Output Image Volume'': create new volume,  rename to "MRI_Xf1" (we use this for ease of validation only)
 +
##''Initialization'': select the ''useCenterOfROIAlign''
 +
##''Registration Phases'': check boxes for ''Rigid'' , ''Rigid+Scale'' and ''Affine''
 +
##''Mask Option'': select ''ROI'' button
 +
###''(ROI)Masking input fixed'': CT_mask
 +
###''(ROI)Masking input moving'': MRI_mask
 +
##Leave all other settings at default
 +
##click: Apply; runtime < 1 min (MacPro QuadCore 2.4GHz)
 +
##this should generate a first alignment.
 +
*'''Phase III: Nonrigid Registration'''
 +
#open the [http://wiki.slicer.org/slicerWiki/index.php/Documentation/4.1/Modules/BRAINSFit General Registration (BRAINS) module]
 +
##''Fixed Image Volume'': CT
 +
##''Moving Image Volume'': MRI
 +
##Output Settings:
 +
###''Slicer BSpline Transform": create new transform, rename to "Xf2_MRI-CT_BSpline"
 +
###''Slicer Linear Transform'': none
 +
###''Output Image Volume'': create new volume,  rename to "MRI_Xf2"
 +
##''Initialization'':
 +
###''Initialization Transform'': select  "Xf1_MRI-CT_Affine" created in Phase II above
 +
###''Initialization Transform Mode'': Off
 +
##''Registration Phases'': check boxes for ''BSpline'' only
 +
##''Main Parameters'':
 +
###''Number Of Samples'': 200,000
 +
###''B-Spline Grid Size'': 7,7,3
 +
##''Mask Option'': select ''ROI'' button
 +
###''(ROI)Masking input fixed'': CT_mask
 +
###''(ROI)Masking input moving'': MRI_mask
 +
##Leave all other settings at default
 +
##click: Apply
 +
 
 +
=== Registration Results===
 +
{| style="color:#bbbbbb; " cellpadding="10" cellspacing="0" border="0"
 +
|[[Image:RegLib_C12_unregistered.gif|300px|left|unregistered MRI & CT]]
 +
|unregistered MRI & CT
 +
|-
 +
|[[Image:RegLib_C12_Masks.png|300px|left|registration masks]]
 +
|registration masks
 +
|-
 +
|[[Image:RegLib_C12_Affine.gif|300px|left|affine registered MRI & CT]]
 +
|affine registered MRI & CT
 +
|-
 +
|[[Image:RegLib_C12_BSpline.gif|300px|left|nonrigid registered MRI & CT]]
 +
|nonrigid registered MRI & CT
 +
|-
 +
|[[Image:RegLib_C12_ConstrainFailure.gif|300px|left|insufficient mask: nonrigid registered with liver mask only, note the misalignment in the remaining abdomen]]
 +
|insufficient mask: nonrigid registered with liver mask only, note the misalignment in the remaining abdomen
 +
|-
 +
|[[Image:RegLib_C12_ColorOverlay.gif|300px|left|Color overlay of registered MRI onto CT, illustrating the fusion: MRI soft tissue contrast shows substructures & vasculature invisible on the CT]]
 +
|Color overlay of registered MRI onto CT, illustrating the fusion: MRI soft tissue contrast shows substructures & vasculature invisible on the CT
 +
|}
 +
 
 +
 
 +
=== Acknowledgments ===
 +
Thanks to Dr.Stuart Silverman and Dr. Nobuhiko Hata for sharing this case.

Latest revision as of 18:04, 10 July 2017

Home < Projects:RegistrationLibrary:RegLib C12

Back to ARRA main page
Back to Registration main page
Back to Registration Use-case Inventory

updated for v4.1 Slicer4 RegLibLogo.png
Slicer Registration Library Case #12: Liver Tumor Cryoablation

Input

this is a pre-op CT + contrast reference image. All images are aligned into this space lleft this is the pre-op MRI we seek to align with the CT
fixed image/target moving image

Slicer4 Modules used

Download

Objective / Background

We seek to align a pre-operative MRI with a contrast enhanced CT for surgical guidance.

Keywords

MRI, CT, IGT, intra-operative, liver, cryoablation, change detection, non-rigid registration

Input Data

  • reference/fixed : pr-op CT, 0.95 x 0.95 x 5 mm voxel size
  • moving: intra-op MRI, 0.78 x 0.78 x 2.5 mm axial,

Discussion: Registration Challenges

  • large differences in FOV
  • strong differences in image contrast between MRI & CT
  • contrast enhancement and pathology and treatment changes cause additional differences in image content
  • we have strongly anisotropic voxel sizes with much less through-plane resolution

Notes / Overall Strategy

  • masking is required to focus the registration algorithm on the structure of interest
  • Overall strategy:
  1. obtain (manual) a coarse segmentation of the liver in both MRI and CT. Dilate by a few pixels to include the organ boundary
  2. perform a manual initial alignment of MR to CT. Use this alignment as starting point for the automated registration
  3. run an affine registration with above masks and intial alignment
  1. run a non-rigid BSpline registration with above affine alignment as starting point


Procedures

  • Phase I: Build Masks
Note: for illustration the example set contains 2 masks: one with only the liver and one also including spleen and kidney (Mask2). As shown in the results below, the liver-only mask is insufficiently constraining the registration, yielding a result that at first glance looks ok for the liver, but has significant misalignment in the remaining abdominal area. Hence it is advisable to stabilize the registration further by including more structures with good contrast in both images (Spleen, Kidney).
  1. open the Editor module
  2. select "MRI" as the master volume ; a new "MRI_label" is created
  3. using the Brush tool, trace the liver contour from axial slices. Also include kidneys and spleen.
  4. repeat the same for the CT.
  5. you should end up with 2 label maps similar to those included in the example dataset. See snapshots in Result section below.
  6. save the label maps as "MRI-label.nrrd" or similar
  7. registration masks ideally extend beyond the structure boundary:
  8. select the Dilate tool and click Apply 3-4 times to extend the mask area
  9. repeat for both masks
  10. In the Editor module, use the Dilate function to expand the outline by 2-3 pixels (click on Apply button 2-3 times)
  11. save dilated labelmasks under new name (e.g. CT_mask.nrrd)
  • Phase II: MR-CTpre registration (Affine)
  1. open the General Registration (BRAINS) module
    1. Fixed Image Volume: CT
    2. Moving Image Volume: MRI
    3. Output Settings:
      1. Slicer BSpline Transform": none
      2. Slicer Linear Transform: create new transform, rename to "Xf1_MRI-CT_Affine"
      3. Output Image Volume: create new volume, rename to "MRI_Xf1" (we use this for ease of validation only)
    4. Initialization: select the useCenterOfROIAlign
    5. Registration Phases: check boxes for Rigid , Rigid+Scale and Affine
    6. Mask Option: select ROI button
      1. (ROI)Masking input fixed: CT_mask
      2. (ROI)Masking input moving: MRI_mask
    7. Leave all other settings at default
    8. click: Apply; runtime < 1 min (MacPro QuadCore 2.4GHz)
    9. this should generate a first alignment.
  • Phase III: Nonrigid Registration
  1. open the General Registration (BRAINS) module
    1. Fixed Image Volume: CT
    2. Moving Image Volume: MRI
    3. Output Settings:
      1. Slicer BSpline Transform": create new transform, rename to "Xf2_MRI-CT_BSpline"
      2. Slicer Linear Transform: none
      3. Output Image Volume: create new volume, rename to "MRI_Xf2"
    4. Initialization:
      1. Initialization Transform: select "Xf1_MRI-CT_Affine" created in Phase II above
      2. Initialization Transform Mode: Off
    5. Registration Phases: check boxes for BSpline only
    6. Main Parameters:
      1. Number Of Samples: 200,000
      2. B-Spline Grid Size: 7,7,3
    7. Mask Option: select ROI button
      1. (ROI)Masking input fixed: CT_mask
      2. (ROI)Masking input moving: MRI_mask
    8. Leave all other settings at default
    9. click: Apply

Registration Results

unregistered MRI & CT
 unregistered MRI & CT
registration masks
 registration masks
affine registered MRI & CT
 affine registered MRI & CT
nonrigid registered MRI & CT
 nonrigid registered MRI & CT
insufficient mask: nonrigid registered with liver mask only, note the misalignment in the remaining abdomen
 insufficient mask: nonrigid registered with liver mask only, note the misalignment in the remaining abdomen
Color overlay of registered MRI onto CT, illustrating the fusion: MRI soft tissue contrast shows substructures & vasculature invisible on the CT
 Color overlay of registered MRI onto CT, illustrating the fusion: MRI soft tissue contrast shows substructures & vasculature invisible on the CT


Acknowledgments

Thanks to Dr.Stuart Silverman and Dr. Nobuhiko Hata for sharing this case.

Retrieved from "https://www.na-mic.org/w/index.php?title=Projects:RegistrationLibrary:RegLib_C12&oldid=97472"