NA-MIC/Projects/Collaboration/NIREP: Non-rigid Image Registration Evaluation

Return to Project Week Main Page

NIREP application splash screen

NIREP program

Key Investigators

• Gary Christensen, Iowa <gary-christensen@uiowa.edu> (NIREP PI)
• Jeffrey Hawley <woofton_9@eaglescrag.net> (NIREP software developer)
• Ying Wei <wywendy2000@gmail.com> (NIREP software developer)
• Kate Rasing <kate@spicybrains.org> (NIREP software developer)
• Julien Jomier, Kitware
• Bill Hoffman
• Sebastien Barre, Kitware
• Jim Miller
• Luis Ibanez, Kitware (image registration regression testing, Cpack, and ITK)

Objective

We have started the Non-rigid Image Registration Evaluation Project (NIREP) to develop software tools and provide shared image validation databases for rigorous testing of non-rigid image registration algorithms. NIREP will extend the scope of prior validation projects by developing evaluation criteria and metrics using large image populations, using richly annotated image databases, using computer simulated data, and increasing the number and types of evaluation criteria.

The goal of this project is to establish, maintain, and endorse a standardized set of relevant benchmarks and metrics for performance evaluation of nonrigid image registration algorithms. Furthermore, these standards will be incorporated into an exportable computer program to automatically evaluate the registration accuracy of nonrigid image registration algorithms.

Approach, Plan

We plan to do the following tasks to improve the NIREP software package: surfaces, etc. into a composite image.

• Use CPack to package the NIREP program.
• Setup and use a DART Dashboard at Iowa
• Select a license for the software.
• Redesign the Database Manager and investigate how database managers are implemented in other tools.
• Learn about setting up data distribution via Xnat.
• Learn about distributing tools with NSIS.
• Learn the best way to break the VTK & ITK pipelines
• Implement streaming of images in NIREP software
• Learn how other tools combine images, landmarks, contours,

• Investigate integration of wxWidgets with ITK and VTK.

Progress

• CMake/CTest/CDash/CPack
  • Dashboard is installed on the server
  • Configured and uploading
  • Submitted CDash bug
  • Talked with Julien Jomier, Sebastien Barre, and Bill Hoffman about CDash/CTest/CMake/CPack issues & got the CMake/CTest written correctly, CPack/CDash working
• XNAT
  • Talked with Hans about common XNAT server
  • Started installing on transform
  • Uploaded and organized NIREP initial evaluation database NA0 to XNAT central.
  • Talked with Mikhail and Tim about how to organize local files(NIREP database) in XNAT Deaktop(XND), store text metadata, and distribute to others.
  • Fixed certain problems with XNAT Desktop and XNAT central, and still need to ask Tim and Mikhail more to see how to better organize and upload database both local and website and if it can be more convenient.
• Talked with Hans about breaking the pipelines and started implementation
• Talked with Bill Hoffman and got NIREP packaged with CPack (which uses NSIS)
• Talked with Steve Pieper about MRML and other methods used in Slicer that could help us with our Database Manager

References

This work was supported in part by NIH grants EB004126, CA096679 and HL64368.

• Link to NIREP web site:
• The STARD Initiative -- Towards Complete and Accurate Reporting of Studies on Diagnostic Accuracy
• SPIE Medical Imaging: Validation in Medical Image Registration Workshop, Feb. 18, 2007
• IEEE Transactions on Medical Imaging, Special Issue on Validation in Medical Image Processing 25(11), Nov. 2006 (need access to IEEE explore to view papers)
• P. Hellier, C. Barillot, I. Corouge, B. Gibaud, G. Le Goualher, D. L. Collins, A. Evans, G. Malandain, N. Ayache, G. E. Christensen, and H. J. Johnson, Retrospective Evaluation of Intersubject Brain Registration, IEEE Transactions on Medical Imaging, 22(9) 2003, pp. 1120-1130 (need access to IEEE explore to view paper)
• P. Jannin, C. Grova, C.R. Maurer, Model for defining and reporting reference-based validation protocols in medical image processing, International Journal of Computer Assisted Radiology and Surgery, 1(2), August 2006.
• P. Jannin, M. Fitzpatrick, D. Hawkes, X. Pennec, R. Shahidi, and M.W. Vannier, Editorial: Validation of Medical Image Processing in Image-Guided Therapy, IEEE Transactions on Medical Imaging, 21(11), 2002, pp. 1445-1449.