Difference between revisions of "NA-MIC-Kit"

From NAMIC Wiki
Jump to: navigation, search
(Undo revision 95773 by Zack (talk))
Tag: Undo
 
(22 intermediate revisions by 6 users not shown)
Line 7: Line 7:
 
The NA-MIC Kit is a free open source software platform. The NA-MIC Kit is distributed under a BSD-style license without restrictions or "give-back" requirements and is intended for research, but there are no restrictions on other uses. It consists of the 3D Slicer application software, a number of tools and toolkits such as VTK and ITK, and a software engineering methodology that enables multiplatform implementations.  It also draws on other "best practices" from the community to support automatic testing for quality assurance. The NA-MIC kit uses a modular approach, where the individual components can be used by themselves or together. The NA-MIC kit is fully-compatible with local installation (behind institutional firewalls) and installation as an internet service.  Significant effort has been invested to ensure compatibility with standard file formats and interoperability with a large number of external applications.  
 
The NA-MIC Kit is a free open source software platform. The NA-MIC Kit is distributed under a BSD-style license without restrictions or "give-back" requirements and is intended for research, but there are no restrictions on other uses. It consists of the 3D Slicer application software, a number of tools and toolkits such as VTK and ITK, and a software engineering methodology that enables multiplatform implementations.  It also draws on other "best practices" from the community to support automatic testing for quality assurance. The NA-MIC kit uses a modular approach, where the individual components can be used by themselves or together. The NA-MIC kit is fully-compatible with local installation (behind institutional firewalls) and installation as an internet service.  Significant effort has been invested to ensure compatibility with standard file formats and interoperability with a large number of external applications.  
  
| style="background: #ebeced" colspan="2" align="center"| <b>Featured Software Tool</b>
+
| style="background: #ebeced" colspan="2" align="center"| <b>3D Slicer</b>
 
|-
 
|-
 
| style="background: #ebeced"|[[Image:Slicer3-11-2007.jpg|center|350px|Visualization of the SPL/PNL Brain Atlas]]  
 
| style="background: #ebeced"|[[Image:Slicer3-11-2007.jpg|center|350px|Visualization of the SPL/PNL Brain Atlas]]  
Line 30: Line 30:
 
* [http://www.slicer.org 3D Slicer] is a general purpose application. Biomedical researchers will typically use this software tool to load, view, analyze, process and save image data. Slicer has been implemented to interoperate with many other tools, including [http://www.xnat.org XNAT], which is an open source image database.
 
* [http://www.slicer.org 3D Slicer] is a general purpose application. Biomedical researchers will typically use this software tool to load, view, analyze, process and save image data. Slicer has been implemented to interoperate with many other tools, including [http://www.xnat.org XNAT], which is an open source image database.
 
* Slicer modules, which are dynamically loaded by Slicer at run-time, can be used to extend Slicer's core functionality including defining graphical user interfaces. Modules are typically used by algorithms and application developers.
 
* Slicer modules, which are dynamically loaded by Slicer at run-time, can be used to extend Slicer's core functionality including defining graphical user interfaces. Modules are typically used by algorithms and application developers.
* Application and algorithms developers may also use NA-MIC Kit toolkits and libraries. For example, the [http://www.itk.org Insight Segmentation and Registration Toolkit ITK] can be used to develop slicer modules for medical image analysis. The [http://www.vtk.org Visualization Toolkit] can be used to process, visualize and graphically interact with data. [http://www.kwwidgets.org KWWidgets] is a 2D graphical user interface toolset that can be used to build applications. Teem is a library of general purpose command-line tools that are useful for processing data. Finally, those individuals wishing to create and manage complex software, the NAMIC-Kit software process is available as embodied in CMake, CTest, CPack, DART and the various documentation, bug tracking and communication tools.
+
* Application and algorithms developers may also use NA-MIC Kit toolkits and libraries. For example, the [http://www.itk.org Insight Segmentation and Registration Toolkit ITK] can be used to develop slicer modules for medical image analysis. The [http://www.vtk.org Visualization Toolkit] can be used to process, visualize and graphically interact with data. Teem is a library of general purpose command-line tools that are useful for processing data. Finally, those individuals wishing to create and manage complex software, the NAMIC-Kit software process is available as embodied in CMake, CTest, CPack, DART and the various documentation, bug tracking and communication tools.
  
 
{|
 
{|
Line 74: Line 74:
 
|style="background:white"|[[Image:NRRDLogo.png|100px]]
 
|style="background:white"|[[Image:NRRDLogo.png|100px]]
 
|[http://wiki.na-mic.org/Wiki/index.php/TeemSummary Teem Libraries and Command Line Tools]<br>Teem is a coordinated group of libraries for representing, processing, and visualizing scientific raster data. Teem includes command-line tools that permit the library functions to be quickly applied to files and streams, without having to write any code. [http://wiki.na-mic.org/Wiki/index.php/TeemSummary More...]
 
|[http://wiki.na-mic.org/Wiki/index.php/TeemSummary Teem Libraries and Command Line Tools]<br>Teem is a coordinated group of libraries for representing, processing, and visualizing scientific raster data. Teem includes command-line tools that permit the library functions to be quickly applied to files and streams, without having to write any code. [http://wiki.na-mic.org/Wiki/index.php/TeemSummary More...]
|-
 
|style="background:white"|[[Image:Logo-xnat.gif|100px]]
 
|[http://xnat.org XNAT Web-based Image Informatics Server]<br>The Extensible Neuroimaging Archive Toolkit (XNAT) is an open source software platform designed to facilitate management and exploration of neuroimaging and related data. XNAT includes a secure database backend and a rich web-based user interface. NA-MIC is working to provide a portable, easy-to-install and easy-to-administer version of XNAT that can be deployed as part the Kit.  These efforts will build on ongoing work in the BIRN community to integrate Slicer with XNAT.
 
 
|-
 
|-
 
|style="background:white"|[[Image:CMake-logo-med-res.png|100px]]
 
|style="background:white"|[[Image:CMake-logo-med-res.png|100px]]
Line 89: Line 86:
 
|[http://www.kitware.com/products/midas.html MIDAS and the Publication Database]<br>[http://www.kitware.com/products/midas.html MIDAS] is open-source software for hosting heterogeneous databases, e.g., databases of images, publications, meta-data, presentations, and more. MIDAS also provides interfaces so that its data can be easily accesses over the web and via C++/python/Java. MIDAS can also harvest data from other databases on the web, e.g., PubMed and genomics databases. NA-MIC has a MIDAS installation to serve as the NA-MIC Publications Database. MIDAS is also being used to host NA-MIC data, the Insight Journal, the MIDAS Journal, and the VTK Journal. Direct access to MIDAS's data from within Slicer is being developed to support informatics analysis and visualization. Direct access to MIDAS's publications from within Slicer is being developed to provide documentation and integrative tutorials. [http://wiki.na-mic.org/Wiki/index.php/MIDASSummary More...]
 
|[http://www.kitware.com/products/midas.html MIDAS and the Publication Database]<br>[http://www.kitware.com/products/midas.html MIDAS] is open-source software for hosting heterogeneous databases, e.g., databases of images, publications, meta-data, presentations, and more. MIDAS also provides interfaces so that its data can be easily accesses over the web and via C++/python/Java. MIDAS can also harvest data from other databases on the web, e.g., PubMed and genomics databases. NA-MIC has a MIDAS installation to serve as the NA-MIC Publications Database. MIDAS is also being used to host NA-MIC data, the Insight Journal, the MIDAS Journal, and the VTK Journal. Direct access to MIDAS's data from within Slicer is being developed to support informatics analysis and visualization. Direct access to MIDAS's publications from within Slicer is being developed to provide documentation and integrative tutorials. [http://wiki.na-mic.org/Wiki/index.php/MIDASSummary More...]
 
|-
 
|-
|style="background:white"|[[Image:BatchMakeLogo.gif|100px]]
+
|style="background:white"|[[Image:Logo-xnat.gif|100px]]
|[http://batchmake.org Batchmake]<br>BatchMake is a cross platform tool for batch processing of large amount of data.
+
|[http://xnat.org XNAT Web-based Image Informatics Server]<br>The Extensible Neuroimaging Archive Toolkit (XNAT) is an open source software platform designed to facilitate management and exploration of neuroimaging and related data. XNAT includes a secure database backend and a rich web-based user interface. NA-MIC is working to provide a portable, easy-to-install and easy-to-administer version of XNAT that can be deployed as part the Kit. These efforts will build on ongoing work in the BIRN community to integrate Slicer with XNAT.
BatchMake can process datasets locally or on distributed systems using Condor (a grid computing tool that enables distributed computing across the network). Some of the key features of BatchMake include: 1) a BSD License, 2) CMake-like scripting language, 3) distributed scripting via Condor, 4) a centralized remote website for online statistical analysis. 4) a user Interface using FLTK, and 5) BatchMake is cross platform. [http://batchmake.org More...]
 
 
|-
 
|-
 
|style="background:white"|[[Image:CTKLogo.gif|100px]]
 
|style="background:white"|[[Image:CTKLogo.gif|100px]]
Line 98: Line 94:
 
|style="background:white"|[[Image:QtLogo.gif|100px]]
 
|style="background:white"|[[Image:QtLogo.gif|100px]]
 
|[http://qt.nokia.com/ Qt GUI Toolkit]<br>Qt is a suite of tools and frameworks designed to streamline the creation of cross-platform applications for Microsoft Windows, Mac OS X, and Linux.  [http://qt.nokia.com/ More...]
 
|[http://qt.nokia.com/ Qt GUI Toolkit]<br>Qt is a suite of tools and frameworks designed to streamline the creation of cross-platform applications for Microsoft Windows, Mac OS X, and Linux.  [http://qt.nokia.com/ More...]
 +
|-
 +
|style="background:white"|[[Image:PythonLogo.png|100px]]
 +
|[http://www.python.org/ Python]<br>Python is a programming language that enables developers and users to work quickly and integrate systems more effectively. Python enables rapid gains in productivity and lower software maintenance costs.  [http://www.python.org/ More...]
 
|}
 
|}
  
Line 107: Line 106:
 
*[http://www.cdash.org/CDash/index.php?project=Insight ITK]  
 
*[http://www.cdash.org/CDash/index.php?project=Insight ITK]  
 
*[http://www.cdash.org/CDash/index.php?project=CMake CMake]  
 
*[http://www.cdash.org/CDash/index.php?project=CMake CMake]  
*[http://www.cdash.org/CDash/index.php?project=KWWidgets KWWidgets]
+
*[http://www.cdash.org/CDash/index.php?project=Midas Midas]
*[http://www.cdash.org/CDash/index.php?project=BatchMake BatchMake]
+
*[http://my.cdash.org/index.php?project=CTK CTK]
  
 
<br>
 
<br>
Line 115: Line 114:
  
 
=NA-MIC Kit in Numbers=
 
=NA-MIC Kit in Numbers=
The numbers in this table are statistics characterizing the [http://wiki.na-mic.org/Wiki/index.php/NA-MIC-Kit NA-MIC kit]. They provide an estimate of the scale of the Kit, including approximate costs to create and total effort expended. Note that estimates such as these are required because large open-source software systems cannot be tracked via direct investment since much of the effort is voluntary in nature, and distributed across the world through a variety of organizations.
+
The numbers in this table are statistics characterizing the [http://wiki.na-mic.org/Wiki/index.php/NA-MIC-Kit NA-MIC kit]. They provide an estimate of the scale of the Kit, including approximate costs to create and total effort expended. Note that estimates such as these are required because large open-source software systems cannot be tracked via direct investment since much of the effort is voluntary in nature, and distributed across the world through a variety of organizations. Also note that the numbers reflect the current state as of the date of capture. Reorganization of the code can lead to fluctuation in the numbers over time.
<BR><small> Source: http://www.ohloh.org. Captured on May 6 2010. See the Ohloh website for an explanation of how the numbers were computed.</small>
+
<BR><small> Source: http://www.ohloh.org. Captured on June. 27 2014. See the Ohloh website for an explanation of how the numbers were computed. Used salary estimate of $100K per developer.</small>  
  
 
{|border="1" cellpadding="2"
 
{|border="1" cellpadding="2"
Line 125: Line 124:
 
|-
 
|-
 
| Slicer
 
| Slicer
| align="right" |1,270,816
+
| align="right" |1,446,222
| align="right" |361
+
| align="right" |408
| align="right" |$36,122,644
+
| align="right" |$40,838,073
|-
 
| KWW
 
| align="right" |207,208
 
| align="right" |54
 
| align="right" |$ 5,406,516
 
 
|-
 
|-
 
| VTK
 
| VTK
| align="right" |1,853,529
+
| align="right" |1,493,877
| align="right" |538
+
| align="right" |427
| align="right" |$53,808,076
+
| align="right" |$42,660,861
 
|-
 
|-
 
| ITK
 
| ITK
| align="right" |848,383
+
| align="right" |1,602,013
| align="right" |237
+
| align="right" |457
| align="right" |$23,719,173
+
| align="right" |$45,665,146
 
|-
 
|-
 
| CMake / CTest / CPack
 
| CMake / CTest / CPack
| align="right" |323,454
+
| align="right" |832,766
| align="right" |86
+
| align="right" |227
| align="right" |$8,590,888
+
| align="right" |$22,732,345
 
|-
 
|-
 
| CDash
 
| CDash
| align="right" |78,226
+
| align="right" |243,231
| align="right" |19
+
| align="right" |62
| align="right" |$1,897,060
+
| align="right" |$6,199,044
 +
|-
 +
| Midas
 +
| align="right" |650,953
 +
| align="right" |176
 +
| align="right" |$17,635,039
 +
|-
 +
| CTK
 +
| align="right" |177,606
 +
| align="right" |45
 +
| align="right" |$4,486,786
 +
|-
 +
| Teem
 +
| align="right" |170,261
 +
| align="right" |44
 +
| align="right" |$4,383,427
 +
|-
 +
| DCMTK
 +
| align="right" |471,114
 +
| align="right" |127
 +
| align="right" |$12,690,868
 
|-
 
|-
 
| XNat
 
| XNat
| align="right" |200,985
+
| align="right" |508,354
| align="right" |51
+
| align="right" |137
| align="right" |$5,149,987
+
| align="right" |$13,700,329
 
|-
 
|-
 
|style="background:#8EDEB5; color:black" |Total
 
|style="background:#8EDEB5; color:black" |Total
| style="background:#8EDEB5; color:black" align="right" |4,782,601
+
| style="background:#8EDEB5; color:black" align="right" |7,596,397
| style="background:#8EDEB5; color:black" align="right" |1346
+
| style="background:#8EDEB5; color:black" align="right" |2,110
| style="background:#8EDEB5; color:black" align="right" |$134,694,344
+
| style="background:#8EDEB5; color:black" align="right" |$210,991,918
 
|}
 
|}

Latest revision as of 09:59, 25 March 2020

Home < NA-MIC-Kit
Back to NA-MIC Internal Collaborations

Overview

The NA-MIC Kit is a free open source software platform. The NA-MIC Kit is distributed under a BSD-style license without restrictions or "give-back" requirements and is intended for research, but there are no restrictions on other uses. It consists of the 3D Slicer application software, a number of tools and toolkits such as VTK and ITK, and a software engineering methodology that enables multiplatform implementations. It also draws on other "best practices" from the community to support automatic testing for quality assurance. The NA-MIC kit uses a modular approach, where the individual components can be used by themselves or together. The NA-MIC kit is fully-compatible with local installation (behind institutional firewalls) and installation as an internet service. Significant effort has been invested to ensure compatibility with standard file formats and interoperability with a large number of external applications.

3D Slicer
Visualization of the SPL/PNL Brain Atlas


3D Slicer is a general-purpose application for loading, viewing, analyzing, processing and interacting with biomedical data. Slicer can be extended at run-time through plug-in modules, enabling algorithms developers and researchers to modify and specialize Slicer to a particular application. Slicer is distributed under open source license free of commercial restriction. For more information about 3D Slicer click here.



Target Audience

The NA-MIC Kit has been created to support a spectrum of users and developers. This includes:

  • biomedical researchers
  • algorithms developers
  • application developers
  • software toolkit developers and users; and
  • software process tools including support for building, testing, community building and software management, and is outlined in this presentation (ppt), and this poster (pdf).

The NA-MIC Kit has also been employed by users wishing to perform image analysis and visualization tasks. For example, the Slicer application is being used at Harvard's IIC for astrophysics research. Other tools, such as CMake, are in world wide use in projects as disparate as KDE, one of the world's largest open source software projects. (For more information about the KDE Linux desktop environment, see Why the KDE project switched to CMake, which describes how one of the largest FOSS efforts adopts a component of the NA-MIC kit.)

Software Overview

Users of the NAMIC Kit will typically use a combination of its many modular components. More information about each tool is available below.

  • 3D Slicer is a general purpose application. Biomedical researchers will typically use this software tool to load, view, analyze, process and save image data. Slicer has been implemented to interoperate with many other tools, including XNAT, which is an open source image database.
  • Slicer modules, which are dynamically loaded by Slicer at run-time, can be used to extend Slicer's core functionality including defining graphical user interfaces. Modules are typically used by algorithms and application developers.
  • Application and algorithms developers may also use NA-MIC Kit toolkits and libraries. For example, the Insight Segmentation and Registration Toolkit ITK can be used to develop slicer modules for medical image analysis. The Visualization Toolkit can be used to process, visualize and graphically interact with data. Teem is a library of general purpose command-line tools that are useful for processing data. Finally, those individuals wishing to create and manage complex software, the NAMIC-Kit software process is available as embodied in CMake, CTest, CPack, DART and the various documentation, bug tracking and communication tools.
NAMIC-Kit-Overview.png Thus the NA-MIC Kit consists of a modular set of interoperable free open source software (FOSS) packages, managed under a collaborative, high quality software engineering methodology (see Figure). These packages have been carefully architected to accommodate technology contributions from the NA-MIC Investigators, and to rapidly deploy these technologies to NA-MIC and the broader biomedical imaging community.Algorithm developers contribute to the computational platform (image analysis: ITK and Teem; visualization: VTK and OpenCL) and application developers create tools within an architectural framework (scene graph: MRML, GUI: Qt, scientific computing: Python) in conjunction with data management facilities (XNAT) and under the control of the quality software process (CMake and CDash). The 3D Slicer platform is designed to accommodate accelerated innovation with a flexible execution engine on which community-developed analysis modules can be rapidly deployed to clinical researchers and the broader community via the 3D Slicer.

Software Methodology

The Open Source Software development methodology that is used by NA-MIC is summarized in the following documents:

Support Resources

Open Source Software

NAMIC fully embraces and advocates the use of open source software tools and data. We use BSD style licenses without restrictions on the use of the software and free of license requirements. There are many reasons for this including

  • ease of collaboration in the spirit of scientific research (open science);
  • improved software quality; and
  • widespread dissemination of NAMIC products including software, documentation, data, training materials, and ideas.

Along these lines, we have had extensive discussions relative to acceptable open source standards in the NAMIC kit. We are also working with NIH, NLM and other interested parties to establish open source standards.

Download Central

Please go here to download Slicer software, documentation and data.

Software Packages

3DSlicerLogo-V-Color-201x204.png 3D Slicer
3D Slicer is a software package for visualization and medical image computing. A tutorial for prospective users of the program can be found on the web. See our training page for an introduction to the use of 3D Slicer. More...
VTK-logo-medium-res.jpg The Visualization Toolkit VTK
The Visualization Toolkit is an object-oriented toolkit for processing, viewing and interacting with a variety of data forms including images, volumes, polygonal data, and simulation datasets such as meshes, structured grids, and hierarchical multi-resolution forms. It also supports large-scale data processing and rendering. More...
ItkLogo.jpg The Insight Toolkit ITK
The Insight Segmentation and Registration Toolkit (ITK) is an open-source software toolkit for performing registration and segmentation. Segmentation is the process of identifying and classifying data found in digitally sampled representations. Typically the sampled representation is an image acquired from such medical instrumentation as CT or MRI scanners. Registration is the task of aligning or developing correspondences between data. For example, in the medical environment, a CT scan may be registered with a MRI scan in order to combine the information contained in both. More...
NRRDLogo.png Teem Libraries and Command Line Tools
Teem is a coordinated group of libraries for representing, processing, and visualizing scientific raster data. Teem includes command-line tools that permit the library functions to be quickly applied to files and streams, without having to write any code. More...
CMake-logo-med-res.png CMake The Cross-platform Make Tool
CMake is used to control the software build process using simple platform, compiler and operating system independent configuration files. CMake generates native makefiles and workspaces that can be used in the development environment of your choice. CMake is quite sophisticated: it is possible to support complex environments requiring source code repository access, system configuration, pre-processor generation, code generation, and template instantiation. More...

Featured: CMake has been adopted by KDE, one of the world's largest open source software systems. CMake is downloaded over 1500 times/day.

Cdash.gif CDash, CTest, CPack Software Process Tools
As an adjunct to CMake the tools CDash, CTest, CPack are used to test and package all components of the NAMIC kit. CTest is a testing client that locally performs testing on a software repository, and then communicates the results of the testing to CDash (and other testing, dashboard servers such as DART2). CPack is a cross-platform tool for packaging, distributing and installing the NAMIC kit on various systems including Linux, Windows, and Mac OSX. More...
MIDASLogo.png MIDAS and the Publication Database
MIDAS is open-source software for hosting heterogeneous databases, e.g., databases of images, publications, meta-data, presentations, and more. MIDAS also provides interfaces so that its data can be easily accesses over the web and via C++/python/Java. MIDAS can also harvest data from other databases on the web, e.g., PubMed and genomics databases. NA-MIC has a MIDAS installation to serve as the NA-MIC Publications Database. MIDAS is also being used to host NA-MIC data, the Insight Journal, the MIDAS Journal, and the VTK Journal. Direct access to MIDAS's data from within Slicer is being developed to support informatics analysis and visualization. Direct access to MIDAS's publications from within Slicer is being developed to provide documentation and integrative tutorials. More...
Logo-xnat.gif XNAT Web-based Image Informatics Server
The Extensible Neuroimaging Archive Toolkit (XNAT) is an open source software platform designed to facilitate management and exploration of neuroimaging and related data. XNAT includes a secure database backend and a rich web-based user interface. NA-MIC is working to provide a portable, easy-to-install and easy-to-administer version of XNAT that can be deployed as part the Kit. These efforts will build on ongoing work in the BIRN community to integrate Slicer with XNAT.
CTKLogo.gif CTK GUI Toolkit
CTK is an Open Source library of GUI classes based on Qt, VTK, ITK, CMake, and DCMTK. This library is an international effort to simplify the development of medical image analysis and scientific computing applications. NAMIC is assisting in the architectural design, helping them establish software practices, contributing classes, and evaluating early developments. More...
QtLogo.gif Qt GUI Toolkit
Qt is a suite of tools and frameworks designed to streamline the creation of cross-platform applications for Microsoft Windows, Mac OS X, and Linux. More...
PythonLogo.png Python
Python is a programming language that enables developers and users to work quickly and integrate systems more effectively. Python enables rapid gains in productivity and lower software maintenance costs. More...


View NA-MIC-Kit dashboards here:

The testing dashboards continually captures information relative to the quality of the various components of the NAMIC-Kit. Each component has its own dashboard, and a suite of tests that are executed on a continual basis. Developers check out these dashboards to monitor the health of the software, and to make fixes when problems are discovered. The following are the component dashboards for the NAMIC-Kit.


Go to NA-MIC-Kit-Old to see the version of the NA-MIC Kit web pages prior to October 2007.

NA-MIC Kit in Numbers

The numbers in this table are statistics characterizing the NA-MIC kit. They provide an estimate of the scale of the Kit, including approximate costs to create and total effort expended. Note that estimates such as these are required because large open-source software systems cannot be tracked via direct investment since much of the effort is voluntary in nature, and distributed across the world through a variety of organizations. Also note that the numbers reflect the current state as of the date of capture. Reorganization of the code can lead to fluctuation in the numbers over time.
Source: http://www.ohloh.org. Captured on June. 27 2014. See the Ohloh website for an explanation of how the numbers were computed. Used salary estimate of $100K per developer.

Package Lines of code Person years Price tag at 100k per person year
Slicer 1,446,222 408 $40,838,073
VTK 1,493,877 427 $42,660,861
ITK 1,602,013 457 $45,665,146
CMake / CTest / CPack 832,766 227 $22,732,345
CDash 243,231 62 $6,199,044
Midas 650,953 176 $17,635,039
CTK 177,606 45 $4,486,786
Teem 170,261 44 $4,383,427
DCMTK 471,114 127 $12,690,868
XNat 508,354 137 $13,700,329
Total 7,596,397 2,110 $210,991,918