DBP2:Harvard:Brain Segmentation Roadmap

Back to NA-MIC Collaborations, Harvard DBP 2

Stochastic Tractography for VCFS

Roadmap

The main goal of this project is to develop end-to-end application that would be used to characterize anatomical connectivity abnormalities in the brain of patients with velocardiofacial syndrome (VCFS), and to link this information with deficits in schizophrenia. This page describes the technology roadmap for stochastic tractography, using newly acquired 3T data, NAMIC tools and slicer 3.

Algorythm

A-Description Most tractography methods estimate fibers by tracing the maximum direction of diffusion. A limitation of this approach is that, in practice, several factors introduce uncertainty in the tracking procedure, including, noise, splitting and crossing fibers, head motion and image artifacts. To address this uncertainty, stochastic tractography methods have been developed to quantify the uncertainty associated with estimated fibers (Bjornemo et al., 2002). Method uses a propagation model based on stochastics and regularization, which allows paths originating at one point to branch and return a probability distribution of possible paths. The method utilizes principles of a statistical Monte Carlo method called Sequential Importance Sampling and Resampling (SISR). Based on probability functions, using a sequential importance sampling technique (Bjornemo et al., 2002), one can generate thousands of fibers starting in the same point by sequentially drawing random step directions. This gives a very rich model of the fiber distribution, as contrasted with single fibers produced by conventional tractography methods. Moreover, from a large number of sampled paths, probability maps can be generated, providing better estimates of connectivity between several anatomical locations. A comparison of the algorithms can be see here. (Figure 1)

Figure 1: Comparison of deterministic and stochastic tractography algorithms

B-Possible Applications Since diffusion direction uncertainty within the gray matter is quite significant; principal diffusion direction approaches usually do not work for tracking between two gray matter regions. Thus if one requires finding connections between a priori selected anatomical gray matter regions, defined either by anatomical segmentations (in case of using structural ROI data), or functional activations (in case of megring DTI with fMRI), stochastic tractography seems to be the method of choice. Here is an example of this application to anatomical data (Figure 2, left image) and to fMRI data (Figure 2, right image). Stochastic Tractography is also comparable, if not better, in defining large white matter fiber bundles, especially those traveling through white matter regions characterized by increased diffusion uncertainty (fiber crossings). Example of such application to internal capsule. (Figure 3)

Figure 2: Stochastic Tractography of uncinate fasciculis on anatomical data (left) and cingulum bungle on fMRI scan (right)

Figure 3: Streamline vs. Stochastic Tractography of the Internal Capsule

C-References

• Björnemo M, Brun A, Kikinis R, Westin CF. Regularized stochastic white matter tractography using diffusion tensor MRI. In Fifth International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI'02). Tokyo, Japan, 2002;435-442.
• Friman, O., Farneback, G., Westin CF. A Bayesian Approach for Stochastic White Matter Tractography. IEEE Transactions on Medical Imaging, Vol 25, No. 8, Aug. 2006

Module

Directions of completing Stochastic Tractography with Python in Slicer 3.0:

1. Loading volumes:

• Go to MODULES > VOLUME.
• Under "Load," click the folder icon and select the volume you want to load. You must load a DWI.nhdr or DWI.nrrd and at least one labelmap for your ROI (in .nhdr or .nrrd). Double-click the file you want in to pop-up window, and then hit apply in Slicer. You have the option to load a second ROI and a white matter mask if you choose to. For the labelmaps, be sure to check the box that says labelmap and then hit "apply"

2. Then click "MODULES > PYTHON MODULES > PYTHON STOCHASTIC TRACTOGRAPHY 3. Input/Output:

• Set your DWI under "Input DWI Volume"
• Set your ROI under "Input ROI Volume"
• Set other volumes (optional)

4. Set Smoothing

• Click: "enabled" to turn smoothing on.
• FWHM:

5. Otsu Mask- tensor estimation

• Click: "enabled" to turn Otsu mask on.
• This is a thresholding method for the dwi that is based on intensity.

6. WM mask

• Click: "enabled" to turn WM mask generation on.
• WM Threshold is based on FA values. Only values within threshold will be included for tractography.
• Artifact Removal- Will add voxels to the white matter mask by evaluating voxels with a high FA that might have been due to an artifact.

7. Tensor Parameters

• Baseline--
• Tensor mode: Is the method for computing the tensors
• FA/Mode/Trace: You can check these if you want the module to create FA/Mode/Trace map.

8. Stochastic Tractography Parameters:

• Total Tracts: The amount of tracts that will be seeded from each voxel
• Maximum tract length (in mm)
• Step Size: length between each re-estimation of tensors.
• Use spacing - -
• Stopping criteria: Terminates a tract when FA drops below the specified threshold.

8. Probability map

• Click: "enabled" to turn visualization on.
  • rough:
  • cumulative:Tracts are summed by voxel independently
  • discriminative: tracts are summed by voxel depending on their length ownership

??visual inspection (looking at areas where mask does not exist, but FA exceeds 0.3)

??thresholding

/??visualizing path, tracts

??getting numbers (thresholded FA, FA weighted by probability)

• Module documentation can be found here (replace with the new documentation, when its ready):
  • Training Dataset
  • Training Presentation
  • Training Webcast (Theora format)

Work Accomplished

Figure 4: Stochastic Tractography on Phantom

A - Optimization and testing of stochastic tractography algorythm 

• Original methodological paper, as well as our first attempts to use the algorythm (CC+ and matlab scripts) have been done on old "NAMIC" 1.5T LSDI data (Structural MRI and DTI data).
• Tri worked hard on making sure algorythm works on new high resolution 3T data (available here: 3T Data).
• Tests have been done also on the spiral diffusion phantom, to make sure diffusion directions and scanner coordinates are handled properly by the algorythm (Figure 4).

B - Clincal Applications Algorythm was used to trace and analyze anterior limb of the internal capsule on 1.5T data. It generated reacher representation of frontal fiber projections, it also turned out to be more sensitive to group differences in white matter integrity that conventional deterministic tractography (see Figure 4). Algorythm was also used to trace smaller white matter fiber tracts, such as Cingulum, Fornix, Uncinate Fasciculus, Arcuate Fasciculus on 3T "Santa Fe" dataset (http://www.na-mic.org/Wiki/index.php/SanteFe.Tractography.Conference) C - References Shenton, M.E., Ngo, T., Rosenberger, G., Westin, C.F., Levitt, J.J., McCarley, R.W., Kubicki, M. Study of Thalamo-Cortical White Matter Fiber Tract Projections in Schizophrenia Using Diffusion Stochastic Tractography. Poster presented at the 46th Meeting of the American College of Neuropsychopharmacology, Boca Raton, FL, December 2007. Work in Progress A - Optimization and Testing of stochastic tractography module  Julien is testing now separate components of work flow, including the masks, and impact of their precision on stochastic output, as well as impact of number of seeding points on tractography results. At the same time, we are testing the module on Max Plank dataset, as well as running it on tractography comparison project dataset. We are discussing possibility of adding project specific functionality to module, such as third ROI to guide tractography, nonlinear registration button for merging fMRI and DTI data. B - Related Clinical Projects

Arcuate Fasciculus Extraction Project We have started the project of investigating Arcuate Fasciculus using Stochastic Tractography (Figure 5). This structure is especially important in both VCFS and schizophrenia, as it connects language related areas (Brocka and Wernicke's), and is involved in language processing quite disturbed in schizophrenia patients. It also can not be reliably traced using deterministic tractography. Project involves: Whole brain segmentation, and automatic extraction of regions interconnected by Arcuate Fasciculus (Inferior frontal and Superior Temporal Gyri). White matter segmentation, in order to prevent algorithm from traveling through the ventricles, where diffusivity is high. Non-linear registration of labelmaps to the DTI space. Seeding tracts. We have piloted it using 5000 seeds per voxel, however it is quite time consuming running it on even most powerful computers in the lab, so we have experimented with smaller number of seeds per voxel. We tested 1000 seeds, which gave virtually identical results. Extracting path of interest, and calculating FA along the path for group comparison. Presentation of previous results for 7 schizophrenics and 12 control subjects, can be found here: Progress Report Presentation. Results presentation and paper submission. Abstract was submitted and accepted for presentation at World Biological Psychiatry Symposium in Venice, Italy. Paper is in preparation.

Figure 5: The arcuate fasciculus including seed, midpoint and target ROI's.

Semantic Network Connectivity Project We use combination of fMRI and DTI data to define and characterize functional and anatomical connectivity within the semantic processing network in schizophrenia. Project involves: fMRI data analysis and identification of functional nodes involved in semantic processing in healthy controls and seubjects with schizophrenia Analysis of functional connectivity (using FSL) between nodes of semantic network Whole brain Voxel Based analysis of DTI data in same population Use of stochastic tractography to identify connections between functional nodes Correlational analysis involving anatomical and functional connectivity data. Results presentation and paper submission. Data was presented at HBM conference in 2007, paper has been submitted to HBM. Study of Default Network We have started collaboration with Department of Neurophysiology Max Planck Institute in Frankfurt (Anna Rotarska contact person). They have dataset containing DTI and resting state fMRI in schizophrenia, and want to use stochastic tractography to measure integrity of anatomical connections within the default network in schizophrenia. Their fMRI data has been co-registered with anatomical scans, and we are putting it into the DTI space. Once this is done, we will start creating tracts connecting fMRI ROIs. This data will be also used to test robustness of our module, since data was collected on a different scanner (3T Philips). Tractography Comparison Project We are also working on a tractography comparison projectdataset, where we apply stochastic tractography to phantom, as well as test dataset. Staffing Plan Sylvain and Yogesh are the DBP resources charged with adapting the tools in the NA-MIC Kit to the DBP needs Doug Markant, our NAMIC RA has left the lab, and now Doug Terry, is a new NAMIC RA. Julien is our new NAMIC software engineer. He is responsible for improving the STM (Stochastic Tractography Module), and making sure software works with STM compliant datasets. Progress Polina is the algorithm core contact Brad is the engineering core contact

Schedule

• 10/2007 - Optimization of Stochastic Tractography algorythm for 1.5T data.
• 10/2007 - Algorythm testing on Santa Fe data set and diffusion phantom.
• 06/2008 - Optimization of Stochastic Tractography algorythm for 3T data.
• 11/2008 - Slicer 3 module prototype using python.
• 12/2008 - Slicer 3 module official release
• 12/2008 - Documentation and packaging for dissemination.
• 12/2008 - Arcuate Fasciculus results.
• 01/2009 - Arcuate Fasciuclus first draft of the paper.
• 05/2009 - Distortion correction and nonlinear registration added to the module
• 05/2009 - Symposium on tractography, including stochastic methods at World Biological Psychiatry Symposium in Venice, Italy.
• 05/2009 - Presentation of Arcuate Fasciculus findings at World Biological Psychiatry Symposium in Venice, Italy.

Team and Institute

• PI: Marek Kubicki (kubicki at bwh.harvard.edu)
• DBP2 Investigators: Sylvain Bouix, Yogesh Rathi, Julien de Siebenthal
• NA-MIC Engineering Contact: Brad Davis, Kitware
• NA-MIC Algorithms Contact: Polina Gollard, MIT

Publications

In print

• NA-MIC Publications Database - Clinical Applications

• NA-MIC Publications Database - Algorithms Development