Project Week 25/Breast Segmentation in DCE-MRI via Deep Learning Approaches

Jump to: navigation, search
Home < Project Week 25 < Breast Segmentation in DCE-MRI via Deep Learning Approaches

Back to Projects List

Breast Analysis in DCE-MRI

Key Investigators


In recent years Dynamic Contrast Enhanced-Magnetic Resonance Imaging (DCE-MRI) has gained popularity as an important complementary diagnostic methodology for early detection of breast cancer. It has demonstrated a great potential in the screening of high-risk women, in staging newly diagnosed breast cancer patients and in assessing therapy effects thanks to its minimal invasiveness and to the possibility to visualise 3D high resolution dynamic (functional) information not available with conventional RX imaging. Among the major issues in developing CAD systems for breast DCE-MRI there are: (a) the detection of suspicious regions of interest (ROIs) as sensibly as possible, while simultaneously minimising the number of false alarms [1] and (b) the classification of each segmented ROI according to its aggressiveness [2]. This task is made harder by the peculiarity of DCE-MRI breast examinations: breast movements due to inspiration, a huge diversity of lesion types.

Project Description

Breast Cancer analysis could be approached as a classification problem via Computer Aided Detection (CAD) system.

Typical Computer Aided Detection System

Breats-Mask Extraction

With the aim of reducing the computational cost of further steps and attenuate noise caused by extraneous voxel (VOlumetric piXEL) a binary mask representing only breast parenchyma and excluding background and other tissues is extracted. Segmentation of breast parenchyma has been addressed relying on fuzzy binary clustering, breast anatomical priors and morphological refinements.

My Previous Proposal (ICPR2016 [3])

The segmentation of breast parenchyma has been addressed relying on fuzzy binary clustering, breast anatomical priors and morphological refinements. In breast segmentation, the most difficult issue to address is discriminating the breast parenchyma from the pectoral muscle since signal intensities, textures and anatomical structures of these tissues are very close each other.

A Breast-Mask extracted from DCE-MRI data

The proposed breast mask extraction approach overcomes the issue by mixing geometrical-based and pixel-based approaches. It relies on geometrical anatomical priors to take advance of anatomical knowledge of the breast key points and uses a pixel base segmentation to obtain the best threshold for each border.

Anatomical key-points

It uses a pixel-based Fuzzy C-Means (FCM) clustering to shift the breast mask extraction from a simple grey-level based segmentation to a membership probability one. Moreover, it exploits novel geometrical consideration to weight the classes membership probability according to the breast anatomy.

Result of FCM segmentation (in red) overlapped to the Ground Truth (green)

The result is an automated procedure, able to extract an accurate breast mask without any prior information on the patient dataset (as in the case of atlases).

Objective Approach and Plan Progress and Next Steps
  • Breast segmentation of 4D DCE-MRI volumes via deep approaches [3].
  • Results evaluation with 42 patients provided of manually segmented ground-truth.
  1. Prepare the Caffe environment
  2. Prepare the Data
  3. Test the classical deep networks architectures
  4. Evaluate results in a k-fold flavor
  5. Try to do better by using a specifically designed network architecture.
  • Include the model in a Slicer Module.
  • Relying on the Breast Mask Lesion detection via Deep approaches should be performed [1].
  • Relying on the segmented regions of interest (ROIs) a lesion malignity assessment via deep approaches should be performed [2].

Deep Proposal

The novel proposed lesion detection module performs the breast segmentation relying on deep approaches such as those proposed in [4] [5]. In particular, "u-net" provides segmentation via deep Convolutional Neural Networks (dCNN).

U-Net architecture for image segmentation [5]

Segmentation has been performed in Axial projection

Preliminary Results

Approach Validation Dice
fuzzy c-means leave one patient out 83.25
fuzzy c-means + anatomical priors leave one patient out 88.85
fuzzy c-means + anatomical priors + postprocessing leave one patient out 91.36
"u-net" without batch-normalisation 30 epochs (hold-out) 76.58
"u-net" with batch-normalisation 30 epochs (hold-out) 82.19

Interactions with Anneke and Giampaolo were important in order to understand how to improve the CNN topology.

Background and References

  1. 1.0 1.1 Marrone, S., Piantadosi, G., Fusco, R., Petrillo, A., Sansone, M., & Sansone, C. (2013, September). Automatic lesion detection in breast DCE-MRI. In International Conference on Image Analysis and Processing (pp. 359-368). Springer Berlin Heidelberg.
  2. 2.0 2.1 Piantadosi, G., Fusco, R., Petrillo, A., Sansone, M., & Sansone, C. (2015). LBP-TOP for volume lesion classification in breast DCE-MRI. In 18th International Conference on Image Analysis and Processing, ICIAP 2015. Springer Verlag.
  3. 3.0 3.1 Marrone, S., Piantadosi, G., Fusco, R., Petrillo, A., Sansone, M., & Sansone, C. (2016, December). Breast Segmentation using Fuzzy C-Means and anatomical priors in DCE-MRI. In Pattern Recognition (ICPR), 2016 23rd International Conference on (pp. 1472-1477). IEEE.
  4. Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3431-3440).
  5. 5.0 5.1 Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. arXiv preprint arXiv:1505.04597.