Difference between revisions of "Project Week 25/NeedleSegmentation"

From NAMIC Wiki
Jump to: navigation, search
 
(15 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
  
Back to [[Project_Week_25#Projects|Projects List]]
+
Back to [[Project_Week_25#Projects|Projects List]]
 
 
  
 
==Key Investigators==
 
==Key Investigators==
{|class="wikitable"
+
*[http://www.imagenglab.com/newsite/paolo_zaffino/ Paolo Zaffino] (Magna Graecia University, Italy)
|-
+
*[http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] (Magna Graecia University/ASL Vercelli, Italy)
| [http://www.imagenglab.com/newsite/paolo_zaffino/ Paolo Zaffino] || [http://www.imagenglab.com/newsite/salvatore_scaramuzzino/ Salvatore Scaramuzzino] || [http://www.imagenglab.com/newsite/mf_spadea/ Maria Francesca Spadea]  
+
*[http://www.imagenglab.com/newsite/mf_spadea/ Maria Francesca Spadea] (Magna Graecia University, Italy)
|-
+
*[http://www.imperial.ac.uk/people/g.pernelle14 Guillaume Pernelle] (remote) (Imperial College, London, UK)
|[http://www.imperial.ac.uk/people/g.pernelle14 Guillaume Pernelle] (remote) || [http://www.spl.harvard.edu/pages/People/mehrtash Alireza Mehrtash] (remote) ||  [http://www.spl.harvard.edu/pages/People/tkapur Tina Kapur]
+
*[http://www.spl.harvard.edu/pages/People/mehrtash Alireza Mehrtash] (remote) (Brigham and Women's Hospital, Harvard Medical School, USA)
|}
+
*[http://www.spl.harvard.edu/pages/People/tkapur Tina Kapur] (Brigham and Women's Hospital, Harvard Medical School, USA)
  
 
==Project Description==
 
==Project Description==
 +
 +
NeedleFinder is a tool for segmentation of needles from MR scans which requires manual initialization of the tip of the needle. It has been tested extensively on MR-guided gynecologic brachytherapy data, and preliminarily on MR-guided prostate biopsy data.  In this project, we aim to eliminate this reliance on manual interaction and develop a completely automatic strategy to segment the needles.  We have tested a CNN approach that provides good results, even if a post processing step must be implemented in order to remove some noise and to refine the obtained segmentations.
 +
 
{| class="wikitable"
 
{| class="wikitable"
 
! style="text-align: left; width:27%" |  Objective
 
! style="text-align: left; width:27%" |  Objective
Line 20: Line 22:
 
|
 
|
 
<!-- Objective bullet points -->
 
<!-- Objective bullet points -->
Please start each sentence in a new line.
+
* Refine/clear the segmentations coming from the CNN algorithm.
 
+
* Figure out how to transfer MRIs to a server hosting the CNN code and get back the results.
Like this.
 
 
|
 
|
 
<!-- Approach and Plan bullet points -->
 
<!-- Approach and Plan bullet points -->
Please start each sentence in a new line.
+
* Clustering and morphological filters for data cleaning.
+
* Talk with someone from the core team to figure out how to remotely process the data.
 
|
 
|
 
<!-- Progress and Next steps (fill out at the end of project week) -->
 
<!-- Progress and Next steps (fill out at the end of project week) -->
Please start each sentence in a new line.
+
* A bridge between data coming by the unet and the already existing NeedleFinder module was implemented. Now we are able to use the segmentations generated by the unet to initialize the NeedleFinder algorithm. The process is completely automatic. [https://github.com/needlefinder/NunetFinder/blob/master/NunetFinder.py The code is here]
 
+
* We had an interesting discussion with Steve about DeepInfer.
 
 
 
|}
 
|}
  
 
==Illustrations==
 
==Illustrations==
  
 
+
[[File:NunetFinder.png|900px|thumb|left|Red volume: ground truth, yellow circles: needle coming from NeedleFinder, labels: segmentation coming from unet]]
https://www.slicer.org/img/Slicer4Announcement-HiRes.png  
 
 
 
 
 
  
 
<embedvideo service="youtube">https://youtu.be/5G9t6DZ8KrM</embedvideo>
 
<embedvideo service="youtube">https://youtu.be/5G9t6DZ8KrM</embedvideo>
Line 47: Line 44:
  
 
#[http://www.needlefinder.org  NeedleFinder website]
 
#[http://www.needlefinder.org  NeedleFinder website]
#
+
#[https://arxiv.org/abs/1705.06712 Model-based Catheter Segmentation in MRI-images]

Latest revision as of 09:08, 30 June 2017

Home < Project Week 25 < NeedleSegmentation


Back to Projects List

Key Investigators

Project Description

NeedleFinder is a tool for segmentation of needles from MR scans which requires manual initialization of the tip of the needle. It has been tested extensively on MR-guided gynecologic brachytherapy data, and preliminarily on MR-guided prostate biopsy data. In this project, we aim to eliminate this reliance on manual interaction and develop a completely automatic strategy to segment the needles. We have tested a CNN approach that provides good results, even if a post processing step must be implemented in order to remove some noise and to refine the obtained segmentations.

Objective Approach and Plan Progress and Next Steps
  • Refine/clear the segmentations coming from the CNN algorithm.
  • Figure out how to transfer MRIs to a server hosting the CNN code and get back the results.
  • Clustering and morphological filters for data cleaning.
  • Talk with someone from the core team to figure out how to remotely process the data.
  • A bridge between data coming by the unet and the already existing NeedleFinder module was implemented. Now we are able to use the segmentations generated by the unet to initialize the NeedleFinder algorithm. The process is completely automatic. The code is here
  • We had an interesting discussion with Steve about DeepInfer.

Illustrations

Red volume: ground truth, yellow circles: needle coming from NeedleFinder, labels: segmentation coming from unet

Background and References

  1. NeedleFinder website
  2. Model-based Catheter Segmentation in MRI-images