Difference between revisions of "4DUSandEndoscope"

From NAMIC Wiki
Jump to: navigation, search
Tag: 2017 source edit
 
(47 intermediate revisions by 3 users not shown)
Line 32: Line 32:
 
The goal of this project is to create a new 3D Slicer Module that can overlay patient registered 4D US volumes with endoscopic images.
 
The goal of this project is to create a new 3D Slicer Module that can overlay patient registered 4D US volumes with endoscopic images.
  
−
The Project is divided into four part: 4D Ultrasound, Patient-Image Registration, Endoscope Overlay, and Endoscope Calibration. All four parts will be accessable through a single 3D Slicer Module.
+
The Project is divided into four part: 4D Ultrasound Volume Reconstruction, Patient-Image Registration, Endoscope Overlay, and Endoscope Calibration. All four parts will be accessable through a single 3D Slicer Module.
 +
 
 +
[[Image:ModuleWorkflow.png | 600px ]]
  
 
=== Overall Progress ===
 
=== Overall Progress ===
Line 73: Line 75:
  
 
|height="10px" |
 
|height="10px" |
 +
|-
 +
 +
| || colspan="2" | New PC set up ||align="center" | x || Thu Jul, 30th
  
 
|-
 
|-
  
−
| || colspan="2" | ||align="center" | ||  
+
| || colspan="2" | New PC arrived ||align="center" | x || Tue Jul, 28th
  
 
|- bgcolor="#E8E8E8"
 
|- bgcolor="#E8E8E8"
Line 92: Line 97:
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 100: Line 105:
 
=== General To Do ===
 
=== General To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 112: Line 117:
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left" width="730px"|Order new PC
+
| align="center" width="70px" | O || align="left" width="730px"|Order new Frame Grabber Card
  
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left" width="730px"|Order new Frame Grabber Card
+
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" width="730px"|Set Up New Computer
 +
 
 +
|-
 +
 
 +
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" width="730px"|Order new PC
  
 
|-
 
|-
  
 
| align="center" bgcolor="#009900" | DONE || align="left" | Create Project Page
 
| align="center" bgcolor="#009900" | DONE || align="left" | Create Project Page
−
|- bgcolor="silver"
 
−
 
−
! colspan="2" | Create 3D volume with Synchrograb
 
  
 
|-
 
|-
  
 
|}
 
|}
 +
 +
=== Details ===
 +
 +
* The following frame grabber card only provides grayscale images: I-O DATA GV-VCP3R/PCI (video decoder chip CX2388x) [http://www.iodata.jp/product/tv/capture/gv-vcp3pci/index.htm]
 +
 +
 +
----
 +
----
  
 
== 3D Slicer Module ==
 
== 3D Slicer Module ==
 +
 +
 +
 
* Responsible: Jan Gumprecht
 
* Responsible: Jan Gumprecht
 
=== Details ===
 
=== Details ===
 +
* The module is available through svn: http://svn.na-mic.org/NAMICSandBox/trunk/IGTLoadableModules/4DUsEndoNav/
  
 
=== Progress ===
 
=== Progress ===
Line 160: Line 178:
  
 
|height="10px" |
 
|height="10px" |
 +
 +
|-
 +
 +
| width="80px"| || colspan="2" width="550px"| Source Code checked in to svn ||align="center" width="50px" |  x || width="120px" |  Thu, Aug 6th
 +
 +
|-
 +
 +
| width="80px"| || colspan="2" width="550px"| Second Window works ||align="center" width="50px" |  x || width="120px" |  Thu, Aug 6th
  
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
Line 168: Line 194:
  
 
|height="10px" |
 
|height="10px" |
 +
 +
|-
 +
 +
| width="80px"| || colspan="2" width="550px"| Created First prototype of module ||align="center" width="50px" |  x || width="120px" |  Fri, Jul 31st
  
 
|- bgcolor="#E8E8E8"
 
|- bgcolor="#E8E8E8"
Line 176: Line 206:
  
 
|height="10px" |
 
|height="10px" |
−
 
−
|-
 
−
 
−
| width="80px"| || colspan="2" width="550px"| Create first prototype of model ||align="center" width="50px" |  x || width="120px" |  Fri, Jul 25th
 
  
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 191: Line 217:
 
=== To Do ===
 
=== To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 199: Line 225:
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left"| Create first prototyp of module
+
| align="center" width="70px" | O || align="left" | Close Second window with OS native commands, i.e. click the "X" in the right upper corner
  
 
|-
 
|-
Line 207: Line 233:
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left" width="730px"| Read docu of Prostate nav module
+
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" | Check in source to svn
  
−
|- bgcolor="silver"
+
|-
 +
 
 +
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" | Include Second Window source code
 +
 
 +
|-
  
−
! colspan="2" | 3D Slicer module
+
| align="center" width="70px" bgcolor="#009900" | DONE || align="left"| Create first prototyp of module, i.e. adapt IGTWizard Module
  
 
|-
 
|-
Line 217: Line 247:
 
|}
 
|}
  
−
== 4D Ultrasound ==
+
 
 +
----
 +
 
 +
----
 +
 
 +
== 4D Ultrasound Volume Reconstruction==
 
* Responsible: Jan Gumprecht
 
* Responsible: Jan Gumprecht
 
=== Details ===
 
=== Details ===
Line 262: Line 297:
  
 
| width="80" | || width="550" colspan="2" | Update Calibration and Spacing Handeling  || width="50" align="center" |  || width="120" |
 
| width="80" | || width="550" colspan="2" | Update Calibration and Spacing Handeling  || width="50" align="center" |  || width="120" |
 +
 +
|-
 +
 +
| width="80" | || width="550" colspan="2" | New Commandline parameter added to grab a test image  || width="50" align="center" | x || width="120" | Tue, Jul 30th
 +
 +
|-
 +
 +
| width="80" | || width="550" colspan="2" | All parameters of the calibration file are now used  || width="50" align="center" | x || width="120" | Tue, Jul 28th
 +
 +
|-
 +
 +
| width="80" | || width="550" colspan="2" | OpenIGTLink is now externally, no local copy within the source code is used anymore  || width="50" align="center" | x || width="120" | Mon, Jul 27th
  
 
|- bgcolor="#E8E8E8"
 
|- bgcolor="#E8E8E8"
Line 276: Line 323:
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 284: Line 331:
 
=== To Do ===
 
=== To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 292: Line 339:
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left" width="730"| Update CalibratioFileReader
+
| align="center" width="70px" s| O || align="left" width="730"| Find Segmentation Fault
  
 
|-
 
|-
Line 304: Line 351:
 
|-
 
|-
  
−
| align="center" width="70px" | O || align="left" width="730"| Set up existing Hardware for first demo
+
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" width="730"| Set up existing Hardware for first demo
  
−
|- bgcolor="silver"
+
|-
  
−
! colspan="2" | 4D Ultrasound
+
| align="center" width="70px" bgcolor="#009900" | DONE || align="left" width="730"| Update CalibrationFileReader
  
 
|-
 
|-
  
 
|}
 
|}
 +
 +
 +
 +
----
 +
 +
----
  
 
== Patient-Image Registration ==
 
== Patient-Image Registration ==
Line 370: Line 423:
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 378: Line 431:
 
=== To Do ===
 
=== To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 388: Line 441:
 
| align="center" width="70px" | O || align="left" width="730"|Dummy Task
 
| align="center" width="70px" | O || align="left" width="730"|Dummy Task
  
−
|- bgcolor="silver"
+
|-
 +
 
 +
|}
 +
 
  
−
! colspan="2" | Patient-Image registration
 
  
−
|-
+
----
  
−
|}
+
----
  
 
== Endoscope Overlay ==
 
== Endoscope Overlay ==
−
* Responsible: Yaamada Atsushi, Haiying Liu
+
* Responsible: Yamada Atsushi, Haiying Liu
−
* [http://www.na-mic.org/Wiki/index.php/OpenCV_Module_in_Slicer3 OpenCV module in Slicer3]
 
 
=== Details ===
 
=== Details ===
 +
* [http://www.na-mic.org/Wiki/index.php/OpenCV_Module_in_Slicer3 OpenCV Module in Slicer3]
 +
* [http://www.na-mic.org/Wiki/index.php/Slicer3_FlexibleLayouts Multiple Camera Support in Slicer3]
 +
* [http://wiki.ncigt.org/index.php/U41:Prostate:BRP:Common_Module_For_Multiple_Robots Transrectal/Transperineal biopsy robot module merge]
 +
* [http://opencv.willowgarage.com/wiki/ Open CV Wiki]
 +
* [http://wiki.intelli-si.org/index.php?title=2009SummerSecondDisplayProject Summer Second Display Project] (Japanese)
 +
 +
=== Bug Fixes for the 3D Slicer Module ===
 +
 +
* There is a bug in OpenCV related to V4L2 devices:
 +
** Here is the bugtrac with information: [[https://bugs.launchpad.net/ubuntu/+source/linux/+bug/260251]]
 +
*** Somehow this is related to bttv 878 cards. OpenCV seem not to be able to handle all output of the card correctly
 +
** Here is the fix [[http://opencvlibrary.svn.sourceforge.net/viewvc/opencvlibrary/trunk/opencv/src/highgui/cvcap_v4l.cpp?r1=1604&r2=1609]]
 +
*** Apply the changes of revision 1609 to the file # opencv/src/highgui/cvcap_v4l.cpp
  
 
=== Progress ===
 
=== Progress ===
Line 455: Line 522:
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 463: Line 530:
 
=== To Do ===
 
=== To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 479: Line 546:
  
 
|}
 
|}
 +
 +
 +
 +
----
 +
 +
----
  
 
== Endoscope Calibration ==
 
== Endoscope Calibration ==
Line 538: Line 611:
 
|- bgcolor="#D0D0D0"
 
|- bgcolor="#D0D0D0"
  
−
! Juli !! Week 30 || 20.07.09 - 26.07.09 || ||
+
! July !! Week 30 || 20.07.09 - 26.07.09 || ||
  
 
|-
 
|-
Line 546: Line 619:
 
=== To Do ===
 
=== To Do ===
  
−
{|border="0", cellpadding="5"
+
{|border="0" cellpadding="5"
  
 
|- bgcolor="silver"
 
|- bgcolor="silver"
Line 555: Line 628:
  
 
| align="center" width="70px" | O || align="left" width="730"| Dummy Task
 
| align="center" width="70px" | O || align="left" width="730"| Dummy Task
−
 
−
|-
 
−
 
−
|- bgcolor="silver"
 
−
 
−
! colspan="2" | Create 3D volume with Synchrograb
 
  
 
|-
 
|-
  
 
|}
 
|}

Latest revision as of 05:23, 11 April 2023

Home < 4DUSandEndoscope

Project Page for 4D Ultrasound with Endoscopic Overlay

Collaborators

Jan Gumprecht

  • E-Mail: jgumprec(at)bwh.harvard.edu
  • Location: Kyushu, Japan
  • Timezone: GMT + 9

Jae-Sung Hung, PhD

  • E-Mail: hong(at)dem.med.kyushu-u.ac.jp
  • Location: Kyushu, Japan
  • Timezone: GMT + 9

Nobuhiko Hata, PhD

  • E-Mail: hata(at)bwh.harvard.edu
  • Location: Boston, USA
  • Timezone: GMT - 5

Haiying Liu

  • E-Mail: hliu(at)bwh.harvard.edu
  • Location: Boston, USA
  • Timezone: GMT - 5

Yamada Atsushi, PhD

  • E-Mail: yamada.atsushi(at)nitech.ac.jp
  • Location: Nagoya, Japan
  • Timezone: GMT + 9

Project Description

The goal of this project is to create a new 3D Slicer Module that can overlay patient registered 4D US volumes with endoscopic images.

The Project is divided into four part: 4D Ultrasound Volume Reconstruction, Patient-Image Registration, Endoscope Overlay, and Endoscope Calibration. All four parts will be accessable through a single 3D Slicer Module.

ModuleWorkflow.png

Overall Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
Endoscopic Overlay and Endoscopic Calibration shall be finished
August Week 32 03.08.09 - 09.08.09
New PC set up x Thu Jul, 30th
New PC arrived x Tue Jul, 28th
Week 31 27.07 - 02.08
Project Page created x Fri Jul, 24th
July Week 30 20.07.09 - 26.07.09

General To Do

Tasks
O Fill Project Page with Information
O Order new Frame Grabber Card
DONE Set Up New Computer
DONE Order new PC
DONE Create Project Page

Details

  • The following frame grabber card only provides grayscale images: I-O DATA GV-VCP3R/PCI (video decoder chip CX2388x) [1]


3D Slicer Module

  • Responsible: Jan Gumprecht

Details

Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
Source Code checked in to svn x Thu, Aug 6th
Second Window works x Thu, Aug 6th
August Week 32 03.08.09 - 09.08.09
Created First prototype of module x Fri, Jul 31st
Week 31 27.07 - 02.08
July Week 30 20.07.09 - 26.07.09

To Do

Tasks
O Close Second window with OS native commands, i.e. click the "X" in the right upper corner
O Comprehend Prostate nav module's source code
DONE Check in source to svn
DONE Include Second Window source code
DONE Create first prototyp of module, i.e. adapt IGTWizard Module


4D Ultrasound Volume Reconstruction

  • Responsible: Jan Gumprecht

Details

The project is described here: [[2]]

Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
August Week 32 03.08.09 - 09.08.09
Update Calibration and Spacing Handeling
New Commandline parameter added to grab a test image x Tue, Jul 30th
All parameters of the calibration file are now used x Tue, Jul 28th
OpenIGTLink is now externally, no local copy within the source code is used anymore x Mon, Jul 27th
Week 31 27.07 - 02.08
Show demo of the system
July Week 30 20.07.09 - 26.07.09

To Do

Tasks
O Find Segmentation Fault
O Update Handling of Spacing
O Update Calibration Part
DONE Set up existing Hardware for first demo
DONE Update CalibrationFileReader


Patient-Image Registration

  • Responsible: Jae-Sung Hong

Details

Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
August Week 32 03.08.09 - 09.08.09
Start integration with 4D Ultrasound
Week 31 27.07 - 02.08


July Week 30 20.07.09 - 26.07.09

To Do

Tasks
O Dummy Task


Endoscope Overlay

  • Responsible: Yamada Atsushi, Haiying Liu

Details

Bug Fixes for the 3D Slicer Module

  • There is a bug in OpenCV related to V4L2 devices:
    • Here is the bugtrac with information: [[3]]
      • Somehow this is related to bttv 878 cards. OpenCV seem not to be able to handle all output of the card correctly
    • Here is the fix [[4]]
      • Apply the changes of revision 1609 to the file # opencv/src/highgui/cvcap_v4l.cpp

Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
Endoscopic Overlay shall be finished
August Week 32 03.08.09 - 09.08.09
Week 31 27.07 - 02.08
July Week 30 20.07.09 - 26.07.09

To Do

Tasks
O Dummy Task
Endoscope overlay


Endoscope Calibration

  • Responsible: Dr. Yang

Details

Progress

Month Week # Start Date - End Date Done Date Done
Week 34 17.08 - 23.08
Week 33 10.08 - 16.08
Endoscopic Calibration shall be finished
August Week 32 03.08.09 - 09.08.09
Week 31 27.07 - 02.08
July Week 30 20.07.09 - 26.07.09

To Do

Tasks
O Dummy Task
Retrieved from "https://www.na-mic.org/w/index.php?title=4DUSandEndoscope&oldid=98832"