4DUSandEndoscope

Project Page for 4D Ultrasound with Endoscopic Overlay

Collaborators

Jan Gumprecht

• E-Mail: jgumprec(at)bwh.harvard.edu
• Location: Kyushu, Japan
• Timezone: GMT + 9

Jae-Sung Hung, PhD

• E-Mail: hong(at)dem.med.kyushu-u.ac.jp
• Location: Kyushu, Japan
• Timezone: GMT + 9

Nobuhiko Hata, PhD

• E-Mail: hata(at)bwh.harvard.edu
• Location: Boston, USA
• Timezone: GMT - 5

Haiying Liu

• E-Mail: hliu(at)bwh.harvard.edu
• Location: Boston, USA
• Timezone: GMT - 5

Yamada Atsushi, PhD

• E-Mail: yamada.atsushi(at)nitech.ac.jp
• Location: Nagoya, Japan
• Timezone: GMT + 9

Project Description

The goal of this project is to create a new 3D Slicer Module that can overlay patient registered 4D US volumes with endoscopic images.

The Project is divided into four part: 4D Ultrasound Volume Reconstruction, Patient-Image Registration, Endoscope Overlay, and Endoscope Calibration. All four parts will be accessable through a single 3D Slicer Module.

Overall Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
	Endoscopic Overlay and Endoscopic Calibration shall be finished
August	Week 32	03.08.09 - 09.08.09
	New PC set up		x	Thu Jul, 30th
	New PC arrived		x	Tue Jul, 28th
	Week 31	27.07 - 02.08
	Project Page created		x	Fri Jul, 24th
July	Week 30	20.07.09 - 26.07.09

General To Do

Tasks
O	Fill Project Page with Information
O	Order new Frame Grabber Card
DONE	Set Up New Computer
DONE	Order new PC
DONE	Create Project Page

Details

• The following frame grabber card only provides grayscale images: I-O DATA GV-VCP3R/PCI (video decoder chip CX2388x) [1]

---

---

3D Slicer Module

• Responsible: Jan Gumprecht

Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
	Second Window works		x	Thu, Aug 6th
August	Week 32	03.08.09 - 09.08.09
	Created First prototype of module		x	Fri, Jul 31st
	Week 31	27.07 - 02.08
July	Week 30	20.07.09 - 26.07.09

To Do

Tasks
O	Close Second window with OS native commands, i.e. click the "X" in the right upper corner
O	Comprehend Prostate nav module's source code
DONE	Include Second Window source code
DONE	Create first prototyp of module, i.e. adapt IGTWizard Module

---

---

4D Ultrasound Volume Reconstruction

• Responsible: Jan Gumprecht

Details

The project is described here: [[2]]

Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
August	Week 32	03.08.09 - 09.08.09
	Update Calibration and Spacing Handeling
	New Commandline parameter added to grab a test image		x	Tue, Jul 30th
	All parameters of the calibration file are now used		x	Tue, Jul 28th
	OpenIGTLink is now externally, no local copy within the source code is used anymore		x	Mon, Jul 27th
	Week 31	27.07 - 02.08
	Show demo of the system
July	Week 30	20.07.09 - 26.07.09

To Do

Tasks
O	Find Segmentation Fault
O	Update Handling of Spacing
O	Update Calibration Part
DONE	Set up existing Hardware for first demo
DONE	Update CalibrationFileReader

---

---

Patient-Image Registration

• Responsible: Jae-Sung Hong

Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
August	Week 32	03.08.09 - 09.08.09
	Start integration with 4D Ultrasound
	Week 31	27.07 - 02.08
July	Week 30	20.07.09 - 26.07.09

To Do

Tasks
O	Dummy Task

---

---

Endoscope Overlay

• Responsible: Yamada Atsushi, Haiying Liu

Details

• OpenCV Module in Slicer3
• Multiple Camera Support in Slicer3
• Transrectal/Transperineal biopsy robot module merge
• Open CV Wiki
• Summer Second Display Project (Japanese)

Bug Fixes for the 3D Slicer Module

• There is a bug in OpenCV related to V4L2 devices:
  • Here is the bugtrac with information: [[3]]
    • Somehow this is related to bttv 878 cards. OpenCV seem not to be able to handle all output of the card correctly
  • Here is the fix [[4]]
    • Apply the changes of revision 1609 to the file # opencv/src/highgui/cvcap_v4l.cpp

Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
	Endoscopic Overlay shall be finished
August	Week 32	03.08.09 - 09.08.09
	Week 31	27.07 - 02.08
July	Week 30	20.07.09 - 26.07.09

To Do

Tasks
O	Dummy Task
Endoscope overlay

---

---

Endoscope Calibration

• Responsible: Dr. Yang

Progress

Month	Week #	Start Date - End Date	Done	Date Done
	Week 34	17.08 - 23.08
	Week 33	10.08 - 16.08
	Endoscopic Calibration shall be finished
August	Week 32	03.08.09 - 09.08.09
	Week 31	27.07 - 02.08
July	Week 30	20.07.09 - 26.07.09

To Do

Tasks
O	Dummy Task