2016 Summer Project Week/CommonGL

• 

  Projects List

• 
• 
• 
• 

Key Investigators

• Steve Pieper, Isomics, Inc.
• Jim Miller, GE
• Christian, Simon, Andras, Fernando, Marco...
• Others are welcome to join!

Project Description

Objective	Approach and Plan	Progress and Next Steps
Move forward on a set of code to do GPU computing with multiple target platforms in mind as described in these slides and videos.	Progress from 2016 Winter Project Week: Identify use cases that would be good for this approach Visualization Segmentation Registration Code review and refinement of Slicer OpenGL shader/texture classes Evaluate build and deployment issues on various platforms Test code performance on various platforms Implement one or more sample image algorithms and compare with CPU implementation Performance Ease of development, readability, maintainability... Scalability limits Discussed motivation and implementation options with many members of the community Positive feedback on goals and opportunity Potential use cases identified as possible points of collaboration (Sandy Wells, Terry Yoo, Dan Blezek, Curt Lisle, Sudhanshu Semwal...) Additional motivation from IGT projects Real-time brain shift visualization for AMIGO neurosurgery Interactive segmentation/volume rendering for SlicerHeart and other applications Code and architecture review Experimental compositing options (see sphere-subtract image above)	Looked at examples of current functionaltiy https://www.youtube.com/watch?v=fV7rh76vBvs https://www.youtube.com/watch?v=_0K9vxgdwUU Review of requirements, previous implementations, design options Goal to have a common set of functionality across applications (Slicer, CustusX, IBIS, MITK, etc...) General feeling that a dedicated project week for GPU volume rendering would be a good idea.

Background and References

• A document describing some considerations on CommonGL
• Prototype code
  • VTK Classes to support GLSL programming: https://github.com/pieper/Slicer/tree/add-commongl
  • Scripted module for rendering: https://github.com/pieper/CommonGL/tree/master/ShaderComputation
• Video showing CT + MR compositing, nonlinear spatial transform, and interactive positioning of geometric objects
• Video showing smart editor tool implemented with GLSL
• Babybrain collaboration (Boston XTK/SliceDrop/Children's Hospital, Nicolas, Steve, Rudolph, Daniel...)
  • VJS https://github.com/FNNDSC/vjs
  • WebGL ray cast demo: http://fnndsc.github.io/vjs/#shaders_raycasting_adibrain

Other WebGL / GLSL references

• Image processing in WebGL: https://www.gitbook.com/book/projectseptemberinc/gl-react/details
• Fun GLSL demos
  • http://glslsandbox.com
  • http://shadertoy.com
• WebGL graphics library: http://threejs.org