Difference between revisions of "Slicer3:Pipeline Integration"
From NAMIC Wiki
m (Update from Wiki) |
m (Update from Wiki) |
||
| Line 1: | Line 1: | ||
# The main features of the project | # The main features of the project | ||
## http://pipeline.loni.ucla.edu | ## http://pipeline.loni.ucla.edu | ||
| − | # The main outstanding questions that must be answered before you can complete the | + | # The main outstanding questions that must be answered before you can complete the project :: |
## Pipeline -> Slicer3 | ## Pipeline -> Slicer3 | ||
### Once the API for submission to Slicer3 is released, we can integrate it into the Pipeline. | ### Once the API for submission to Slicer3 is released, we can integrate it into the Pipeline. | ||
## Slicer3 -> Pipeline | ## Slicer3 -> Pipeline | ||
| − | + | ### We have made considerable progress in making Pipeline more stable, robust and scalable. Detailed progress is listed below :: | |
| − | + | #### GUI : A new and improved graphical interface is now available. The gui is now much simpler in design and easier to use. The list of improvements/ new features is as follows : | |
| − | #### | ||
| − | |||
| − | + | - Completely new data model/xml | |
| − | + | - Significantly easier parameter editing | |
| − | + | - Cleaner drag and drop of modules | |
| − | + | - Easier list processing | |
| − | + | - Stronger type checking (with feedback to help the user) | |
| − | + | - Variable can be used on parameter bindings | |
| − | + | - Personal Library of workflows and moduels | |
| − | + | - Copy/Paste of single modules and groups of modules (and still retain connections) | |
| − | + | - Undo/Redo on most operations | |
| − | + | - Workflows can be layed out horizontally now | |
| − | + | - Faster and easier zooming | |
| − | + | - Scalable GUI functionality - is able to handle hundreds of modules in a single workflow | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | # This | + | # ## ### #### DataModel : The data model, associated XML descriptions have been simplified greatly. The data model has been decoupled from the execution and the GUI, this component has been completed |
| + | #### Translation : The translation portion of the software is responsible for accomodating logic that separates GUI/Execution vs Execution. This component has been completed, it takes the workflow and converts it into a flattened graph (it loses the property of module groups at this stage) and constructs the commands using the data model | ||
| + | #### Validation : The validation portion conducts sanity checks on the workflow. It allows the user to fix errors prior to "actual" execution and informs the user of all steps needed to make the workflow run | ||
| + | #### Execution : The execution portion now is an independent component that is agnostic of the data model and can be invoked on the command line directly. Self-sufficient workflows (with previously bound parameters), can be now invoked and executed from the commandline, bypassing the GUI entirely. Workflows or pipes can now be executed both locally and on the LONI grid. The scalability has dramatically improved from 30 inputs to thousands of inputs per workflow. The changes in the execution model are :: | ||
| − | + | - Agnostic of the data model | |
| − | + | - Minimal synchronization to express sequentiality and/or parallelism | |
| − | + | - Local execution and LONI grid execution supported | |
| − | + | - Detailed logs to keep track of progress | |
| − | + | - Periodic status messages passed to GUI for immediate user feedback | |
| − | + | - Scalability of execution allows running > 1000 inputs per workflow | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
# To start a pipeline on the commandline with parameters: | # To start a pipeline on the commandline with parameters: | ||
| − | java - | + | java -classpath pipeline.client.jar ui.cli.Main -execute prebound_workflow |
'''Team Members'''<nowiki>: </nowiki> | '''Team Members'''<nowiki>: </nowiki> | ||
| − | |||
* Jagadeeswaran Rajendiran - UCLA | * Jagadeeswaran Rajendiran - UCLA | ||
Revision as of 13:42, 18 December 2006
Home < Slicer3:Pipeline Integration- The main features of the project
- The main outstanding questions that must be answered before you can complete the project ::
- Pipeline -> Slicer3
- Once the API for submission to Slicer3 is released, we can integrate it into the Pipeline.
- Slicer3 -> Pipeline
- We have made considerable progress in making Pipeline more stable, robust and scalable. Detailed progress is listed below ::
- GUI : A new and improved graphical interface is now available. The gui is now much simpler in design and easier to use. The list of improvements/ new features is as follows :
- We have made considerable progress in making Pipeline more stable, robust and scalable. Detailed progress is listed below ::
- Pipeline -> Slicer3
- Completely new data model/xml - Significantly easier parameter editing - Cleaner drag and drop of modules - Easier list processing - Stronger type checking (with feedback to help the user) - Variable can be used on parameter bindings - Personal Library of workflows and moduels - Copy/Paste of single modules and groups of modules (and still retain connections) - Undo/Redo on most operations - Workflows can be layed out horizontally now - Faster and easier zooming - Scalable GUI functionality - is able to handle hundreds of modules in a single workflow
- ## ### #### DataModel : The data model, associated XML descriptions have been simplified greatly. The data model has been decoupled from the execution and the GUI, this component has been completed
- Translation : The translation portion of the software is responsible for accomodating logic that separates GUI/Execution vs Execution. This component has been completed, it takes the workflow and converts it into a flattened graph (it loses the property of module groups at this stage) and constructs the commands using the data model
- Validation : The validation portion conducts sanity checks on the workflow. It allows the user to fix errors prior to "actual" execution and informs the user of all steps needed to make the workflow run
- Execution : The execution portion now is an independent component that is agnostic of the data model and can be invoked on the command line directly. Self-sufficient workflows (with previously bound parameters), can be now invoked and executed from the commandline, bypassing the GUI entirely. Workflows or pipes can now be executed both locally and on the LONI grid. The scalability has dramatically improved from 30 inputs to thousands of inputs per workflow. The changes in the execution model are ::
- Agnostic of the data model - Minimal synchronization to express sequentiality and/or parallelism - Local execution and LONI grid execution supported - Detailed logs to keep track of progress - Periodic status messages passed to GUI for immediate user feedback - Scalability of execution allows running > 1000 inputs per workflow
- To start a pipeline on the commandline with parameters:
java -classpath pipeline.client.jar ui.cli.Main -execute prebound_workflow
Team Members:
- Jagadeeswaran Rajendiran - UCLA
