Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create extension/package/namespace to capture information needed for parallel execution #157

Open
jonrkarr opened this issue May 10, 2021 · 0 comments
Labels

Comments

@jonrkarr
Copy link
Contributor

Several discussions have highlighted the need to execute SED-ML tasks in parallel -- see #54. This has led to clarifying the meaning of subtask/@order -- see #95.

To facilitate parallel execution, SED-ML needs more information. To avoid complicating the core of SED-ML, this could be placed in a separate namespace similar to SBML packages.

Additional classes/attributes could be added for this information. This would enable parallel execution, for example by conversion into a CWL file and execution with a CWL engine such as Airflow or Toil or conversion to Nextflow.

  • Tasks
    • CPU requirements
    • Memory requirements
    • Walltime requirements
    • Preferred tool to execute the task (e.g., a URL for a Docker image)
    • Environment variables (e.g., for licenses to software)
  • Subtasks
    • Dependency on other subtasks
  • Outputs
    • Plot (creation) in particular needs similar information to tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant