Managing Event Oriented Workflows

David Marchant, Rasmus Munk, Elise O. Brenne, Brian Vinter

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review

5 Citations (Scopus)

Abstract

This paper introduces an event-driven solution for modern scientific workflows. This novel approach enables truly dynamic workflows by splitting them into their constituent parts, defined using combinations of Patterns and Recipes, and lacking any meaningful inter-dependencies. The theory behind this system is set out, and an example workflow is presented. A python package mig-meow, which implements this workflow system is also shown and explained. The use cases of various user groups are considered to asses the feasibility of the design, and it is found to be sufficient, especially in light of recent workflow requirements for dynamic looping, optional outputs and in-The-loop interactions.

Original languageEnglish
Title of host publicationProceedings of XLOOP 2020 : 2nd Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing, Held in conjunction with SC 2020: The International Conference for High Performance Computing, Networking, Storage and Analysis
Number of pages6
PublisherIEEE
Publication dateNov 2020
Pages23-28
Article number9307825
ISBN (Electronic)9780738110721
DOIs
Publication statusPublished - Nov 2020
Event2nd IEEE/ACM Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing, XLOOP 2020 - Virtual, Atlanta, United States
Duration: 12 Nov 2020 → …

Conference

Conference2nd IEEE/ACM Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing, XLOOP 2020
Country/TerritoryUnited States
CityVirtual, Atlanta
Period12/11/2020 → …
SeriesProceedings of XLOOP 2020: 2nd Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing, Held in conjunction with SC 2020: The International Conference for High Performance Computing, Networking, Storage and Analysis

Keywords

  • adaptive
  • dynamic
  • event driven
  • Jupyter
  • MiG
  • workflow

Fingerprint

Dive into the research topics of 'Managing Event Oriented Workflows'. Together they form a unique fingerprint.

Cite this