Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
January 26, 2026The European Physical Journal COpen Access

iDDS: intelligent distributed dispatch and scheduling for workflow orchestration

View Full Paper
Ask AI
Bookmark
Share

Authors

WGWen GuanTMTadashi MaenoAAAleksandr Alekseev

Discussion

Loading...

Member takes

Overview

This system improves workflow automation in scientific computing, supporting diverse applications across infrastructures.

Key Points

  • The aim is to present the capabilities and architecture of the iDDS service for workflow orchestration in distributed environments.
  • Developed for large-scale distributed scientific computing
  • Integrates data-aware execution and conditional logic
  • Supports both template-driven workflows and function-as-a-task model
  • Showcases real-world applications for ATLAS and Rubin Observatory
  • Addresses future challenges in interactive and cloud-native environments
  • iDDS reduces operational overhead and enhances workflow reproducibility
  • Demonstrated effectiveness in orchestrating complex data processing pipelines
  • Facilitated hyperparameter optimization for machine learning and active learning in physics
  • Supports high-throughput workflows over heterogeneous infrastructure

Cite This Study

Guan et al. (2026) studied this question.

synapsesocial.com/papers/697703af722626c4468e8b59https://doi.org/10.1140/epjc/s10052-025-15275-7
View Full Paper
Ask AI
Bookmark
Share