Scaling Scientific Workflows in Europe: Architecture and Deployment of the Galaxy-Pulsar Computational Network

Overview
Related items

Abstract:

Description

This preprint outlines the development and deployment of the European Pulsar Network (EPN)—a federated, scalable architecture enabling distributed job execution across national and European Galaxy instances. Built within the Horizon Europe EuroScienceGateway project, the EPN leverages the Galaxy workflow system and the Pulsar job execution service to offload computational workloads to remote endpoints seamlessly and securely. The work introduces an Open Infrastructure (OI) framework that automates provisioning, deployment, and monitoring using Terraform, Ansible, and Jenkins. The pre-print highlights deployments across thirteen Pulsar nodes and six national Galaxy portals, illustrating how the EPN supports reproducible, FAIR-aligned data analysis while abstracting infrastructure complexity for researchers.

SEEK ID: https://workflowhub.eu/publications/46

DOI: 10.5281/zenodo.16761933

Teams: EuroScienceGateway

Publication type: Unpublished

Publisher: Zenodo

Citation: https://doi.org/10.5281/zenodo.16761933

Date Published: 7th Aug 2025

URL: https://doi.org/10.5281/zenodo.16761933

Registered Mode: imported from a bibtex file

Authors: Marco Antonio Tangaro, Stefano Nicotri, Björn Grüning, Sanjay Kumar Srikakulam, Armin Dadras, Oana Kaiser, Mira Kuntz, Anthony Bretaudeau, Paul De Geest, Sebastian Luna-Valero, María Chavero Díez, José María Fernández González, Salvador Capella-Gutierrez, Josep Lluís Gelpí, Jan Astalos, Boris Jurič, Miroslav Ruda, Łukasz Opioła, Hakan Bayındır, SILVIA GIOIOSA, Gaetanomaria De Sanctis, Federico Zambelli

Help

Tree Split Graph

Submitter

Stian Soiland-Reyes

Citation

Tangaro, M. A., Nicotri, S., Grüning, B., Srikakulam, S. K., Dadras, A., Kaiser, O., Kuntz, M., Bretaudeau, A., De Geest, P., Luna-Valero, S., Chavero Díez, M., Fernández González, J. M., Capella-Gutierrez, S., Gelpí, J. L., Astalos, J., Jurič, B., Ruda, M., Opioła, Ł., Bayındır, H., … Zambelli, F. (2025). Scaling Scientific Workflows in Europe: Architecture and Deployment of the Galaxy-Pulsar Computational Network (Version 1). Zenodo. https://doi.org/10.5281/ZENODO.16761933

Activity

Views: 73

Created: 3rd Oct 2025 at 16:50

Last updated: 3rd Oct 2025 at 16:52

Scaling Scientific Workflows in Europe: Architecture and Deployment of the Galaxy-Pulsar Computational Network

Related items