Publications

What is a Publication?
6 Publications visible to you, out of a total of 6

Abstract (Expand)

The concept of publishing workflows as scholarly is being recognised and practiced through repositories like WorkflowHub and principles for FAIR Computational Workflow. This deliverable describes how the evolving landscape of the European Open Science Cloud (EOSC) can facilitate workflow publishing in a federated and distributed manner, exemplified by how workflows for Galaxy are published.

Authors: Stian Soiland-Reyes, Eli Chadwick, Armin Dadras, Björn Grüning, Catalin Condurache, Sebastian Luna-Valero, Volodymyr Savchenko

Date Published: 8th Feb 2025

Publication Type: Tech report

Abstract (Expand)

Description The Workflowhub Knowledge Graph has been improved and its generation made more robust. When this work was last reported, a complete knowledge graph had been generated but several criticismsicisms were made. The previous graph was: - Verbose and hard for a human to read or navigate - Had unresolvable URIs as root data entities - Contained many duplicate entries - Contained sparse metadata from only a single source Work has successfully been undertaken to address all of these points. The graph now uses partially resolvable, more human readable, URIs for root data entities. Steps have been added to the generation software to add metadata from additional sources (enrichment) and to remove duplicate entries (consolidation). Several areas of the codebase have been refactored and improved, to help ensure repeatability and longevity. The new knowledge graph still has areas that could be improved. Partially resolvable URIs should be migrated to fully resolvable alternatives. Further enrichment processes should be added which affords greater de-duplication.

Authors: Eli Chadwick, Oliver Woolland, Volodymyr Savchenko, Finn Bacall, Alexander Hambley, José María Fernández González, Armin Dadras, Stian Soiland-Reyes

Date Published: 1st Aug 2025

Publication Type: Tech report

Abstract (Expand)

Description This deliverable provides the final project summary of EuroScienceGateway (ESG), a Horizon Europe and EOSC initiative (Grant Agreement 101057388, Sept 2022–Aug 2025) coordinated byed by Albert-Ludwigs-Universität Freiburg. It summarizes ESG’s main achievements, impacts, FAIR data management, sustainability and exploitation plans, and dissemination outcomes. Technically, ESG delivered a production-grade, federated research gateway built on Galaxy and an expanded Pulsar Network, enabling scalable, data-intensive analysis across heterogeneous European compute and storage. Key innovations include Bring-Your-Own-Compute/Storage (BYOC/BYOS), a smart meta-scheduler (TPV Broker), Galaxy Job Radar dashboard, and streamlined deployment/admin tooling—altogether improving throughput, data locality, and operational transparency. The project operationalized FAIR principles for computational workflows by packaging and publishing Workflow RO-Crates with persistent identifiers via WorkflowHub, advancing EOSC interoperability. Federated AAI (e.g., EGI Check-in, LS Login, IAM4NFDI) supports secure access across institutions. ESG contributed >20 workflows, >40 tutorials, and >10 peer-reviewed publications, and collaborated with 20+ initiatives. Six national Galaxy instances and 10+ Pulsar endpoints were launched; the European Galaxy instance achieved ISO/IEC 27001 certification. Community impact was substantial: registered users on the European Galaxy portal grew from ~30,000 to >130,000, with monthly actives doubling to >6,000, underpinned by >20 online/onsite workshops and large-scale training through the Galaxy Training Network and Training-Infrastructure-as-a-Service (TIaaS). Sustainability is ensured through distributed governance, national/institutional hosting of Galaxy/Pulsar services, continued curation of workflows and training materials, and alignment with EOSC service models and funding pathways. The report closes with exploitation routes for beneficiaries and stakeholders and a record of dissemination and outreach activities across the European research ecosystem.

Authors: Armin Dadras, Oana Kaiser, Björn Grüning, Sebastian Luna-Valero, Enol Fernandez-del-Castillo

Date Published: 20th Aug 2025

Publication Type: Tech report

Abstract (Expand)

Description Documentation of the cross-domain adoption of the EuroScienceGateway (ESG) project, showcasing how Galaxy was used and extended to meet the data analysis needs of researchers acrossers across biodiversity, climate science, astrophysics, materials science, and biomedical domains. This record outlines ESG’s impact on the onboarding of diverse scientific communities, enabling scalable, reproducible, and FAIR-compliant workflows. Through targeted outreach, infrastructure integration, and community-driven tool development, the project successfully onboarded new user groups and demonstrated Galaxy’s adaptability across multiple scientific verticals. Over 800 tools were integrated into Galaxy during the past 3 years, and dozens of reusable workflows were published to support sensitive data handling, high-throughput image analysis, simulation environments, and federated compute. The deliverable documents use cases, domain-specific onboarding models, training efforts, and collaborative success stories, including the development of the Galaxy Codex and strategic alignment with EOSC, ELIXIR, and NFDI initiatives. Project: EuroScienceGateway was funded by the European Union’s Horizon Europe programme (HORIZON-INFRA-2021-EOSC-01) under grant agreement number 101057388. Document: D5.2 Publication of the usage of EuroScienceGateway by multiple communities Work Package: Work Package 5. Community engagement, adoption and onboarding Tasks: Task 5.1 Biodiversity and Climate Science Task 5.2 Materials Science Task 5.3 Astrophysics Task 5.4 Mentoring and onboarding new communities Lead Beneficiary: University of Oslo (UiO) Contributing Beneficiaries: UiO, ALU-FR, CNRS, UNIFI, UKRI, EPFL, UP, BSC

Authors: Armin Dadras, Denys Savchenko, Andrii Neronov, Volodymyr Savchenko, Nikolay Vazov, Jean Iaquinta, Eva Alloza, María Chavero Díez, Anthony Bretaudeau

Date Published: 18th Aug 2025

Publication Type: Tech report

Abstract (Expand)

Description Documentation of the design, deployment, and operationalization of the European Pulsar Network, developed within the EuroScienceGateway (ESG) project. This deliverable outlines how thew the Pulsar Network enables scalable, federated, and interoperable remote job execution across European Galaxy servers and compute infrastructures. This record showcases the technical architecture, automation strategies, and monitoring solutions behind the distributed execution framework, supporting reproducible workflows and efficient resource sharing. The network connects 13 Pulsar endpoints across 10 countries, integrated with six national Galaxy servers and the European Galaxy server. Deployments span public clouds, institutional HPCs, and EOSC resources, unified under a secure, open-source infrastructure stack using Terraform, Ansible, RabbitMQ, CVMFS, and SABER. The deliverable demonstrates how ESG addressed interoperability and scalability challenges through open infrastructure tooling, cross-institutional coordination, and continuous monitoring. It provides a replicable model for distributed compute resource integration and highlights Galaxy's extensibility in federated scientific computing. Project: EuroScienceGateway, funded by the European Union’s Horizon Europe programme (HORIZON-INFRA-2021-EOSC-01) under grant agreement number 101057388. Document: D3.2 Publication on the Pulsar Network, integrated in workflow management systems Work Package: Work Package 3. Pulsar Network: Distributed heterogeneuos compute Tasks: - Task 3.1 Develop and maintain an Open Infrastructure-based deployment model for Pulsar endpoints - Task 3.2 Add GA4GH Task Execution Service (TES) API to Pulsar - Task 3.3 Build a European-wide network of Pulsar sites - Task 3.4 Add TES support to WfExS (Workflow Execution Service) - Task 3.5 Developing and maintaining national or domain-driven Galaxy servers Lead Beneficiary: CNR Contributing Beneficiaries: CNR, INFN, ALU-FR, CNRS, CESNET, UiO, UB, EPFL, AGH/AGH-UST, BSC, VIB, IISAS, TUBITAK, UNIMAN

Authors: Armin Dadras, Marco Antonio Tangaro

Date Published: 1st Aug 2025

Publication Type: Tech report

Abstract (Expand)

Description This preprint outlines the development and deployment of the European Pulsar Network (EPN)—a federated, scalable architecture enabling distributed job execution across national and Europeanopean Galaxy instances. Built within the Horizon Europe EuroScienceGateway project, the EPN leverages the Galaxy workflow system and the Pulsar job execution service to offload computational workloads to remote endpoints seamlessly and securely. The work introduces an Open Infrastructure (OI) framework that automates provisioning, deployment, and monitoring using Terraform, Ansible, and Jenkins. The pre-print highlights deployments across thirteen Pulsar nodes and six national Galaxy portals, illustrating how the EPN supports reproducible, FAIR-aligned data analysis while abstracting infrastructure complexity for researchers.

Authors: Marco Antonio Tangaro, Stefano Nicotri, Björn Grüning, Sanjay Kumar Srikakulam, Armin Dadras, Oana Kaiser, Mira Kuntz, Anthony Bretaudeau, Paul De Geest, Sebastian Luna-Valero, María Chavero Díez, José María Fernández González, Salvador Capella-Gutierrez, Josep Lluís Gelpí, Jan Astalos, Boris Jurič, Miroslav Ruda, Łukasz Opioła, Hakan Bayındır, SILVIA GIOIOSA, Gaetanomaria De Sanctis, Federico Zambelli

Date Published: 7th Aug 2025

Publication Type: Unpublished

Powered by
(v.1.17.0-main)
Copyright © 2008 - 2025 The University of Manchester and HITS gGmbH