Established Researcher at Workflows and Distributed Computing Group, Computer Sciences department, Barcelona Supercomputing Center.
SEEK ID: https://workflowhub.eu/people/305
Location: Spain
ORCID: https://orcid.org/0000-0003-0606-2512
Joined: 18th Jul 2022
Expertise: Workflows, Programming Models, High Performance Computing, Distributed Computing, Provenance
Tools: COMPSs
Roles
Team Administrator
- Cluster Emergent del Cervell Humà
- Workflows and Distributed Computing
- WP5 - Volcanoes
- WP6 - Tsunamis
- WP7 - Earthquakes
- WP8 - Anthropogenic geophysical extremes
- Pillar I: Manufacturing
- Pillar II: Climate
- Pillar III: Urgent computing for natural hazards
- eFlows4HPC general
- COMPSs Tutorials
Asset housekeeper
Space Administrator
Related items
- Spaces (2)
- Teams (11)
- Organizations (1)
- Publications (1)
- Presentations (2)
- Workflows (30+5)
- Collections (1)
With present computational capabilities and data volumes entering the Exascale Era, digital twins of the Earth system will be able to mimic the different system components (atmosphere, ocean, land, lithosphere) with unrivaled precision, providing analyses, forecasts, and what if scenarios for natural hazards and resources from their genesis phases and across their temporal and spatial scales. DT-GEO aims at developing a prototype for a digital twin on geophysical extremes including earthquakes, ...
Teams: WP5 - Volcanoes, WP6 - Tsunamis, WP7 - Earthquakes, WP8 - Anthropogenic geophysical extremes
Web page: https://dtgeo.eu/
eFlows4HPC project aims at providing workflow software stack and an additional set of services to enable the integration of HPC simulations and modelling with big data analytics and machine learning in scientific and industrial applications. The project is also developing the HPC Workflows as a Service (HPCWaaS) methodology that aims at providing tools to simplify the development, deployment, execution and reuse of workflows. The project demonstrates its advances through three application Pillars ...
Teams: Cluster Emergent del Cervell Humà, Workflows and Distributed Computing, Pillar I: Manufacturing, Pillar II: Climate, Pillar III: Urgent computing for natural hazards, eFlows4HPC general, COMPSs Tutorials
Web page: https://eflows4hpc.eu
Team created to publish applications during COMPSs Tutorials, and share them among participants.
Space: eFlows4HPC
Public web page: https://www.bsc.es/education/training/bsc-training/bsc-training-course-programming-distributed-computing-platforms-compss/
Organisms: Not specified
Distributed computing aims to offer tools and mechanisms that enable the sharing, selection, and aggregation of a wide variety of geographically distributed computational resources in a transparent way. The research done in this team is based on the past expertise of the group, and on extending it towards the aspects of distributed computing that can benefit from this expertise. The team at BSC has a strong focus on programming models and resource management and scheduling in distributed computing ...
Space: eFlows4HPC
Public web page: https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing
Organisms: Not specified
Develop and implement 4 DTCs for volcano-related extremes: volcanic unrest (DTC-V1), forecast of volcanic ash clouds and fallout (DTC-V2), lava flows (DTC-V3), and volcanic gases (DTC-V4).
Test the 4 DTC-V through demonstrators at 3 relevant European sites: Mt. Etna in Italy (SD1), and Grímsvötn and Fagradalsfjall in Iceland (SD2 and SD3 respectively).
Space: A Digital Twin for GEOphysical extremes (DT-GEO)
Public web page: https://dtgeo.eu/
Organisms: Not specified
This team is to publish workflows executed from WPs that are not the three main pillars of the project.
Space: eFlows4HPC
Public web page: https://eflows4hpc.eu/
Organisms: Not specified
Develop and implement 1 DTC for data-informed Probabilistic Tsunami Forecasting (PTF) (DTC-T1)
Test the DTC-T1 through demonstrators at 4 relevant sites: Mediterranean sea coast (SD4), Eastern Sicily (SD5), Chilean cost (SD6), and Eastern Honshu coast in Japan (SD7).
Space: A Digital Twin for GEOphysical extremes (DT-GEO)
Public web page: https://dtgeo.eu/
Organisms: Not specified
It explores the modelling of natural catastrophes – in particular, earthquakes and their associated tsunamis shortly after such an event is recorded.
Space: eFlows4HPC
Public web page: https://eflows4hpc.eu/pillars/
Organisms: Not specified
Provide an integrated, comprehensive, modular modelling and testing framework
Develop multi-scale workflows applicable beyond the identified test-areas enabling improved physical understanding and progress beyond state-of-the-art in the earthquake process.
Develop and implement 6 DTCs covering earthquake-related aspects over long and short time scales
Test the 6 DTC-E at 4 relevant sites: Euro-Med (SD8), Central Apennines and Alto-Tiberina (SD9), Bedretto Lab (SD10) and the Alps (SD11).
Space: A Digital Twin for GEOphysical extremes (DT-GEO)
Public web page: https://dtgeo.eu/
Organisms: Not specified
It develops innovative adaptive workflows for climate and for the study of Tropical Cyclones (TC) in the context of the CMIP6 experiment, including in-situ analytics.
Space: eFlows4HPC
Public web page: https://eflows4hpc.eu/pillars/
Organisms: Not specified
Develop and implement 1 DTC for Anthropogenic Geophysical Extreme Forecasting (AGEF) with 4 workflow outcomes: forecasting of long-range responses of georeservoirs (TC-AGEF1), forecasting of late responses of georeservoirs (TC-AGEF2), modelling of the largest magnitude (TC-AGEF3), and induced seismic hazard map estimation (TC-AGEF4).
Test the DTC-A through demonstrators at 2 relevant European sites: Strasbourg geothermal site in France (SD12) and KGHM copper ore mine in Poland (SD13).
Space: A Digital Twin for GEOphysical extremes (DT-GEO)
Public web page: https://dtgeo.eu/
Organisms: Not specified
It focuses on the construction of DigitalTwins for the prototyping of complex manufactured objects integrating state-of-the-art adaptive solvers with machine learning and data-mining, contributing to the Industry 4.0 vision.
Space: eFlows4HPC
Public web page: https://eflows4hpc.eu/pillars/
Organisms: Not specified
Project that aims to create the NeuroPlat portal for neurodrug design
Space: eFlows4HPC
Public web page: https://www.upf.edu/web/cech
Organisms: Not specified
Abstract (Expand)
Authors: Raul Sirvent, Javier Conejero, Francesc Lordan, Jorge Ejarque, Laura Rodriguez-Navas, Jose M. Fernandez, Salvador Capella-Gutierrez, Rosa M. Badia
Date Published: 1st Nov 2022
Publication Type: Proceedings
DOI: 10.1109/WORKS56498.2022.00006
Citation: 2022 IEEE/ACM Workshop on Workflows in Support of Large-Scale Science (WORKS),pp.1-9,IEEE
Provenance registration is becoming more and more important, as we increase the size and number of experiments performed using computers. In particular, when provenance is recorded in HPC environments, it must be efficient and scalable. In this paper, we propose a provenance registration method for scientific workflows, efficient enough to run in supercomputers (thus, it could run in other ...
Creator: Raül Sirvent
Submitter: Raül Sirvent
Session during the Innovative HPC workflows for industry (https://eflows4hpc.eu/event/innovative-hpc-workflows-for-industry/) that describes how Workflow Provenance is recorded with COMPSs: the background on the tools used, how the recording has been designed, and how to use it and inspect metadata.
Creator: Raül Sirvent
Submitter: Raül Sirvent
Name: Matrix Multiplication Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Matrix multiplication is a binary operation that takes a pair of matrices and produces another matrix.
If A is an n×m matrix and B is an m×p matrix, the result AB of their multiplication is an n×p matrix defined only if the number of columns m in A is equal to the number of rows m in B. When multiplying A and B, the elements of the ...
Name: Matrix Multiplication Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Matrix multiplication is a binary operation that takes a pair of matrices and produces another matrix.
If A is an n×m matrix and B is an m×p matrix, the result AB of their multiplication is an n×p matrix defined only if the number of columns m in A is equal to the number of rows m in B. When multiplying A and B, the elements of the ...
Lysozyme in water full COMPSs application
Lysozyme in water full COMPSs application, using dataset_small
Lysozyme in water full COMPSs application
Name: SparseLU Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
The Sparse LU application computes an LU matrix factorization on a sparse blocked matrix. The matrix size (number of blocks) and the block size are parameters of the application.
As the algorithm progresses, the area of the matrix that is accessed is smaller; concretely, at each iteration, the 0th row and column of the current matrix are discarded. ...
COMPSs Matrix Multiplication, out-of-core using files. Hypermatrix size used 2x2 blocks (MSIZE=2), block size used 2x2 elements (BSIZE=2)
Name: Matrix multiplication with Files, reproducibility example, without data persistence Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Matrix multiplication is a binary operation that takes a pair of matrices and produces another matrix.
If A is an n×m matrix and B is an m×p matrix, the result AB of their multiplication is an n×p matrix defined only if the number of columns m in A is equal to the number ...
Name: Matrix multiplication with Files, reproducibility example Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Matrix multiplication is a binary operation that takes a pair of matrices and produces another matrix.
If A is an n×m matrix and B is an m×p matrix, the result AB of their multiplication is an n×p matrix defined only if the number of columns m in A is equal to the number of rows m in B. When multiplying ...
Lysozyme in water full COMPSs application run at MareNostrum IV, using full dataset with two workers
Lysozyme in water sample COMPSs application
Cluster Comparison COMPSs application
Cholesky factorisation COMPSs application
K-means COMPSs application
Wordcount reduce version COMPSs application
Wordcount merge version COMPSs application
Lysozyme in water full COMPSs application, using dataset_small
Name: Word Count Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Wordcount is an application that counts the number of words for a given set of files.
To allow parallelism the file is divided in blocks that are treated separately and merged afterwards.
Results are printed to a Pickle binary file, so they can be checked using: python -mpickle result.txt
This example also shows how to manually add input or ...
Type: COMPSs
Creators: Javier Conejero, The Workflows and Distributed Computing Team (https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing/)
Submitter: Raül Sirvent
Name: Java Wordcount Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Wordcount application. There are two versions of Wordcount, depending on how the input data is given.
Version 1
''Single input file'', where all the text is given in the same file and the chunks are calculated with a BLOCK_SIZE parameter.
Version 2
''Multiple input files'', where the text fragments are already in different files under ...
Type: COMPSs
Creators: Jorge Ejarque, The Workflows and Distributed Computing Team (https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing/)
Submitter: Raül Sirvent
Name: Increment Contact Person: support-compss@bsc.es Access Level: public License Agreement: Apache2 Platform: COMPSs
Description
Increment is an application that takes three different values and increases them a number of given times.
The purpose of this application is to show parallelism between the different increments.
Execution instructions
Usage:
runcompss --lang=python src/increment.py N initValue1 initValue2 initValue3
where:
- N: Number of times to increase ...
Type: COMPSs
Creators: Javier Conejero, The Workflows and Distributed Computing Team (https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing/)
Submitter: Raül Sirvent
Solutions to the exercises on the Workflow Provenance part, during January 2024 COMPSs Tutorial.