Workshops and courses

ELIXIR node event Croupier, an user-centric meta-orchestrator for cross-platform workflow delivery and execution

View event

Date: 15 November 2022

The orchestration of complex application workflows executed in the context of High Performance Computing (HPC) infrastructures requires the joint collaboration of application designers/developers, HPC engineers and application consumers (i.e. end-users). In the context of HPC, complex workflows can be executed with either HPC schedulers (e.g. Slurm), workflow managers (e.g. PyCOMPSs, NextFlow), with meta-orchestrators (e.g. Croupier) or with a combination of them. While schedulers and workflow managers are restricted to execute applications within a single HPC cluster, Croupier supports cross-platform application delivery, execution, monitoring and data management. 

In this webinar, we will introduce Croupier from the application designers and consumers perspective, and the use of Croupier, with a demo on how to deploy, execute and monitor one of the PerMedCoE use case applications.

About the speaker

Jesús has been working in diverse ICT companies as Software Analyst and Architect for 20 years. In Atos Research & Innovation (ARI) he is Chief Architect and Senior Researcher on the AI, Data & HLS Unit, member of the Advanced Parallel Computing Group, where he designs and develops cross-platform meta-orchestrators for HPC infrastructures in EC R&D&i projects, such as EUXDAT, Hidalgo, Grapevine or PerMedCoE. He is also Atos Technical Team Leader of AI-centric project IoT-NGIN.

Contact: Daniel Thomas Lopez - dthlopez@ebi.ac.uk

Keywords: DNA & RNA (dna-rna), Proteins (proteins), UniProt: The Universal Protein Resource, Fermentation, Microbial ecosystems webinar, Antimicrobial resistance, Ensembl, BLAST, Open Targets Platform, Cross domain (cross-domain), Chemical biology (chemical-biology), Drug discovery, Drug target identification, UniRule, ARBA, Automated annotation, MetaboLights: Metabolomics repository and reference database, Chemical Entities of Biological Interest, ChEBI, Metabolites, Molecular building blocks of life, Human Cell Atlas Data Coordination Platform, Single-cell transcriptomics, HCA data portal, Programmatic access, API, Python, Complex Portal, macromolecular assembly, InterPro, Boolean modelling, Europe PubMed Central, Literature (literature), Open access, Protein Data Bank in Europe - Knowledge Base, 3D structure, AlphaFold Database, DeepMind, Artificial intelligence, AI, Structure prediction, cancer, Boolean, Ensembl Genomes, European Nucleotide Archive, Data archive, Raw sequencing data, RNAcentral, Non-coding RNA, ncRNA, GPU, Data protection, Job dispatcher, Bioimage analysis resource, Accessibility, Missense variation, Biostatistics, Rfam, non-coding RNA, Infernal software, Sequence annotation, Root microbiome, Abiotic stress, land management, Plant genotype, Plant webinar series, HPC, database development, cross-linked databases, Plant database, data infrastructure, Plant breeding, Data standards, data managemnet, data sharing, Hyb-Seq method, Flowering plants, Crop improvement, Pangenomics, Pangenomes, Virtual humans, Drug-target identification, plant-microbe interactions, Spatial transcriptomics, Plant research, Drug targets, Machine learning, Mathematical modelling, plant science, Data integration, plant-environment interaction, Phenotyping, field phenotyping, Deep phenotyping, EOSC-Life, NHGRI-EBI GWAS Catalog, clinical data, genome-wide association, plants, European Variation Archive, EVA, Variant clusters, Variant data annotation, Constraint-based metabolic modelling, UniProt knowledgebase, protein variant impact, disease-associated protein variants, Bioethics, FAIR principles, ELSI, cohort data, translational research, BioModels database, Mathematical modeling, Reproducibity, Systems biology models, workflows, federated analysis, polygenic risk scores, IntAct Molecular Interaction Database, PSICQUIC, IMEx, Complex portal, Agent-based modelling, Macrophages, Tumorigenesis, Training (Training), On-demand, teaching, introduction, Building blocks, Data analysis, COSMIC, Cancer mutation, Somatic mutation, ChEMBL: Bioactive data for drug discovery, Chemical compounds, drug-like molecules, Chemogenomics, Biocurator, Programming, Data management, Green Algorithms, Open data, Environmental impact, Carbon footprint, HPC workflows, Orchestrator

Organizer: European Bioinformatics Institute (EBI)

Host institutions: EMBL-EBI

Capacity: 500

Event types:

  • Workshops and courses

Scientific topics: Simulation experiment, Computational biology, Personalised medicine

Activity log