Project

General

Profile

Use Case #115

Use case ATLAS: ATLAS002

Added by Arturo Sanchez Pineda about 2 months ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Target version:
% Done:

0%


Description

Hi,

This issue describes ATLAS use case defined as ATLAS002

Name
ATLAS user analysis pipeline tests on experimental particle physics using augmented open data (source codes http://opendata.atlas.cern/software/)

ID
ATLAS002

Goal/Aim
The ability to run user final data analysis using datasets hosted in the datalake.

Workflow

  • Run the current AOD analysis examples requesting data from the datalake.
  • Allow the execution of the examples over the multiplied data to simulate longer analysis pipelines.
  • Modify such analysis to write outputs (ROOT files) that can be store back into the datalake.
  • We can also:
    • Create a volatile JupyterHub that can be used for multiple-user usage of the datalake.
    • CERN OpenStack resources are a feasible option.
  • Try to integrate those exercises with volunteer computer services like MyBinder and Google Colab (?)

Requirements

  • Container and/or another way to use the RUCIO CLI and Datalake authentication.
  • At least one Jupyter-kind interface with the RUVIO extension to use the analysis notebooks
  • The proper storage of the datasets in the datalake, e.i. The ATLAS 001 above.
  • Correct replication of the analysis examples in the OSSR for a complete analysis pipeline simulation at the user level.

People Involved
Arturo Sánchez Pineda

Work Packages
WP2, WP3 (for software stored in a record attached to the Zenodo ESCAPE community).


Success
The analysis examples will be correctly be executed in several instances.

Things to test
Localisation, retrieval and usage of the data in several user-kind particle physics analysis examples.

Impact

  • To show the ability of the datalake to deliver the data to several analysis instances (VMs and personal computers) and store the final products back to the datalake.
  • Test different interfaces that will be the standard way of interaction for many final users.

Add

Subtasks


Add

Related issues

Related to ESFRI: HL-LHC - Use Case #114: Use case ATLAS: ATLAS001New

Delete relationActions
Related to ESFRI: HL-LHC - Product #123: Software: ATLAS Open Data analyses framework at 13 TeVNew

Delete relationActions

History

#1

Updated by Arturo Sanchez Pineda about 2 months ago

#2

Updated by Arturo Sanchez Pineda about 2 months ago

  • Start date deleted (08/30/2021)
  • Tracker changed from Integration to Use Case
#3

Updated by Jutta Schnabel about 1 month ago

  • Related to Integration #122: Onboarding: ATLAS Open Data C++ analysis software at 13 TeV added
#4

Updated by Jutta Schnabel about 1 month ago

  • Related to Product #123: Software: ATLAS Open Data analyses framework at 13 TeV added
#5

Updated by Jutta Schnabel about 1 month ago

  • Related to deleted (Integration #122: Onboarding: ATLAS Open Data C++ analysis software at 13 TeV)

Also available in: Atom PDF