Project

General

Profile

Use Case #85

JHub Notebook access to Data Lake data products

Added by Rosie Bolton 2 months ago. Updated 2 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Documentation:
Tags:

Description

Get new (simulated, or real) data, stored in Data Lake and accessible from a notebook interface, with single-sign-on for all systems (IAM).

SKA would be very interested to see the demonstration of data upload into rucio and visible to astronomer-user using ESAP with credentials according to IAM.

Requires ESAP/rucio integration (not required for DAC21)

Important cross-WP use case.

https://docs.google.com/document/d/1xofZ0-UdPbSA-tlM9X9q1Bm0h2K683YxNbTp0s40MOc/edit#heading=h.nxunofgr9cki


Checklist

  • Store SKA data in data lake managed by Rucio
  • Retrieve this data from data lake in Notebook environment
  • User logs in to JupyterHub via ESCAPE IAM, and is then able to interact with the data lake seamlessly without re-uploading credentials

Add

Related issues

History

#1

Updated by Rosie Bolton 2 months ago

  • Start date deleted (07/13/2021)
  • Tracker changed from Integration to Use Case
#2

Updated by Rosie Bolton 2 months ago

  • Description updated (diff)

Also available in: Atom PDF