Project

General

Profile

Use Case #135

La Silla Paranal Observatory: Interactive web browsing and further processing of processed data

Added by John Swinbank 8 months ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Documentation:
Tags:

Description

(Use case provided by Martino Romaniello, transcribed by John Swinbank)

Synopsis

As a user I want to query the ESO La Silla Paranal processed data web archive interface and process the resulting data via the ESAP Science Platform.

User Story

  1. I fill in the query parameters and search. The processed data query form is a complex interface, developed to guide the user to the data of interest. In this case, reducing it to a simple collection of text fields and checkboxes is not acceptable.
  2. I review the query results and choose whether to include other relevant data (e.g. different flavors/categories of ancillary files, if available; see an example at: http://archive.eso.org/downloadportal/079ef765-f5bf-4281-aa38-0dd35417f6d2).
  3. In case the data I’m interested in is proprietary or otherwise protected, I need to authenticate with the ESO archive to access it.
  4. The typical size of the datasets I want to process is of the order of several TB. My waiting time for the data to become available for processing should be minimized, e.g. by having the processing itself as close as possible to the data storage.
  5. I want to analyze and further process the results with commonly used data handling/analysis tools (e.g. a python installation with a standard set of packages, including plotting capabilities TBD), as well as being able to upload custom tools (e.g. a python script I have developed for a specific purpose).
  6. I want my ESAP workspace to be persistent for a TBD amount of time and with a TBD amount of space, to be able to split the work in several sessions without having to restart from scratch every time. I want the workspace to be private, to protect proprietary data and my intellectual property of the analysis I’m performing and the custom tools I’m using. I want to be able to share with other ESAP users of my choice the content of selected areas of my workspace (read and/or write) without sharing my credentials. The possibility of providing long-term storage should be explored.
  7. Once done with processing/analyzing, I want to download the results (e.g. plots, processed data, etc.) to my local system. I want to be able to select which result files to download. In addition to my local system, I want to be able to send selected results to other destinations, as well, most notably submitting them back to the ESO Science Archive via the “Phase 3” process (https://www.eso.org/sci/observing/phase3.html).

Related issues

Related to ESFRI: ESO - Use Case #131: La Silla Paranal Observatory: Interactive web browsing and processing of raw dataNew

Actions
Related to ESFRI: ESO - Use Case #136: La Silla Paranal Observatory: Programmatic browsing and further processing of processed dataNew

Actions

History

#1

Updated by John Swinbank 8 months ago

  • Tags set to WP2, WP3, DIOS, OSSR, ESAP

I don't think this use case places substantial requirements on ESAP beyond those surfaced in #131. A new service connector for ESO's processed data archive may be required.

#2

Updated by John Swinbank 8 months ago

  • Related to Use Case #131: La Silla Paranal Observatory: Interactive web browsing and processing of raw data added
#3

Updated by John Swinbank 8 months ago

  • Related to Use Case #136: La Silla Paranal Observatory: Programmatic browsing and further processing of processed data added
#4

Updated by John Swinbank 8 months ago

  • Description updated (diff)

Also available in: Atom PDF