Tool augmentation by user enhancements and orchestration
Programme
GSTP
Programme Reference
GT17-472EO
Prime Contractor
CS ROMANIA SA
Start Date
End Date
Status
Closed
Country
Romania
Objectives
The objective of this activity is to develop up to a fully operational platform the tool augmentation by user enhancements and orchestration (TAO) prototype.
Description
Based on the achieved development in the frame of the GSTP activity G611-033EO - Tool augmentation by user enhancements and orchestration, TAO provides very good means for orchestration of heterogeneous Earth Observation (EO) processing toolboxes and libraries for process EO data.
;
The framework provides processing composition and distribution so that users can visually define processing workflows and easily integrate additional processing modules (native or Python/R scripts) without any programming knowledge requirements. It can be used (standalone or in a cluster) by scientific users for prototyping, or in an operational environment for mass processing. Additionally, the framework serves as a base layer for services of several processing platforms.
;
This activity aims to achieve the level of a fully operational platform. Several evolutions have to be addressed in order to respond to the interest of various potential users to apply it for building national and regional thematic platforms.
;
The following aspects will be addressed during the activity:
- Implementation of quota enforcement for private workspaces so that the information and communication technology (ICT) resources (CPU, disk storage) are adequately used.
- Allow for scheduled data access (query) in order to periodically ingest EO products for near-real-time processing workflows.
- Integration of Jupyter notebook as both code editor for script components (Python, R) and for further analysis of and graphs/charts from workflow results.
- Allow the reuse of workflows inside other workflows.
- Improve the parallelism of execution for groups of components and the output flow between successive workflow nodes.
- Create one-time execution plans for workflows (?compiled? workflows) that can be deployed for execution on computing nodes.
- Make use of the OpenStack application programming interface (API) (present on AWS and DIAS platforms) to dynamically control the scaling up and down of computing resources.
- Improve the visualisation of processing results.
;
Software shall be delivered under an ESA Software Community Licence, so that any individuals or entities within ESA Member States can access to it and can provide update to the community of users.
;
;
Application Domain
EO-Earth Observation
Technology Domain
26-OTHERS
Competence Domain
9-Digital Engineering
Initial TRL
TRL 6
Target TRL
TRL 7
Achieved TRL
TRL 7
Public Document
Executive Summary