Nebula Public Library

The knowledge bank of ESA’s R&D programmes

AI AT THE EDGE : DEEP CUBE SERVICE IOD/IOV

Programme
Discovery
Programme Reference
21-D-S-OPS-02-i
Contractor
Start Date
End Date
Status
Closed
Country
France
AI AT THE EDGE : DEEP CUBE SERVICE IOD/IOV
Description

ESA's OPS-SAT mission is a key element for operational validation in flight (or IOD/IOV) of the DeepCube service of Deep Learning at the edge that Agenium Space is preparing with the support of the GSTP programme (GSTP Make, ESA-CNES) and the R&D performed in the CORTEX project (Permanent Open Call EOEP-4, ESA/Phi-Lab, https://esacortexproject.agenium-space.com). The goal of this activity was to execute on board the inference of the simplified models defined in those projects. The chosen use case was forest detection (segmentation problem). Our simplified DNN was pre trained on S2 images over Slovenia, these images were processed to simulate OPS-SAT images. Then real OPS SAT images were used with the transfer learning method. The Binary Deep Neural Network using convolution was ported on the Cyclone V card using our own custom IP. A lot of efforts were made to fit the software within the hardware constraints (in terms of memory/storage resources) and many tests were performed with the support of the OPS-SAT team to be able to send the package on board.

Technology Domain
Executive summary
Final presentation