Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Towards operational application of Deep Reinforcement Learning to Earth Observation satellite scheduling

Abstract : Scheduling an agile optical Earth Observation satellite (AEOS) requires to choose a limited number of images to take among a large set of possibilities. It is a NP-hard problem which is made even more difficult by the presence of uncertainties: an image is useless if it is too cloudy and weather uncertainty cannot be removed, no matter the accuracy of the forecasts. Moreover, among the various types of customer requests of commercial satellites, we focus here on large area acquisitions that cover a country or a continent. Such requests require several months or years to complete even with a constellation of satellites. Considering such long time frames, the completion time highly depends on weather uncertainties and there are currently no trustworthy forecasts. Therefore the selection of the requests is crucial to speed up the completion using a long-term strategy. Reinforcement Learning is an interesting solution to explore when it comes to uncertain environments. We propose to use the well-known Actor Critic (A2C) algorithm combined with Transfer Learning, Domain Knowledge and Domain Randomization (TDDR). We demonstrate how transfer learning is a way to address real-world problem. We find that TDDR method challenge state-of-the-art heuristics for satellite scheduling on various real weather conditions.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02925740
Contributor : Adrien Hadj-Salah <>
Submitted on : Sunday, August 30, 2020 - 7:43:33 PM
Last modification on : Wednesday, November 18, 2020 - 3:18:02 PM
Long-term archiving on: : Tuesday, December 1, 2020 - 8:50:26 AM

Files

towards_operational_transfer_a...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02925740, version 1

Collections

Citation

Adrien Hadj-Salah, Jonathan Guerra, Mathieu Picard, Mikaël Capelle. Towards operational application of Deep Reinforcement Learning to Earth Observation satellite scheduling. 2020. ⟨hal-02925740⟩

Share

Metrics

Record views

58

Files downloads

56