Hierarchical reinforcement learning for efficent exploration and transfer

  • Authors
  • Steccanella L, Totaro S, Allonsius D, Jonsson A
  • UPF authors
  • JONSSON, ANDERS;
  • Authors of the book
  • AA. VV.
  • Book title
  • Proceedings ICML 2020 Workshop LifelongML Blind Submission
  • Publisher
  • Openreview.net
  • Publication year
  • 2020
  • Pages
  • 1-9
  • Abstract
  • Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing the number of decisions necessary before obtaining a reward. In this paper, we present a novel hierarchical reinforcement learning framework based on the compression of an invariant state space that is common to a range of tasks. The algorithm introduces subtasks which consist in moving between the state partitions induced by the compression. Results indicate that the algorithm can successfully solve complex sparse-reward domains, and transfer knowledge to solve new, previously unseen tasks more quickly.
  • Complete citation
  • Steccanella L, Totaro S, Allonsius D, Jonsson A. Hierarchical reinforcement learning for efficent exploration and transfer. Dins: AA. VV.. Proceedings ICML 2020 Workshop LifelongML Blind Submission. 1 ed. Openreview.net; 2020. p. 1-9.