skip to main content
Idioma:
Tipo de recurso Mostra resultados com: Mostra resultados com: Índice

Methods and algorithms for knowledge reuse in multiagent reinforcement learning.

Silva, Felipe Leno Da

Biblioteca Digital de Teses e Dissertações da USP; Universidade de São Paulo; Escola Politécnica 2019-09-06

Acesso online. A biblioteca também possui exemplares impressos.

  • Título:
    Methods and algorithms for knowledge reuse in multiagent reinforcement learning.
  • Autor: Silva, Felipe Leno Da
  • Orientador: Costa, Anna Helena Reali
  • Assuntos: Aprendizado Por Reforço; Aprendizado Por Reforço Multiagente; Inteligência Artificial; Sistemas Multiagente; Transferência De Conhecimento; Multiagent Reinforcement Learning; Multiagent Systems; Reinforcement Learning; Transfer Learning
  • Notas: Tese (Doutorado)
  • Notas Locais: Programa Engenharia Elétrica
  • Descrição: Reinforcement Learning (RL) is a well-known technique to train autonomous agents through interactions with the environment. However, the learning process has a high sample-complexity to infer an effective policy, especially when multiple agents are simultaneously actuating in the environment. We here propose to take advantage of previous knowledge, so as to accelerate learning in multiagent RL problems. Agents may reuse knowledge gathered from previously solved tasks, and they may also receive guidance from more experienced friendly agents to learn faster. However, specifying a framework to integrate knowledge reuse into the learning process requires answering challenging research questions, such as: How to abstract task solutions to reuse them later in similar yet different tasks? How to define when advice should be given? How to select the previous task most similar to the new one and map correspondences? and How to defined if received advice is trustworthy? Although many methods exist to reuse knowledge from a specific knowledge source, the literature is composed of methods very specialized in their own scenario that are not compatible. We propose in this thesis to reuse knowledge both from previously solved tasks and from communication with other agents. In order to accomplish our goal, we propose several flexible methods to enable each of those two types of knowledge reuse. Our proposed methods include: Ad Hoc Advising, an inter-agent advising framework, where agents can share knowledge among themselves through action suggestions; and an extension of the object-oriented representation to multiagent RL and methods to leverage it for reusing knowledge. Combined, our methods provide ways to reuse knowledge from both previously solved tasks and other agents with state-of-the-art performance. Our contributions are first steps towards more flexible and broadly applicable multiagent transfer learning methods, where agents will be able to consistently combine reused knowledge from multiple sources, including solved tasks and other learning agents.
  • DOI: 10.11606/T.3.2019.tde-21112019-113201
  • Editor: Biblioteca Digital de Teses e Dissertações da USP; Universidade de São Paulo; Escola Politécnica
  • Data de criação/publicação: 2019-09-06
  • Formato: Adobe PDF
  • Idioma: Inglês
Links
Voltar para lista de resultados

  • Realização: ABCD-USP USP   Logos de Redes Sociais: Freepik

Buscando em bases de dados remotas. Favor aguardar.