ALECSYS and the AutonoMouse: Learning to Control a Real Robot by Distributed Classifier Systems

作者:Marco Dorigo

摘要

In this article we investigate the feasibility of using learning classifier systems as a tool for building adaptive control systems for real robots. Their use on real robots imposes efficiency constraints which are addressed by three main tools: parallelism, distributed architecture, and training. Parallelism is useful to speed up computation and to increase the flexibility of the learning system design. Distributed architecture helps in making it possible to decompose the overall task into a set of simpler learning tasks. Finally, training provides guidance to the system while learning, shortening the number of cycles required to learn. These tools and the issues they raise are first studied in simulation, and then the experience gained with simulations is used to implement the learning system on the real robot. Results have shown that with this approach it is possible to let the AutonoMouse, a small real robot, learn to approach a light source under a number of different noise and lesion conditions.

论文关键词:learning classifier systems, reinforcement learning, genetic algorithms, animat problem

论文评审过程:

论文官网地址:https://doi.org/10.1023/A:1022649410928