Distributed online learning of central pattern generators in modular robots

Publication: Research - peer-reviewArticle in proceedings – Annual report year: 2010

Not written here

  • Author: Christensen, David Johan

    Unknown

  • Author: Spröwitz, Alexander

    Ecole Polytechnique Fédérale de Lausanne, Biorobotics Laboratory

  • Author: Ijspeert, Auke Jan

    Ecole Polytechnique Fédérale de Lausanne, Biorobotics Laboratory

View graph of relations

In this paper we study distributed online learning of locomotion gaits for modular robots. The learning is based on a stochastic approximation method, SPSA, which optimizes the parameters of coupled oscillators used to generate periodic actuation patterns. The strategy is implemented in a distributed fashion, based on a globally shared reward signal, but otherwise utilizing local communication only. In a physics-based simulation of modular Roombots robots we experiment with online learning of gaits and study the effects of: module failures, different robot morphologies, and rough terrains. The experiments demonstrate fast online learning, typically 5-30 min. for convergence to high performing gaits (≈ 30 cm/sec), despite high numbers of open parameters (45-54). We conclude that the proposed approach is efficient, effective and a promising candidate for online learning on many other robotic platforms.
Original languageEnglish
TitleFrom Animals to Animats 11
EditorsR. Goebel, J. Siekmann, W. Wahlster
PublisherSpringer
Publication date2010
Pages402-412
DOIs
StatePublished

Conference

Conference11th International Conference on Simulation of Adaptive Behavior
Number11
CountryFrance
CityParis
Period25/08/1028/08/10
NameLecture Notes in Computer Science
Number6226
ISSN (Print)0302-9743
CitationsWeb of Science® Times Cited: No match on DOI
Download as:
Download as PDF
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
PDF
Download as HTML
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
HTML
Download as Word
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
Word

ID: 5506414