skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · colloquia · 2008-2009 · 

Colloquium - Grollman


Learning Multimap Robot Control Policies from Demonstration
Brown University

Many robot control policies can be cast as finite state machines, where a task divides into subtasks that are combined to achieve the overall goal. Learning such a task from demonstration involves learning the number of subtasks, their individual policies, how to switch between them and optionally improving performance. I will talk about an approach to learning the subtasks and their policies. Demonstration data takes the form of a multimap, where states may lead to multiple actions. That is, the distribution over correct actions, given a state estimate, is multimodal. Multimaps may occur due to hidden state or perceptual aliasing. Framing learning as a problem in multimap regression I will present experiments with ROGER (Realtime Overlapping Gaussian Expert Regression), an incremental infinite mixture of experts approach. ROGER addresses model selection (choosing the number of subtasks), gating (assigning data to subtasks) and policy learning (for each subtask). Formulated in a sparse, incremental fashion, ROGER is thus suitable for interactive, mixed-initiative learning and may be combined with other work to perform full FSM learning. Experiments presented will be in the domain of robot soccer.

Hosted by James Martin.

The Department holds colloquia throughout the Fall and Spring semesters. These colloquia, open to the public, are typically held on Thursday afternoons, but sometimes occur at other times as well. If you would like to receive email notification of upcoming colloquia, subscribe to our Colloquia Mailing List. If you would like to schedule a colloquium, see Colloquium Scheduling.

Sign language interpreters are available upon request. Please contact Stephanie Morris at least five days prior to the colloquium.

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:29)