skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · colloquia · 1999-2000 · 

Colloquium - Meila

ECCR 139

Efficient Learning in High Dimensions With Trees and Mixtures
Department of Computer Science, Carnegie-Mellon University

How to learn useful representations of multidimensional data, that can be used in a variety of tasks, some of them unspecified at the time of learning? This problem is called unsupervised learning and probabilistic models have proven to be particularly successful at it. However, learning and using models of multi-dimensional domains raises specific problems - termed the curse of dimensionality - that are not encountered in the univariate case. This talk shows how exploiting the computational properties of a simple probability model, the tree, leads to efficient, elegant and powerful algorithms for learning in multidimensional domains.

The tree is distinguished among graphical models by its outstanding computational properties. I show how to combine trees into more powerful models, called mixtures of trees, and how these can be learned efficiently by a method based on the Maximum Spanning Tree and the EM algorithms. The basic tree learning algorithm is quadratic in the dimension of the data. I demonstrate that for sparse data it can be transformed into an algorithm that is subquadratic and that achieves speedup factors of up to a thousand. Experiments demonstrate the performance of trees and mixtures in classification and density estimation tasks.

No prior knowledge of graphical probability models is necessary to follow this talk.

Hosted by Clayton Lewis.

The Department holds colloquia throughout the Fall and Spring semesters. These colloquia, open to the public, are typically held on Thursday afternoons, but sometimes occur at other times as well. If you would like to receive email notification of upcoming colloquia, subscribe to our Colloquia Mailing List. If you would like to schedule a colloquium, see Colloquium Scheduling.

Sign language interpreters are available upon request. Please contact Stephanie Morris at least five days prior to the colloquium.

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:29)