skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · colloquia · 1996-1997 · 

Colloquium - Smith

ECCR 265

Vision-Guided Robotics
Department of Computer Science and Engineering, University of Colorado at Denver

Recent work combining robotics with vision has emphasized an active vision paradigm where the system changes the pose of the camera to improve environmental knowledge or to establish and preserve a desired relationship between the robot and objects in the environment. Much of this work has concentrated upon the active observation of objects by the robotic agent, leaving interaction as an issue for future work. Since robots are designed to accomplish tasks, many of which involve manipulation of objects, our approach emphasizes techniques for the real-time control of robots via computer vision. Rather than simply observing, we design systems that interact with their environment in a reliable, accurate and robust way. Further, we attempt to use visual feedback control throughout the specified task, leading to a paradigm we have named vision-guided robotics,

Christopher Smith photo

We present an overview of the area of vision-guided robotics and discuss the issues involved with using computer vision as a sensor for real-time robotic systems. The resolution of these issues and experimental results from developed systems demonstrate the effectiveness of computer vision combined with appropriate control laws when applied to real hardware. We also discuss adaptations of the basic system software, demonstrating the applicability of our techniques to other areas of research, most notably Intelligent Transportation Systems.

The culmination of this effort is the development of an automated grasping system that uses computer vision throughout the alignment of the gripper, the reach toward the target, and the closure of the gripper to grasp the target. Contrary to previous efforts in vision-based grasping, our system does not require extensive calibration, stereo cameras, nor any blind reach component (i.e. operation without visual feedback). Furthermore, the object is not required to remain stationary during the grasping motion of the manipulator.

We also present extensive experimental results demonstrating the effectiveness of the grasping system on multiple grasping trials using both static and moving targets with random orientations, locations, and depths.

Refreshments will be served immediately before the talk at 3:30pm.
Hosted by Dirk Grunwald.

The Department holds colloquia throughout the Fall and Spring semesters. These colloquia, open to the public, are typically held on Thursday afternoons, but sometimes occur at other times as well. If you would like to receive email notification of upcoming colloquia, subscribe to our Colloquia Mailing List. If you would like to schedule a colloquium, see Colloquium Scheduling.

Sign language interpreters are available upon request. Please contact Stephanie Morris at least five days prior to the colloquium.

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:29)