home · mobile · calendar · colloquia · 2009-2010 · 

Colloquium - Chun

A Vision-based Hand Interface for Manipulation of Virtual Objects in Marker-less AR System
Junchul (J.C.) Chun
Kyonggi University

In this presentation, a vision-based approach to control the augmented reality (AR) objects robustly in a marker-less AR system is introduced. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. In this talk, we present a real-time method to manipulate the AR objects dynamically in a developed 3D hand coordinate system. To build the marker-less system, we utilize skin-color model for hand shape detection and curvature-based fingertip detection from an input video images. Using the detected fingertips the camera pose are estimated to register virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which use hand gesture recognition for the hand command initiation, is developed. From the experiments we can show that the proposed method can manipulate the objects in a feasible fashion.

Junchul (J.C.) Chun is currently a professor in the department of computer science at Kyonggi University, Suwon South Korea. He received a BS degree from Chung-Ang University, Seoul Korea majoring in computer science. He also received MS and PhD degrees from the department of computer science and engineering at the University of Connecticut, in 1992 and 1995, respectively. He was a visiting research scholar in PRIP (Pattern Recognition and Image Processing) at Michigan State University during 2001. Chun's current research fields are 3D face modeling, vision-based animation, and human-computer interaction.

Department of Computer Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
May 5, 2012 (14:13)