2003-2004 Academic Year

  

Darius Burschka 
Department of Computer Science
Johns Hopkins University 

Title: VICs - A Modular Vision-Based HCI Framework

Abstract:

Many Vision-Based Human-Computer Interaction (VB-HCI) systems are based
on the tracking of user actions. Examples include gaze-tracking,
head-tracking, finger-tracking, and so forth. In our approach, we
utilize a framework that employs no user-tracking; instead, all
interface components continuously observe and react to changes within a
local neighborhood. More specifically, components expect a pre-defined
sequence of visual events called Visual Interface Cues (VICs) in a
volume around the surface of the component. 

We present a general architecture for an interface system operating
under the VIC-Based HCI paradigm, and show two example applications
of 2.5D and 3D interfaces. The presented framework is an extension of
conventional interfaces like keyboard, mouse, CyberGlove, etc. The
current system is able to replace keyboard and mouse in conventional
programs with user gestures without any re-compilation on libX11-based
Unix systems.