Welcome to Pengyu Hong's Homepage

"Simon Says"

Summer internship project at Microsoft Research Lab, Vision Technology Group.

Supervisor: Dr. Matthew Turk.

A technique for posture and gesture modeling and recognition in real-time, interactive environments.  The gesture model is represented by a Finite State Machine (FSM).  The 2D locations of the head and both hands are tracked by three robust color trackers.  The technique has been successfully tested on a set of postures and gestures, e.g., raise left hand, waving left hand, waving right hand, drawing a circle, drawing a figure eight, etc.  We apply the proposed technique to build an experimental system that allows the user to play a real-time game of “Simon Says” with the computer.  Using Microsoft VC++ 6.0 on WinNT 4.0.

Simon Says: "Raise your right hand"

Publicatoin:

Constructing Finite State Machines for Fast Gesture Recognition.  Pengyu Hong, Matthew Turk, Thomas S. Huang. 15th International Conference on Pattern Recognition, Barcelona, Spain, Sep 3-7, 2000. [Abstract] [pdf].