A gesture tracking and recognition method based on spatio-temporal context is proposed to solve the problems such as gesture posture variation, occlusion, illumination changes under the complex background. Firstly, in order to get the location information of gesture, machine learning is used for off-line training a gesture classifier; then spatio-temporal context algorithm is used to track dynamic gesture. At the same time, the gesture detection algorithm is used for real-time calibration to the gesture pos...