This paper describes adaptive correlation tracking based on edge detection to overcome the time-consuming and cumulated errors in correlation tracking. The corrected MAD (maximum absolute difference) distance method is not sensitive to noise. Adjusting the reference image according to the detected edge of the object and adopting a rough-precise searching strategy reduce the needed time. On the basis of similarity of matching, a weighted updating of the reference template is applied.