Target tracking is an important branch of Computer Vision,which is widely used in science and technology,national defense,aerospace,health and medicine in many fields of national economy.The target tracking algorithm based on mutual information is presented,which shows stability when the target is rotated or the illumination is changed.