A control method of effective particle number is presented to solve the problem of particle degeneracy of particle filter in video target tracking. The theory about this control method is presented the via analysis of the effect of weight value and effective particle number on tracking performance. After that, a particle filter object tracking algorithm based on control of effective particle number is proposed. Finally, an evaluation method of tracker performance is built. A large number of experiment comparisons show the effective of the proposed method.