Abstract: In the visual tracking algorithm based on correlation filters, the method of generating sample sets by cyclic shift greatly reduces the amount of calculation. However, it will also bring about boundary effects, and the resulting error samples will weaken the discriminative ability of the classifier. In order to solve the above problem, a visual tracking algorithm based on adaptive spatial regularization is proposed. An adaptive spatial regularization term is introduced into the classic filtering model. By establishing the correlation of regularization weights between adjacent frames, the regularization weights of the model can be adaptively adjusted. In this way, the risk of overfitting when processing unreal samples can be reduced, thereby mitigating the boundary effect. We adopt a scale estimation strategy with adaptive aspect ratio, which can accurately track the scale change of the target. In addition, the update strategy based on the similarity of color histograms is used to avoid the model update when the tracking is inaccurate, thereby suppressing model drift and improving tracking accuracy and speed. Experiments show that the success rate and accuracy of our algorithm on UAV123, OTB2013, OTB2015 are higher than all the compared algorithms. And even in various complex scenes, our algorithm can still maintain a high tracking success rate. Especially in the presence of motion blur and in-plane rotation, the success rate scores are 9.72% and 9.03% higher than the second best algorithm, respectively, which shows that the algorithm has good adaptability.