Abstract: In recent years, the football video retrieval and abstract techniques develop more and more rapidly. As one of the key technologies of video retrieval and abstract for soccer video, highlights extracting technique has high academic research value and wide application perspective. Based on the analysis of existing football video research methods, it is proposed that a highlights extracting system using affection arousal modeling from the angle of audiences emotional change, which is based on the theory of Hanjalics affection curve. The arousal features are extracted from football video to construct arousal modeling and generate arousal curve, then highlights can be extracted based on arousal curve. Compared with Hanjalics work, some improvements and further research are proposed based on Hanjalics excitement curve. A new feature, named shot intensity, is designed to construct arousal modeling instead of the motion intensity feature. This has improved the systems recall rate, accuracy and computing performance. Domain knowledge is applied in the highlights shot locating process to achieve high accuracy, and the highlights can also be automatically filtered according to the users required watching time. The experimental results indicate that the proposed approach is effective and the shot intensity can replace motion intensity to construct arousal model and the proposed algorithms are effective.