Abstract: During the recent ten years, analysis of video content has become a hot research topic Generally speaking, in the video hierarchical structure, scene is the highest layer of video processing However, with the current research progress in video processing, It is believed that a higher layer video processing unit, “Program”, is needed to represent a video “program” is defined as one of more continuous scenes For example, in a several hour very comprehensive video stream, there are thousands of scence It is difficult to manage this large amount of information without the program layer Another example is video genre verification Almost all of the proposed algorithms in this research area are based on the assumption that programs have been manually segmented So, implementing automatic program segmentation is of great benefit in reality A new video processing unit, “program”, is proposed to be inserted between scene layer and video layer A TV program specific automatic segmentation algorithm is also proposed