Abstract: The Chinese Visible Human Project Research Team from The Third Military Medical University has successfully collected several Chinese visible human(CVH) data sets since October 2002. With these images a learning medicine machine can be developed, but CVH image segmentation is one of the hardest tasks, especially in the brain images. The Chinese visual human brain images are analyzed in HSV color space, which can distinguish different areas in brain clearly. A new fuzzy anisotropic diffusion function is presented, which can diffuse the images while preserving the edge information. With the effect of the fake grey matters, which belong to grey matters located under current image and have similar color with true grey matters, it is hard to get exact grey matters. In order to get exact grey matters from brain images, the Ostu method and a new fast table method are presented to analyze the saturation information, hue information, and value information. Using these methods the grey matters can be segmented exactly. Anatomy information and region information are fused to analyze the intensity information and confirm the final results correctly. The experiments to segment the Chinese visual human brain images show that the method of this paper can obtain right results in an accuracy way.