Abstract: Hidden Markov model（HMM） is successfully used in speech recognition, yet it is still unsatisfactory to its recognition speed and rate. An algorithm of well distributed initial code book is proposed according to the system requirement of real time and recognition rate. It improves the system recognition accuracy by using another high speed algorithm for building code book and a method of HMM two step syllables recognition. The algorithm is simple and easy to implement in real time.