We would like to thank Dr. Yamazaki, President, and Dr. Sagisaka, Professor, Head of Department 1 , ATR Interpreting Telecommunications Research Laboratories, for their continuous support of this work. I am also grateful to Isotani of the members of Department 1 for the suggestion of the entropy of Ergodic HMM.