Research on Learning Weights of Fuzzy Production Rules Based on Maximum Fuzzy Entropy

Fuzzy production rules (FPRs) is a fundamental and important way of imprecise knowledge representation. For enhancing generalization capability of FPRs for the given examples, the concept of weight is introduced into FPRs. So it is necessary to explore specific criterion for determining these weight values. Generally speaking, the usual criterion of the weight values adjustment, which is basedonly on improving training accuracy, often results in an over-fitting. This paper aims to accomplish this task by using a new method based on the well-known maximum fuzzy entropy principle. In the case that the training accuracy does not decrease, the testing accuracy will increase with the value of fuzzy entropy of training set. At the same time, adjusting the weight values can change the fuzzy entropy of training set. Therefore, this new criterion can avoid the drawback of over-fitting and can improve the testing accuracy.