Hierarchical Classifier Design Using Mutual Information
Ishwar K. Sethi, G. P. R. Sarvarayudu · IEEE Transactions on Pattern Analysis and Machine Intelligence · 1982
A nonparametric algorithm is presented for the hierarchical partitioning of the feature space. The algorithm is based on the concept of average mutual information, and is suitable for multifeature multicategory pattern recognition problems. The algorithm generates an efficient partitioning tree for specified probability of error by maximizing the amount of average mutual information gain at each partitioning step. A confidence bound expression is presented for the resulting classifier. Three examples, including one of handprinted numeral recognition, are presented to demonstrate the effectiveness of the algorithm.
Cited by 184 works. doi:10.1109/tpami.1982.4767278
Authors
References
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
- Transmission of Information.
- An Algorithm for Constructing Optimal Binary Decision Trees
- A Nonparametric Partitioning Procedure for Pattern Classification
- A Recursive Partitioning Decision Rule for Nonparametric Classification
- Problem-Solving Models and Search Strategies for Pattern Recognition
- A combined nonparametric approach to feature selection and binary decision tree design