Substantial constructive induction using layered information compression: tractable feature formation in search
Larry A. Rendell · 1985
This paper addresses a problem of induction (generalization learning) which is more difficult than any comparable work in AI. The subject of the present research is a hard problem of new terms, a task of realistic constructive induction. While the approach is quite general, the system is analyzed and tested in an environment of heuristic search where noise management and incremental learning are necessary. Here constructive induction becomes feature formation from data represented in elementary form. A high-level attribute or feature such as "piece advantage " in checkers is much more abstract than an elementary descriptor or primitive such as contents of a checkerboard square. Features have often been used in evaluation functions; primitives are usually too detailed for this. To create abstract features from primitives (i.e. to restructure data descriptions), a new form of clustering is used which involves layering of knowledge and invariance of utility relationships related to data primitives and task goals. The scheme, which is both model- and data-driven, requires little background, domain-specific knowledge, but rather constructs it. The method achieves considerable generality with superior noise management and low computational complexity. Although the domains addressed are difficult, initial experimental results are encouraging.
Cited by 59 works.
Authors
References
- Cluster Analysis for Applications
- Pattern Recognition Principles
- Basic objects in natural categories
- LEARNING EFFICIENT CLASSIFICATION PROCEDURES AND THEIR APPLICATION TO CHESS END GAMES
- Some Studies in Machine Learning Using the Game of Checkers. II—Recent Progress
- Learning from Observation: Conceptual Clustering
- Objective Knowledge, an Evolutionary Approach.
- Syntactic pattern recognition and applications
- A theory and methodology of inductive learning
- REDISCOVERING CHEMISTRY WITH THE BACON SYSTEM