Constructive induction on decision trees
Christopher J. Matheus, Larry A. Rendell · 1989
Selective induction techniques perform poorly when the features are inappropriate for the target concept. One solution is to have the learning system construct new features automatically; unfortunately feature construction is a difficult and poorly understood problem. In this paper we present a definition of feature construction in concept learning, and offer a framework for its study based on four aspects: detection, selection, generalization, and evaluation. This framework is used in the analysis of existing learning systems and as the basis for the design of a new system, citre. citre performs feature construction using decision trees and simple domain knowledge as constructive biases. Initial results on a set of spatial-dependent problems suggest the importance of domain knowledge and feature generalization, i.e., constructive induction. 1 Introduction Good representations are often crucial for solving difficult problems in AI. Finding suitable problem representations, however, ...
Cited by 186 works.
Authors
References
- Induction of Decision Trees
- Scientific Discovery: Computational Explorations of the Creative Processes
- A theory and methodology of inductive learning
- Learning DNF by decision trees
- Duce, an oracle-based approach to constructive induction
- Learning and Inductive Inference
- Substantial constructive induction using layered information compression: tractable feature formation in search
- Learning Hard Concepts.
- A CONSTRUCTIVE INDUCTION FRAMEWORK
- Managing constructive induction using optimization and test incorporation