Inducing programs in a direct-manipulation environment
David Maulsby, Ian H. Witten · 1989
End users who need to program within highly interactive direct-manipulation interfaces should be able to communicate their intentions through concrete demonstration rather than in terms of symbolic abstraction. This paper describes a system that learns procedures in interactive graphics taught to it “by example” by minimally trained users. It shows how techniques of machine learning and reactive interfaces can support one another—the former providing generalization heuristics to identify constraints implicit in user actions, the latter offering immediate feedback to help the user clarify hidden constraints and correct errors before they are planted into the procedure. The teacher's attention is focused on the learning system's perceptual and inferential shortcomings through a metaphorical apprentice called Metamouse, which generalizes action sequences on the fly and eagerly carries out any actions it can predict. The success of the induction process is assessed quantitatively by counting erroneous predictions made during example tasks.
Cited by 86 works. doi:10.1145/67449.67463 Open-access PDF
Authors
References
- Strips: A new approach to the application of theorem proving to problem solving
- Inductive Inference: Theory and Methods
- Generalization as search
- PYGMALION: A Creative Programming Environment
- Generalization as Search
- Felicity conditions for human skill acquisition: validating an ai-based theory
- Programming by example
- Defining constraints graphically
- Creating dynamic interaction techniques by demonstration
- Fundamentals of mathematics