Linear Smoothers and Additive Models
Andreas Buja, Trevor J. Hastie, Robert John Tibshirani · The Annals of Statistics · 1989
We study linear smoothers and their use in building nonparametric regression models. In the first part of this paper we examine certain aspects of linear smoothers for scatterplots; examples of these are the running-mean and running-line, kernel and cubic spline smoothers. The eigenvalue and singular value decompositions of the corresponding smoother matrix are used to describe qualitatively a smoother, and several other topics such as the number of degrees of freedom of a smoother are discussed. In the second part of the paper we describe how linear smoothers can be used to estimate the additive model, a powerful nonparametric regression model, using the "back-fitting algorithm." We show that backfitting is the Gauss-Seidel iterative method for solving a set of normal equations associated with the additive model. We provide conditions for consistency and nondegeneracy and prove convergence for the backfitting and related algorithms for a class of smoothers that includes cubic spline smoothers.
Cited by 989 works. doi:10.1214/aos/1176347115 Open-access PDF
Authors
References
- Matrix Computations
- Perturbation Theory for Linear Operators
- Exploratory Data Analysis
- Robust Locally Weighted Regression and Smoothing Scatterplots
- Solving Least Squares Problems
- Projection Pursuit Regression
- Smoothing by spline functions
- The Theory of Matrices in Numerical Analysis.
- Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
- Data Analysis and Regression.