Functional aggregation for nonparametric regression
Anatoli Juditsky, Arkadi S. Nemirovski · The Annals of Statistics · 2000
We consider the problem of estimating an unknown function $f$ from $N$ noisy observations on a random grid. In this paper we address the following aggregation problem: given $M$ functions $f_1,\dots, f_M$, find an “aggregated ”estimator which approximates $f$ nearly as well as the best convex combination $f^*$ of $f_1,\dots, f_M$. We propose algorithms which provide approximations of $f^*$ with expected $L_2$ accuracy $O(N^{-1/4}\ln^{1/4} M$. We show that this approximation rate cannot be significantly improved. We discuss two specific applications: nonparametric prediction for a dynamic system with output nonlinearity and reconstruction in the Jones – Barron class.
Cited by 167 works. doi:10.1214/aos/1015951994
Authors
References
- Classification and Regression Trees.
- Classification and Regression Trees.
- Multivariate Adaptive Regression Splines
- Projection Pursuit Regression
- Projection Pursuit
- Wavelet Shrinkage: Asymptopia?
- Applied nonparametric regression
- Universal approximation bounds for superpositions of a sigmoidal function
- Applied Nonparametric Regression
- Problems in the Analysis of Survey Data, and a Proposal