Electronic Journal of Statistics

Convergence of functional k-nearest neighbor regression estimate with functional responses

Heng Lian

Full-text: Open access


Let (X1,Y1),,(Xn,Yn) be independent and identically distributed random elements taking values in ℱ×ℋ, where ℱ is a semi-metric space and ℋ is a separable Hilbert space. We investigate the rates of strong (almost sure) convergence of the k-nearest neighbor estimate. We give two convergence results assuming a finite moment condition and exponential tail condition on the noises respectively, with the latter requiring less stringent conditions on k for convergence.

Article information

Electron. J. Statist., Volume 5 (2011), 31-40.

First available in Project Euclid: 7 February 2011

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62G08: Nonparametric regression
Secondary: 62G20: Asymptotic properties

Functional response models martingale difference sequence nearest neighbor estimate rates of convergence


Lian, Heng. Convergence of functional k-nearest neighbor regression estimate with functional responses. Electron. J. Statist. 5 (2011), 31--40. doi:10.1214/11-EJS595. https://projecteuclid.org/euclid.ejs/1297088517

Export citation


  • [1] Antoch, J., Prchal, L., De Rosa, M. R. and Sarda, P. (2008). Functional linear regression with functional response: Application to prediction of electricity consumption. In, Functional and Operatorial Statistics ( S. DaboNiang and F. Ferraty, eds.) 23-29.
  • [2] Bosq, D. (2000)., Linear processes in function spaces: theory and applications. Springer Verlag.
  • [3] Burba, F., Ferraty, F. and Vieu, P. (2009). k-Nearest Neighbour method in functional nonparametric regression., Journal of Nonparametric Statistics 21 453–469.
  • [4] Cover, T. M. (1968). Estimation by the nearest neighbor rule., IEEE Transactions on Information Theory 14 50-55.
  • [5] Cover, T. M. and Hart, P. E. (1967). Nearest neighbor pattern classification., IEEE Transactions on Information Theory 13 21-27.
  • [6] Delsol, L. (2009). Advances on asymptotic normality in non-parametric functional time series analysis., Statistics 43 13–33.
  • [7] Ferraty, F., Keilegom, I. and Vieu, P. (2010). On the Validity of the Bootstrap in Non-Parametric Functional Regression., Scandinavian Journal of Statistics 37 286–306.
  • [8] Ferraty, F., Mas, A. and Vieu, P. (2007). Nonparametric regression on functional data: Inference and practical aspects., Australian & New Zealand Journal of Statistics 49 267-286.
  • [9] Ferraty, F. and Vieu, P. (2002). The functional nonparametric model and application to spectrometric data., Computational Statistics 17 545-564.
  • [10] Ferraty, F. and Vieu, P. (2004). Nonparametric models for functional data, with application in regression, time-series prediction and curve discrimination., Journal of nonparametric statistics 16 111-125.
  • [11] Ferraty, F. and Vieu, P. (2006)., Nonparametric functional data analysis: theory and practice. Springer series in statistics. Springer, New York, NY.
  • [12] Ferraty, F., Laksaci, A., Tadj, A. and Vieu, P. (2010). Rate of uniform consistency for nonparametric estimates with functional variables., Journal of Statistical Planning and Inference 140 335–352.
  • [13] Fix, E. and Hodges, J. L. (1989). Discriminatory analysis. nonparametric discrimination: consistency properties., International Statistical Review 57 238-247.
  • [14] Ledoux, M. and Talagrand, M. (1991)., Probability in Banach spaces: isoperimetry and processes. Springer-Verlag, Berlin; New York.
  • [15] Lian, H. (2007). Nonlinear functional models for functional responses in reproducing kernel Hilbert spaces., Canadian Journal of Statistics-Revue Canadienne De Statistique 35 597-606.
  • [16] Parzen, E. (1962). On the estimation of a probability density function and mode., Annals of Mathematical Statistics 33 1065-1076.
  • [17] Pollard, D. (1984)., Convergence of stochastic processes. Springer-Verlag, New York.
  • [18] Preda, C. (2007). Regression models for functional data by reproducing kernel Hilbert spaces methods., Journal of Statistical Planning and Inference 137 829-840.
  • [19] Ramsay, J. O. and Silverman, B. W. (2005)., Functional data analysis, 2nd ed. Springer series in statistics. Springer, New York.
  • [20] Rosenblatt, M. (1956). Remarks on some nonparametric estimates of density function., Annals of Mathematical Statistics 27 832-837.
  • [21] van der Geer, S. A. (2000)., Applications of empirical process theory. Cambridge University Press, Cambridge.
  • [22] van der Vaart, A. W. and Van Zanten, J. H. (2008). Rates of contraction of posterior distributions based on Gaussian process priors., Annals of Statistics 36 1435-1463.
  • [23] van der Vaart, A. W. and Wellner, J. A. (1996)., Weak convergence and empirical processes. Springer series in statistics. Springer, New York.
  • [24] Yang, Y. H. and Barron, A. (1999). Information-theoretic determination of minimax rates of convergence., Annals of Statistics 27 1564-1599.