nearest neighbors degrees of freedom

Question

For polynomial fitting with a polynomial of degree $n$, we have $n$ degrees of freedom. Is there a similar concept for $k$ nearest neighbors? Is there any way to compare the degrees in general? I come from an EE background so I might not familiar with some of the advanced terminology.

Polynomials of degree $n$ have $n+1$ d.f. – Glen_b Feb 20 '13 at 05:25 — Glen_b, Feb 20 '13 at 05:25

score 1 · Answer 1 · answered Apr 12 '14 at 18:43

1

It is roughly $N/k$ where $N$ is the number of data points. See here: http://en.wikipedia.org/wiki/Degrees_of_freedom_(statistics) http://www.cs.ubc.ca/~murphyk/Teaching/CS340-Fall07/L4_knn.pdf

answered Apr 12 '14 at 18:43

Or Zuk

211

nearest neighbors degrees of freedom

1 Answers1

Linked