where each observation has been generated from an underlying, but unknown probability distribution P(x, y).
Let A be the set of all possible parameter vectors for the function fa. Our goal is to find the function fa*, called the decision rule, that minimizes the risk function
where a* is the parameter vector that yields the minimizing function out of all possible functions fa for all a p A. However, since P(x, y) is unknown, we cannot calculate R(a). An estimate of the risk function is the empirical risk function
Was this article helpful?
You Might Start Missing Your Termites After Kickin'em Out. After All, They Have Been Your Roommates For Quite A While. Enraged With How The Termites Have Eaten Up Your Antique Furniture? Can't Wait To Have Them Exterminated Completely From The Face Of The Earth? Fret Not. We Will Tell You How To Get Rid Of Them From Your House At Least. If Not From The Face The Earth.