估计函数
维库,知识与思想的自由文库
在统计学中,估计函数是一个关于已知样本的函数,它用来估计未知总体的参数,它有时也被称为估计子;一次 估计 是指把这个函数应用在一组已知的数据集上,求函数的结果.对于给定的参数,可以有许多不同的估计函数。我们通过一些选择标准从它们中选出较好的估计函数,但是有时候很难说选择这一个估计子比另外一个好。
若要估計一個我們有興趣的參數(比方說,一個母體的平均數, a binomial proportion, 兩個母體平均數的差, 或者兩個母體標準差的比值),通常會透過下列的程序:
1- Select a random sample from the population of interest.
2- Calculate the point estimate of the parameter.
3- Calculate a measure of its variability, often a confidence interval.
4- Associate with this estimate a measure of variability.
There are two types of estimators: point estimators and interval estimators.
目录 |
[编辑] 点估计函数
参数θ的点估计函数
具有以下性质:
- The error of
is 
- The bias of
is defined as 
is an unbiased estimator of θ iff
for all θ, or, equivalently, iff
for all θ.- The mean squared error of
is defined as ![\operatorname{MSE}(\widehat{\theta}) = \operatorname{E}[(\widehat{\theta} - \theta)^2].](/images/math/7/e/1/7e1be505385909f449f9b0ab4f77654a.png)

- i.e. mean squared error = variance + square of bias.
where var(X) is the variance of X and E(X) is the expected value of X.
The standard deviation of an estimator of θ (the square root of the variance), or an estimate of the standard deviation of an estimator of θ, is called the standard error of θ.
[编辑] 一致性
A consistent estimator is an estimator that converges in probability to the quantity being estimated as the sample size grows.
An estimator tn (where n is the sample size) is a consistent estimator for parameter θ if and only if, for all ε > 0, no matter how small, we have
It is called strongly consistent, if it converges almost surely to the true value.
[编辑] Efficiency
The quality of an estimator is generally judged by its mean squared error.
However, occasionally one chooses the unbiased estimator with the lowest variance. Efficient estimators are those that have the lowest possible variance among all unbiased estimators. In some cases, a biased estimator may have a uniformly smaller mean squared error than does any unbiased estimator, so one should not make too much of this concept. For that and other reasons, it is sometimes preferable not to limit oneself to unbiased estimators; see bias (statistics). Concerning such "best unbiased estimators", see also Cramér-Rao inequality, Gauss-Markov theorem, Lehmann-Scheffé theorem, Rao-Blackwell theorem.
[编辑] Other properties
Often, estimator are due to restrictions (restricted estimators).
[编辑] 参见
- 最大似然估计
- 動差法, 廣義動差法
- Cramér-Rao inequality
- 最小均方誤差法 (MMSE)
- Maximum a posteriori (MAP)
- 最小變異不偏估計式 (MVUE)
- 最佳線性不偏估計 (BLUE)
- 不偏估計式— see bias (statistics).
- Particle filter
- Markov chain Monte Carlo (MCMC)
- 卡尔曼滤波
- 维纳滤波





