1.2.1 Unbiased Estimates

Unbiased Estimates

An estimator is a statistic that is used to estimate a population parameter
- When a sample is used with the estimator, the value that it produces is called an estimate
An estimator is called unbiased if the expected value of the estimator is equal to the population parameter
- An estimate from an unbiased estimator is called an unbiased estimate
- This means that the mean of the unbiased estimates will get closer to the population parameter as more samples are taken

If you had the data for a whole population you could find the actual population mean and variance using
- $μ = \frac{Σ x}{n}$
- $σ^{2} = \frac{Σ {(x - μ)}^{2}}{n} = \frac{Σ x^{2}}{n} - μ^{2}$
If you are using a sample to estimate the mean of a population then an unbiased estimate is given by
- $\bar{x} = \frac{Σ x}{n}$
- This is the same formula for the population mean
If you are using a sample to estimate the variance of a population then an unbiased estimate is given by
- $s^{2} = \frac{Σ {(x - \bar{x})}^{2}}{n - 1}$
- This can be written in different ways
- $s^{2} = \frac{Σ {(x - \bar{x})}^{2}}{n - 1} = \frac{1}{n - 1} (Σ x^{2} - \frac{{(Σ x)}^{2}}{n}) = \frac{n}{n - 1} (\frac{Σ x^{2}}{n} - {\bar{x}}^{2})$
- This is a different formula to the population variance
- The last formula shows a method for finding an unbiased estimate for the variance
  - Find the variance of the sample (treating it as a population)
  - Multiply this by $\frac{n}{n - 1}$

Unfortunately square rooting an unbiased variance does not result in an unbiased standard deviation
There is not a formula for an unbiased estimate for the standard deviation that works for all populations
- Therefore it is better to just work with the variance and not the standard deviation
If you need an estimate for the standard deviation then you can use:
- You can use the square root of your unbiased estimate for the population variance
  - $s = \sqrt{\frac{Σ {(x - \bar{x})}^{2}}{n - 1}} = \sqrt{\frac{1}{n - 1} (Σ x^{2} - \frac{{(Σ x)}^{2}}{n})}$
- This won’t be unbiased but it will be a good estimate

If you are given the summary statistics $Σ x$ and $Σ x^{2}$ then you can simply use the formulae in the formula booklet
- $\bar{x} = \frac{Σ x}{n}$
- $s^{2} = \frac{1}{n - 1} (Σ x^{2} - \frac{{(Σ x)}^{2}}{n})$
If you are given the raw data then you will first need to calculate $Σ x$ and $Σ x^{2}$

The times, $T$ minutes, spent on daily revision of a random sample of 50 A Level students from the UK are summarised as follows.

$n = 50$ $Σ t = 6174$ $Σ t^{2} = 831581$

Calculate unbiased estimates of the population mean and variance of the times spent on daily revision by A Level students in the UK

1-2-1-unbiased-estimates-we-solution

Always check whether you need to divide by n or n-1 by looking carefully at the wording in the question.