8.1 A Confidence Interval When the Population Standard Deviation Is Known or Large Sample Size

Calculating the Confidence Interval

Consider the standardizing formula for the sampling distribution developed in the discussion of the Central Limit Theorem:

Notice that µ is substituted for ${\mu }_{\stackrel{-}{x}}$ because we know that the expected value of ${\mu }_{\stackrel{-}{x}}$ is µ from the Central Limit theorem and ${\sigma }_{\stackrel{-}{x}}$ is replaced with $\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.$, also from the Central Limit Theorem.

In this formula we know $\bar{X}$, ${\sigma }_{\stackrel{-}{x}}$ and n, the sample size. (In actuality we do not know the population standard deviation, but we do have a point estimate for it, s, from the sample we took. More on this later.) What we do not know is μ or Z₁. We can solve for either one of these in terms of the other. Solving for μ in terms of Z₁ gives:

Remembering that the Central Limit Theorem tells us that the distribution of the $\overline{X}$'s, the sampling distribution for means, is normal, and that the normal distribution is symmetrical, we can rearrange terms thus:

This is the formula for a confidence interval for the mean of a population.

Notice that Z_α has been substituted for Z₁ in this equation. This is where a choice must be made by the statistician. The analyst must decide the level of confidence they wish to impose on the confidence interval. α is the probability that the interval will not contain the true population mean. The confidence level is defined as (1-α). Z_α is the number of standard deviations $\overline{X}$ lies from the mean with a certain probability. If we chose Z_α = 1.96 we are asking for the 95% confidence interval because we are setting the probability that the true mean lies within the range at 0.95. If we set Z_α at 1.64 we are asking for the 90% confidence interval because we have set the probability at 0.90. These numbers can be verified by consulting the Standard Normal table. Divide either 0.95 or 0.90 in half and find that probability inside the body of the table. Then read on the top and left margins the number of standard deviations it takes to get this level of probability.

In reality, we can set whatever level of confidence we desire simply by changing the Z_α value in the formula. It is the analyst's choice. Common convention in Economics and most social sciences sets confidence intervals at either 90, 95, or 99 percent levels. Levels less than 90% are considered of little value. The level of confidence of a particular interval estimate is called by (1-α).

A good way to see the development of a confidence interval is to graphically depict the solution to a problem requesting a confidence interval. This is presented in Figure 8.2 for the example in the introduction concerning the number of downloads from Apple Music. That case was for a 95% confidence interval, but other levels of confidence could have just as easily been chosen depending on the need of the analyst. However, the level of confidence MUST be pre-set and not subject to revision as a result of the calculations.

Figure 8.2

For this example, let's say we know that the actual population mean number of Apple Music downloads is 2.1. The true population mean falls within the range of the 95% confidence interval. There is absolutely nothing to guarantee that this will happen. Further, if the true mean falls outside of the interval we will never know it. We must always remember that we will never ever know the true mean. Statistics simply allows us, with a given level of probability (confidence), to say that the true mean is within the range calculated. This is what was called in the introduction, the "level of ignorance admitted".

Changing the Confidence Level or Sample Size

Here again is the formula for a confidence interval for an unknown population mean assuming we know the population standard deviation:

It is clear that the confidence interval is driven by two things, the chosen level of confidence, $Z_{\alpha }$, and the standard deviation of the sampling distribution. The Standard deviation of the sampling distribution is further affected by two things, the standard deviation of the population and the sample size we chose for our data. Here we wish to examine the effects of each of the choices we have made on the calculated confidence interval, the confidence level and the sample size.

For a moment we should ask just what we desire in a confidence interval. Our goal was to estimate the population mean from a sample. We have forsaken the hope that we will ever find the true population mean, and population standard deviation for that matter, for any case except where we have an extremely small population and the cost of gathering the data of interest is very small. In all other cases we must rely on samples. With the Central Limit Theorem we have the tools to provide a meaningful confidence interval with a given level of confidence, meaning a known probability of being wrong. By meaningful confidence interval we mean one that is useful. Imagine that you are asked for a confidence interval for the ages of your classmates. You have taken a sample and find a mean of 19.8 years. You wish to be very confident so you report an interval between 9.8 years and 29.8 years. This interval would certainly contain the true population mean and have a very high confidence level. However, it hardly qualifies as meaningful. The very best confidence interval is narrow while having high confidence. There is a natural tension between these two goals. The higher the level of confidence the wider the confidence interval as the case of the students' ages above. We can see this tension in the equation for the confidence interval.

The confidence interval will increase in width as $Z\alpha$ increases, $Z\alpha$ increases as the level of confidence increases. There is a tradeoff between the level of confidence and the width of the interval. Now let's look at the formula again and we see that the sample size also plays an important role in the width of the confidence interval. The sample size, $n$, shows up in the denominator of the standard deviation of the sampling distribution. As the sample size increases, the standard deviation of the sampling distribution decreases and thus the width of the confidence interval, while holding constant the level of confidence. Again we see the importance of having large samples for our analysis although we then face a second constraint, the cost of gathering data.

Example 8.1

Suppose we are interested in the mean scores on an exam. A random sample of 36 scores is taken and gives a sample mean (sample mean score) of 68 ($\overline{X}$ = 68). In this example we have the unusual knowledge that the population standard deviation is 3 points. Do not count on knowing the population parameters outside of textbook examples. Find a confidence interval estimate for the population mean exam score (the mean score on all exams).

Problem

Find a 90% confidence interval for the true (population) mean of statistics exam scores.

Figure 8.3

Solution

The solution is shown step by step:

The formula for a confidence interval for an unknown population mean assuming we know the population standard deviation is:

$$\overline{X}-Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)\le \mu \le \overline{X}+Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)$$

For a 90% confidence interval, visualize an area of 0.90 centered under the normal curve (See Figure 8.3). The remaining area for the two tails of the normal distribution is then 0.10, which indicates that the area in the left tail is one-half of 0.10, which is 0.05. The corresponding z-score that cuts off an area of 0.05 in the left tail is 1.645.

In this example we are given that the population standard deviation $\sigma = 3$.

We are also given that the sample size $n = 36$ and the sample mean $\overline{X} =68$.

Substituting these values in the confidence interval formula results in the following:

$$\overline{X}-Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)\le \mu \le \overline{X}+Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)$$

$$68-1.645\left(\frac{3}{\sqrt{36}}\right)\le \mu \le 68+1.645\left(\frac{3}{\sqrt{36}}\right)$$

$$68-0.8225\le \mu \le 68+0.8225$$

$$67.1775\le \mu \le 68.8225$$

We estimate with 90% confidence that the true population mean exam score for all statistics students is between 67.18 and 68.82.

Example 8.2

Problem

Suppose we change the original problem in Example 8.1 by using a 95% confidence level. Find a 95% confidence interval for the true (population) mean statistics exam score.

Solution

Figure 8.4

$$\mu =\stackrel{\_}{x}\pm Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)$$

$$\mu =68\pm 1.96\left(\frac{3}{\sqrt{36}}\right)$$

$$67.02\le \mu \le 68.98$$

σ = 3; n = 36; The confidence level is 95% (CL = 0.95).

CL = 0.95 so α = 1 – CL = 1 – 0.95 = 0.05

$Z_{\frac{\alpha }{2}}=Z_{0.025}=1.96$

Notice that the plus/minus term in the equation is larger for a 95% confidence level in the original problem.

Comparing the results: The 90% confidence interval is (67.18, 68.82). The 95% confidence interval is (67.02, 68.98). The 95% confidence interval is wider. If you look at the graphs, because the area 0.95 is larger than the area 0.90, it makes sense that the 95% confidence interval is wider. To be more confident that the confidence interval actually does contain the true value of the population mean for all statistics exam scores, the confidence interval necessarily needs to be wider. This demonstrates a very important principle of confidence intervals. There is a trade off between the level of confidence and the width of the interval. Our desire is to have a narrow confidence interval, huge wide intervals provide little information that is useful. But we would also like to have a high level of confidence in our interval. This demonstrates that we cannot have both.

Figure 8.5

Summary: Effect of Changing the Confidence Level

• Increasing the confidence level makes the confidence interval wider.
• Decreasing the confidence level makes the confidence interval narrower.

And again here is the formula for a confidence interval for an unknown mean assuming we have the population standard deviation:

$$\overline{X}-Z_{\alpha }\left(\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.\right)\le \mu \le \overline{X}+Z_{\alpha }\left(\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.\right)$$

The standard deviation of the sampling distribution was provided by the Central Limit Theorem as $\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.$. While we infrequently get to choose the sample size it plays an important role in the confidence interval. Because the sample size is in the denominator of the equation, as $n$ increases it causes the standard deviation of the sampling distribution to decrease and thus the width of the confidence interval to decrease. We have met this before as we reviewed the effects of sample size on the Central Limit Theorem. There we saw that as $n$ increases the sampling distribution narrows until in the limit it collapses on the true population mean.

Changing the Sample Size

Example 8.3

Suppose we change the original problem in Example 8.1 to see what happens to the confidence interval if the sample size is changed.

Problem

Leave everything the same except the sample size. Use the original 90% confidence level. What happens to the confidence interval if we increase the sample size and use n = 100 instead of n = 36? What happens if we decrease the sample size to n = 25 instead of n = 36?

Solution

$\mu =\stackrel{\_}{x}\pm Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)$
$\mu =68\pm 1.645\left(\frac{3}{\sqrt{100}}\right)$
$67.5065\le \mu \le 68.4935$
If we increase the sample size n to 100, we decrease the width of the confidence interval relative to the original sample size of 36 observations.

Solution

$\mu =\stackrel{\_}{x}\pm Z_{\alpha }\left(\frac{\sigma }{\sqrt{n}}\right)$
$\mu =68\pm 1.645\left(\frac{3}{\sqrt{25}}\right)$
$67.013\le \mu \le 68.987$
If we decrease the sample size n to 25, we increase the width of the confidence interval by comparison to the original sample size of 36 observations.

Summary: Effect of Changing the Sample Size

• Increasing the sample size makes the confidence interval narrower.
• Decreasing the sample size makes the confidence interval wider.

Try It 8.3

Refer back to the pizza-delivery Try It 8.1 exercise. The mean delivery time is 36 minutes and the population standard deviation is six minutes. Assume the sample size is changed to 50 restaurants with the same sample mean. Find a 90% confidence interval estimate for the population mean delivery time.

We have already seen this effect when we reviewed the effects of changing the size of the sample, n, on the Central Limit Theorem. See Figure 7.8 to see this effect. Before we saw that as the sample size increased the standard deviation of the sampling distribution decreases. This was why we choose the sample mean from a large sample as compared to a small sample, all other things held constant.

Thus far we assumed that we knew the population standard deviation. This will virtually never be the case. We will have the sample standard deviation, s, however. This is a point estimate for the population standard deviation and can be substituted into the formula for confidence intervals for a mean under certain circumstances. We just saw the effect the sample size has on the width of confidence interval and the impact on the sampling distribution for our discussion of the Central Limit Theorem. We can invoke this to substitute the point estimate for the standard deviation if the sample size is large "enough". Simulation studies indicate that 30 observations or more will be sufficient to eliminate any meaningful bias in the estimated confidence interval.

Example 8.4

Spring break can be a very expensive holiday. A sample of 80 students is surveyed, and the average amount spent by students on travel and beverages is $593.84. The sample standard deviation is approximately $369.34.

Problem

Construct a 92% confidence interval for the population mean amount of money spent by spring breakers.

Solution

We begin with the confidence interval for a mean. We use the formula for a mean because the random variable is dollars spent and this is a continuous random variable. The point estimate for the population standard deviation, s, has been substituted for the true population standard deviation because with 80 observations there is no concern for bias in the estimate of the confidence interval.

$$\mu =\overline{x}\pm \left[Z_{\left(\mathrm{a\; /}2\right)}\frac{s}{\sqrt{n}}\right]$$

Substituting the values into the formula, we have:

$$\mu =593.84\pm \left[1.75\frac{369.34}{\sqrt{80}}\right]$$

$Z_{(a/2)}$ is found on the standard normal table by looking up 0.46 in the body of the table and finding the number of standard deviations on the side and top of the table; 1.75. The solution for the interval is thus:

$$\mu =593.84\pm 72.2636=(521.57,666.10)$$

$$\$521.58\le \mu \le \$666.10$$

Figure 8.6

Try It 8.4

The price of a chair is a large range of cost. The average cost of 25 chairs in a store is $100. The sample standard deviation is $50. Construct a 92% confidence interval for the population mean of the cost of chairs.

Formula Review

The general form for a confidence interval for a single population mean, known standard deviation, normal distribution is given by $\overline{X}-Z_{\alpha }\left(\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.\right)\le \mu \le \overline{X}+Z_{\alpha }\left(\raisebox{1ex}{$\sigma $}\!\left/ \!\raisebox{-1ex}{$\sqrt{n}$}\right.\right)$ This formula is used when the population standard deviation is known.

CL = confidence level, or the proportion of confidence intervals created that are expected to contain the true population parameter

α = 1 – CL = the proportion of confidence intervals that will not contain the population parameter

$z_{\frac{\alpha }{2}}$ = the z-score with the property that the area to the right of the z-score is $\frac{\propto }{2}$ this is the z-score used in the calculation where α = 1 – CL.