Independent and mutually exclusive do **not** mean the same thing.

### Independent Events

Two events are independent if one of the following are true:

- $P\left(A\right|B)=P(A)$
- $P\left(B\right|A)=P(B)$
- $P(A\cap B)=P\left(A\right)P\left(B\right)$

Two events *A* and *B* are independent if the knowledge that one occurred does not affect the chance the other occurs. For example, the outcomes of two roles of a fair die are independent events. The outcome of the first roll does not change the probability for the outcome of the second roll. To show two events are independent, you must show **only one** of the above conditions. If two events are NOT independent, then we say that they are **dependent**.

Sampling may be done **with** replacement or **without replacement**.

**With replacement**: If each member of a population is replaced after it is picked, then that member has the possibility of being chosen more than once. When sampling is done with replacement, then events are considered to be independent, meaning the result of the first pick will not change the probabilities for the second pick.**Without replacement**: When sampling is done without replacement, each member of a population may be chosen only once. In this case, the probabilities for the second pick are affected by the result of the first pick. The events are considered to be dependent or not independent.

If it is not known whether *A* and *B* are independent or dependent, **assume they are dependent until you can show otherwise**.

### Example 3.4

You have a fair, well-shuffled deck of 52 cards. It consists of four suits. The suits are clubs, diamonds, hearts and spades. There are 13 cards in each suit consisting of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, *J* (jack), *Q* (queen), *K* (king) of that suit.

a. Sampling with replacement:

Suppose you pick three cards with replacement. The first card you pick out of the 52 cards is the *Q* of spades. You put this card back, reshuffle the cards and pick a second card from the 52-card deck. It is the ten of clubs. You put this card back, reshuffle the cards and pick a third card from the 52-card deck. This time, the card is the *Q* of spades again. Your picks are {*Q* of spades, ten of clubs, *Q* of spades}. You have picked the *Q* of spades twice. You pick each card from the 52-card deck.

b. Sampling without replacement:

Suppose you pick three cards without replacement. The first card you pick out of the 52 cards is the *K* of hearts. You put this card aside and pick the second card from the 51 cards remaining in the deck. It is the three of diamonds. You put this card aside and pick the third card from the remaining 50 cards in the deck. The third card is the *J* of spades. Your picks are {*K* of hearts, three of diamonds, *J* of spades}. Because you have picked the cards without replacement, you cannot pick the same card twice. The probability of picking the three of diamonds is called a conditional probability because it is conditioned on what was picked first. This is true also of the probability of picking the J of spades. The probability of picking the J of spades is actually conditioned on *both* the previous picks.

You have a fair, well-shuffled deck of 52 cards. It consists of four suits. The suits are clubs, diamonds, hearts and spades. There are 13 cards in each suit consisting of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, *J* (jack), *Q* (queen), *K* (king) of that suit. Three cards are picked at random.

- Suppose you know that the picked cards are
*Q*of spades,*K*of hearts and*Q*of spades. Can you decide if the sampling was with or without replacement? - Suppose you know that the picked cards are
*Q*of spades,*K*of hearts, and*J*of spades. Can you decide if the sampling was with or without replacement?

### Example 3.5

You have a fair, well-shuffled deck of 52 cards. It consists of four suits. The suits are clubs, diamonds, hearts, and spades. There are 13 cards in each suit consisting of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, *J* (jack), *Q* (queen), and *K* (king) of that suit. *S* = spades, *H* = Hearts, *D* = Diamonds, *C* = Clubs.

- Suppose you pick four cards, but do not put any cards back into the deck. Your cards are
*QS*, 1*D*, 1*C*,*QD*. - Suppose you pick four cards and put each card back before you pick the next card. Your cards are
*KH*, 7*D*, 6*D*,*KH*.

Which of a. or b. did you sample with replacement and which did you sample without replacement?

a. Without replacement; b. With replacement

You have a fair, well-shuffled deck of 52 cards. It consists of four suits. The suits are clubs, diamonds, hearts, and spades. There are 13 cards in each suit consisting of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, *J* (jack), *Q* (queen), and *K* (king) of that suit. *S* = spades, *H* = Hearts, *D* = Diamonds, *C* = Clubs. Suppose that you sample four cards without replacement. Which of the following outcomes are possible? Answer the same question for sampling with replacement.

*QS*, 1*D*, 1*C*,*QD**KH*, 7*D*, 6*D*,*KH**QS*, 7*D*, 6*D*,*KS*

### Mutually Exclusive Events

*A* and *B* are mutually exclusive events if they cannot occur at the same time. Said another way, If *A* occurred then *B* cannot occur and vise-a-versa. This means that *A* and *B* do not share any outcomes and $P(A\cap B)=0$.

For example, suppose the sample space *S* = {1, 2, 3, 4, 5, 6, 7, 8, 9, 10}. Let *A* = {1, 2, 3, 4, 5}, *B* = {4, 5, 6, 7, 8}, and *C* = {7, 9}. A $\cap $ B = {4, 5}. $P(A\cap B)=\frac{2}{10}$ and is not equal to zero. Therefore, *A* and *B* are not mutually exclusive. *A* and *C* do not have any numbers in common so $P(A\cap C)=0$. Therefore, *A* and *C* are mutually exclusive.

If it is not known whether *A* and *B* are mutually exclusive, **assume they are not until you can show otherwise**. The following examples illustrate these definitions and terms.

### Example 3.6

Flip two fair coins. (This is an experiment.)

The sample space is {*HH*, *HT*, *TH*, *TT*} where *T* = tails and *H* = heads. The outcomes are *HH*, *HT*, *TH*, and *TT*. The outcomes HT and TH are different. The *HT* means that the first coin showed heads and the second coin showed tails. The *TH* means that the first coin showed tails and the second coin showed heads.

- Let
*A*= the event of getting**at most one tail**. (At most one tail means zero or one tail.) Then*A*can be written as {*HH*,*HT*,*TH*}. The outcome*HH*shows zero tails.*HT*and*TH*each show one tail. - Let
*B*= the event of getting all tails.*B*can be written as {*TT*}.*B*is the**complement**of*A*, so*B*=*A′*. Also,*P*(*A*) +*P*(*B*) =*P*(*A*) +*P*(*A′*) = 1. - The probabilities for
*A*and for*B*are*P*(*A*) = $\frac{3}{4}$ and*P*(*B*) = $\frac{1}{4}$. - Let
*C*= the event of getting all heads.*C*= {*HH*}. Since*B*= {*TT*}, $P(B\cap C)=0$.*B*and*C*are mutually exclusive. (*B*and*C*have no members in common because you cannot have all tails and all heads at the same time.) - Let
*D*= event of getting**more than one**tail.*D*= {*TT*}.*P*(*D*) = $\frac{1}{4}$ - Let
*E*= event of getting a head on the first roll. (This implies you can get either a head or tail on the second roll.)*E*= {*HT*,*HH*}.*P*(*E*) = $\frac{2}{4}$ - Find the probability of getting
**at least one**(one or two) tail in two flips. Let*F*= event of getting at least one tail in two flips.*F*= {*HT*,*TH*,*TT*}.*P*(*F*) = $\frac{3}{4}$

Draw two cards from a standard 52-card deck with replacement. Find the probability of getting at least one black card.

### Example 3.7

Flip two fair coins. Find the probabilities of the events.

- Let
*F*= the event of getting at most one tail (zero or one tail). - Let
*G*= the event of getting two faces that are the same. - Let
*H*= the event of getting a head on the first flip followed by a head or tail on the second flip. - Are
*F*and*G*mutually exclusive? - Let
*J*= the event of getting all tails. Are*J*and*H*mutually exclusive?

Look at the sample space in Example 3.6.

- Zero (0) or one (1) tails occur when the outcomes
*HH*,*TH*,*HT*show up.*P*(*F*) = $\frac{3}{4}$ - Two faces are the same if
*HH*or*TT*show up.*P*(*G*) = $\frac{2}{4}$ - A head on the first flip followed by a head or tail on the second flip occurs when
*HH*or*HT*show up.*P*(*H*) = $\frac{2}{4}$ *F*and*G*share*HH*so $P(F\cap G)$ is not equal to zero (0).*F*and*G*are not mutually exclusive.- Getting all tails occurs when tails shows up on both coins (
*TT*).*H*’s outcomes are*HH*and*HT*.

*J* and *H* have nothing in common so $P(J\cap H)$ = 0. *J* and *H* are mutually exclusive.

A box has two balls, one white and one red. We select one ball, put it back in the box, and select a second ball (sampling with replacement). Find the probability of the following events:

- Let
*F*= the event of getting the white ball twice. - Let
*G*= the event of getting two balls of different colors. - Let
*H*= the event of getting white on the first pick. - Are
*F*and*G*mutually exclusive? - Are
*G*and*H*mutually exclusive?

### Example 3.8

Roll one fair, six-sided die. The sample space is {1, 2, 3, 4, 5, 6}. Let event *A* = a face is odd. Then *A* = {1, 3, 5}. Let event *B* = a face is even. Then *B* = {2, 4, 6}.

- Find the complement of
*A*,*A′*. The complement of*A*,*A′*, is*B*because*A*and*B*together make up the sample space.*P*(*A*) +*P*(*B*) =*P*(*A*) +*P*(*A′*) = 1. Also,*P*(*A*) = $\frac{3}{6}$ and*P*(*B*) = $\frac{3}{6}$. - Let event
*C*= odd faces larger than two. Then*C*= {3, 5}. Let event*D*= all even faces smaller than five. Then*D*= {2, 4}. $P(C\cap D)=0$ because you cannot have an odd and even face at the same time. Therefore,*C*and*D*are mutually exclusive events. - Let event
*E*= all faces less than five.*E*= {1, 2, 3, 4}.

Are *C* and *E* mutually exclusive events? (Answer yes or no.) Why or why not?

No. *C* = {3, 5} and *E* = {1, 2, 3, 4}. $P(C\cap E)=\frac{1}{6}$. To be mutually exclusive, $P(C\cap E)$ must be zero.

- Find $P\left(C\right|A)$. This is a conditional probability. Recall that the event
*C*is {3, 5} and event*A*is {1, 3, 5}. To find $P\left(C\right|A)$, find the probability of*C*using the sample space*A*. You have reduced the sample space from the original sample space {1, 2, 3, 4, 5, 6} to {1, 3, 5}. So, $P\left(C\right|A)=\frac{2}{3}$.

Let event *A* = learning Spanish. Let event *B* = learning German. Then $A\cap B=$ learning Spanish and German. Suppose $P\left(A\right)=0.4$ and $P\left(B\right)=0.2$. $P(A\cap B)=0.08$. Are events *A* and *B* independent? Hint: You must show ONE of the following:

- $P\left(A\right|B)=P(A)$
- $P\left(B\right|A)=P(B)$
- $P(A\cap B)=P\left(A\right)P\left(B\right)$

### Example 3.9

Let event *G* = taking a math class. Let event *H* = taking a science class. Then, G $\cap $ H = taking a math class and a science class. Suppose
$P\left(G\right)=0.6,P\left(H\right)=0.5$, and $P(G\cap H)=0.3.$
Are *G* and *H* independent?

If *G* and *H* are independent, then you must show **ONE** of the following:

- $P\left(G\right|H)=P(G)$
- $P\left(H\right|G)=P(H)$
- $P(G\cap H)=P\left(G\right)P\left(H\right)$

### NOTE

**The choice you make depends on the information you have.** You could choose any of the methods here because you have the necessary information.

a. Show that $P\left(G\right|H)=P(G)$.

$P\left(G\right|H)=\frac{P\text{(}G\cap H\text{)}}{P\text{(}H\text{)}}=\frac{\text{0}\text{.3}}{\text{0}\text{.5}}=0.6=P(G)$

b. Show $P(G\cap H)=P\left(G\right)P\left(H\right)$.

$P\left(G\right)P\left(H\right)=\left(0.6\right)\mathrm{(}0.5)=0.3=P(G\cap H)$

Since *G* and *H* are independent, knowing that a person is taking a science class does not change the chance that he or she is taking a math class. If the two events had not been independent (that is, they are dependent) then knowing that a person is taking a science class would change the chance he or she is taking math. For practice, show that $P\left(H\right|G)=P(H)$ to show that *G* and *H* are independent events.

In a bag, there are six red marbles and four green marbles. The red marbles are marked with the numbers 1, 2, 3, 4, 5, and 6. The green marbles are marked with the numbers 1, 2, 3, and 4.

*R*= a red marble*G*= a green marble*O*= an odd-numbered marble- The sample space is
*S*= {*R*1,*R*2,*R*3,*R*4,*R*5,*R*6,*G*1,*G*2,*G*3,*G*4}.

*S* has ten outcomes. What is $P(G\cap O)$?

### Example 3.10

Let event *C* = taking an English class. Let event *D* = taking a speech class.

Suppose $P\left(C\right)=0.75$, $P\left(D\right)=0.3$, $P\left(C\right|D)=0.75$ and $P(C\cap D)=0.225$.

Justify your answers to the following questions numerically.

- Are
*C*and*D*independent? - Are
*C*and*D*mutually exclusive? - What is $P\left(D\right|C)$?

- Yes, because $P\left(C\right|D)=P(C)$.
- No, because $P(C\cap D)$ is not equal to zero.
- $P\left(D\right|C)=\frac{P\text{(}C\cap D\text{)}}{P\text{(}C\text{)}}=\frac{\text{0}\text{.225}}{0.75}=0.3$

A student goes to the library. Let events *B* = the student checks out a book and *D* = the student checks out a DVD. Suppose that $P\left(B\right)=0.40$, $P\left(D\right)=0.30$ and $P(B\cap D)=0.20$.

- Find $P\left(B\right|D)$.
- Find $P\left(D\right|B)$.
- Are
*B*and*D*independent? - Are
*B*and*D*mutually exclusive?

### Example 3.11

In a box there are three red cards and five blue cards. The red cards are marked with the numbers 1, 2, and 3, and the blue cards are marked with the numbers 1, 2, 3, 4, and 5. The cards are well-shuffled. You reach into the box (you cannot see into it) and draw one card.

Let *R* = red card is drawn, *B* = blue card is drawn, *E* = even-numbered card is drawn.

The sample space *S* = *R*1, *R*2, *R*3, *B*1, *B*2, *B*3, *B*4, *B*5. *S* has eight outcomes.

- $P\left(R\right)=\frac{3}{8}.P\left(B\right)=\frac{5}{8}.P(R\cap B)=0$. (You cannot draw one card that is both red and blue.)
- $P\left(E\right)=\frac{3}{8}$. (There are three even-numbered cards,
*R*2,*B*2, and*B*4.) - $P(E|B)=\frac{2}{5}$. (There are five blue cards:
*B*1,*B*2,*B*3,*B*4, and*B*5. Out of the blue cards, there are two even cards;*B*2 and*B*4.) - $P(B|E)=\frac{2}{3}$. (There are three even-numbered cards:
*R*2,*B*2, and*B*4. Out of the even-numbered cards, to are blue;*B*2 and*B*4.) - The events
*R*and*B*are mutually exclusive because $P(R\cap B)=0$. - Let
*G*= card with a number greater than 3.*G*= {*B*4,*B*5}. $P\left(G\right)=\frac{2}{8}$. Let*H*= blue card numbered between one and four, inclusive.*H*= {*B*1,*B*2,*B*3,*B*4}. $P(G|H)=\frac{1}{4}$. (The only card in*H*that has a number greater than three is*B*4.) Since $\frac{2}{8}$ = $\frac{1}{4}$, $P\left(G\right)=P\left(G\right|H)$, which means that*G*and*H*are independent.

In a basketball arena,

- 70% of the fans are rooting for the home team.
- 25% of the fans are wearing blue.
- 20% of the fans are wearing blue and are rooting for the away team.
- Of the fans rooting for the away team, 67% are wearing blue.

Let *A* be the event that a fan is rooting for the away team.

Let *B* be the event that a fan is wearing blue.

Are the events of rooting for the away team and wearing blue independent? Are they mutually exclusive?

### Example 3.12

In a particular college class, 60% of the students are female. Fifty percent of all students in the class have long hair. Forty-five percent of the students are female and have long hair. Of the female students, 75% have long hair. Let *F* be the event that a student is female. Let *L* be the event that a student has long hair. One student is picked randomly. Are the events of being female and having long hair independent?

- The following probabilities are given in this example:
- $P\left(F\right)\mathrm{=}0.60;P\left(L\right)\mathrm{=}0.50$
- $P(F\cap L)=0.45$
- $P\left(L\right|F)=0.75$

### NOTE

**The choice you make depends on the information you have.** You could use the first or last condition on the list for this example. You do not know *P*(*F*|*L*) yet, so you cannot use the second condition.

Solution 1Check whether $P(F\cap L)=P\left(F\right)P\left(L\right)$. We are given that $P(F\cap L)=0.45$, but $P\left(F\right)P\left(L\right)=\left(0.60\right)\left(0.50\right)=0.30$. The events of being female and having long hair are not independent because $P(F\cap L)$ does not equal $P\left(F\right)P\left(L\right)$.

Solution 2Check whether $P\left(L\right|F)$ equals $P\left(L\right)$. We are given that $P\left(L\right|F)=0.75$, but $P\left(L\right)=0.50$; they are not equal. The events of being female and having long hair are not independent.

Interpretation of ResultsThe events of being female and having long hair are not independent; knowing that a student is female changes the probability that a student has long hair.

Mark is deciding which route to take to work. His choices are *I* = the Interstate and *F* = Fifth Street.

- $P\left(I\right)=0.44$ and $P\left(F\right)=0.56$
- $P(I\cap F)=0$ because Mark will take only one route to work.

What is the probability of $P(I\cup F)$?

### Example 3.13

- Toss one fair coin (the coin has two sides,
*H*and*T*). The outcomes are ________. Count the outcomes. There are ____ outcomes. - Toss one fair, six-sided die (the die has 1, 2, 3, 4, 5 or 6 dots on a side). The outcomes are ________________. Count the outcomes. There are ___ outcomes.
- Multiply the two numbers of outcomes. The answer is _______.
- If you flip one fair coin and follow it with the toss of one fair, six-sided die, the answer to c is the number of outcomes (size of the sample space). What are the outcomes? (Hint: Two of the outcomes are
*H*1 and*T*6.) - Event
*A*= heads (*H*) on the coin followed by an even number (2, 4, 6) on the die.*A*= {_________________}. Find*P*(*A*). - Event
*B*= heads on the coin followed by a three on the die.*B*= {________}. Find*P*(*B*). - Are
*A*and*B*mutually exclusive? (Hint: What is $P(A\cap B)$? If $P(A\cap B)=0$, then*A*and*B*are mutually exclusive.) - Are
*A*and*B*independent? (Hint: Is $P(A\cap B)=P\left(A\right)P\left(B\right)$? If $P(A\cap B)=P\left(A\right)P\left(B\right)$, then*A*and*B*are independent. If not, then they are dependent).

*H*and*T*; 2- 1, 2, 3, 4, 5, 6; 6
- 2(6) = 12
*T*1,*T*2,*T*3,*T*4,*T*5,*T*6,*H*1,*H*2,*H*3,*H*4,*H*5,*H*6*A*= {*H*2,*H*4,*H*6};*P*(*A*) = $\frac{\text{3}}{12}$*B*= {*H*3};*P*(*B*) = $\frac{\text{1}}{12}$- Yes, because $P(A\cap B)=0$
- $P(A\cap B)=0.\phantom{\rule{0.2ems}{0ex}}P\left(A\right)P\left(B\right)=(\frac{3}{12}).\phantom{\rule{0.2ems}{0ex}}P(A\cap B)\phantom{\rule{0.2ems}{0ex}}\text{does not equal}\phantom{\rule{0.2ems}{0ex}}P\left(A\right)P\left(B\right),\phantom{\rule{0.2ems}{0ex}}\text{so}\phantom{\rule{0.2ems}{0ex}}A\phantom{\rule{0.2ems}{0ex}}\text{and}\phantom{\rule{0.2ems}{0ex}}B\phantom{\rule{0.2ems}{0ex}}\text{are dependent.}$

A box has two balls, one white and one red. We select one ball, put it back in the box, and select a second ball (sampling with replacement). Let *T* be the event of getting the white ball twice, *F* the event of picking the white ball first, *S* the event of picking the white ball in the second drawing.

- Compute $P\left(T\right)$.
- Compute $P\left(T\right|F)$.
- Are
*T*and*F*independent?. - Are
*F*and*S*mutually exclusive? - Are
*F*and*S*independent?