Skip to main content

Section 1.7 Probability

Subsection 1.7.1 Probability terminology (Ch 13–15)

[Note: The symbols given in this section appear in Friedman’s text in a note on p.227 at the end of Exercise Set B.]
In a box model, an outcome is a sequence of tickets obtained by random draws, either with or without replacement. For example, here are the 12 possible outcomes for 2 draws, without replacement, from the box \(\{A,K,Q,J\}\text{.}\) (This is a box model for "two cards are dealt from a 4-card deck containing an ace, a king, a queen, and a jack".)
\begin{equation*} \text{set of all outcomes} = \{AK,AQ,AJ,KA,KQ,KJ,QA,QK,QJ,JA,JK,JQ\} \end{equation*}
In this notation, \(AK\) means the ace is drawn first, and the king second, while \(KA\) means the king is first and the ace is second.
An event is a set of outcomes. For example, the events "get a queen" and "get a king on the first draw" are
\begin{align*} \text{"get a queen"} \amp = \{QA,QK,QJ,AQ,KQ,JQ\}\\ \text{"get a king on draw 1"} \amp = \{KA,KQ,KJ\}. \end{align*}
Another example is the event "get the hand ace-king". In a "hand", it does not matter what order the cards are dealt in, so we have
\begin{equation*} \text{"get the hand ace-king"} = \{AK,KA\}. \end{equation*}
To say that two events \(E\) and \(F\) "both happen" can be rephrased "\(E \AND F\)". To say that "at least one of the events \(E,F\) happens" can be rephrased "\(E \OR F\)". For example, for the events
\begin{gather*} E = \text{"get an ace"} = \{AK,AQ,AJ,KA,QA,JA\}\\ F = \text{"get a king"} = \{KA,KQ,KJ,AK,QK,JK\} \end{gather*}
we have the following.
\begin{align*} E \AND F \amp = \text{"get a hand with an ace and a king"} = \{AK,KA\}\\ E \OR F \amp = \text{"get a hand with an ace or a king (or both)"}\\ \amp = \{AK,AQ,AJ,KA,QA,JA,KQ,KJ,QK,JK\} \end{align*}
[Comment for students who know about intersection and union of sets: the event "\(E \AND F\) " is the same thing as the intersection of the sets \(E,F\text{,}\) and the event "\(E \OR F\) " is the same thing as the union of the sets \(E,F\text{.}\)]
We will use the correct terms "outcome" and "event" instead of the vague term "thing" used in the text in Ch 13.
We will write \(P(E)\) to denote the probability for an event \(E\text{.}\) For example, in the game of 2 draws, with replacement, from the box \(\{A,K,Q,J\}\text{,}\) the probability of the single outcome \(AK\) is
\begin{equation*} P(AK) = 1/12 \approx 8.3\% \end{equation*}
because there are 12 equally likely outcomes for the 2 draws. The probability for getting the hand ace-king is
\begin{equation*} P(\text{get the hand ace-king}) = 2/12 \approx 16.7\% \end{equation*}
because there are 2 equally likely outcomes in the event "get the hand ace-king", and there are 12 equally likely outcomes in all for the 2 draws. The probability of getting a queen is
\begin{equation*} P(\text{get a queen}) = 6/12 = 50\% \end{equation*}
because there are 6 equally likely outcomes in the event "get a queen". The probability of getting king on the first draw is
\begin{equation*} P(\text{get a king on draw 1}) = 3/12 = 25\% \end{equation*}
because there are 3 equally likely outcomes in the event "get a king on draw 1".
The textbook does not give a definition of the term conditional probability; instead, they explain by example in Ch 13 Sec. 2 (p.226). Here is the definition: The conditional probability of event \(E\) given that event \(F\) has happened, denoted \(P(E|F)\text{,}\) is
\begin{equation} P(E|F) = \frac{P(E \AND F)}{P(F)}\tag{1.7.1} \end{equation}
where the event "\(E \AND F\)" is the set of all outcomes that belong to both events \(E\) and \(F\text{.}\) For example, in 2 draws with replacement from the box \(\{A,K,Q,J\}\text{,}\) we have
\begin{equation*} P(\text{get a queen | get a king on draw 1}) = 1/3 \approx 33.3\% \end{equation*}
because there is 1 outcome, namely \(KQ\text{,}\) that has a \(Q\text{,}\) among the 3 outcomes that have \(K\) on draw 1. We also have
\begin{equation*} P(\text{get a king on draw 1 | get a queen}) = 1/6 \approx 16.7\% \end{equation*}
because there is 1 outcome, namely \(KQ\text{,}\) for which draw 1 is a \(K\text{,}\) among the 6 outcomes that have a \(Q\text{.}\)
The definitions of independent and dependent events (box on p.230) should be replaced by the following: "Two events \(E,F\) are independent if \(P(F|E) = P(F)\text{.}\) Otherwise, the events \(E,F\) are dependent." Or in words, "Two events \(E,F\) are independent if the probability of \(F\) given that \(E\) has happened is equal to the probability of \(F\text{.}\) Otherwise, the events \(E,F\) are dependent."

Subsection 1.7.2 Probability Practice Problems

Exercises Exercises

Problems 1 and 2 are about the following situation: A box contains seven tickets, labeled \(a,b,c,d,e,f,g\text{.}\) In Game 1, tickets are drawn from the box with replacement. In Game 2, tickets are drawn without replacement. On any given draw, every ticket remaining in the box is equally likely to be selected on the next draw. Consider the following events.
\begin{align*} E \amp= \text{get the ticket } a \text{ on draw 1}\\ F \amp= \text{get the ticket } b \text{ on draw 2}\\ G \amp= \text{get two vowels in the first two draws}\\ H \amp= \text{get exactly two vowels in the first seven draws} \end{align*}
1.
Find the probabilities in the table below. Give your answer as a percent, correct to the nearest \(0.01\) (that is, rounded to the two decimal places). Two entries have been filled in as examples.
\begin{align*} \amp\spacer\amp \amp\spacer\amp \text{Game 1} \amp\spacer\amp \text{Game 2} \\ \amp \amp \amp \amp \rule{.6in}{.1ex} \amp \amp \rule{.6in}{.1ex}\\ (i) \text{ (Ch 13)} \amp\spacer\amp P(E) \amp\spacer\amp \amp\spacer\amp\\ (ii) \text{ (Ch 13)} \amp\spacer\amp P(F) \amp\spacer\amp \amp\spacer\amp\\ (iii) \text{ (Ch 13)} \amp\spacer\amp P(G) \amp\spacer\amp \amp\spacer\amp\\ (iv) \text{ (Ch 13)} \amp\spacer\amp P(F|E) \amp\spacer\amp 1/7 = 14.29\% \amp\spacer\amp 1/6 = 16.67\%\\ (v) \text{ (Ch 13)} \amp\spacer\amp P(E|F) \amp\spacer\amp \amp\spacer\amp \\ (vi) \text{ (Ch 13)} \amp\spacer\amp P(E \AND F) \amp\spacer\amp \amp\spacer\amp\\ (vii) \text{ (Ch 14)} \amp\spacer\amp P(F \OR G) \amp\spacer\amp \amp\spacer\amp\\ (viii) \text{ (Ch 15)} \amp\spacer\amp P(H) \amp\spacer\amp \amp\spacer\amp \end{align*}
Answer.
\begin{align*} \amp\spacer\amp \text{Game 1} \amp\spacer\amp \text{Game 2} \\ \amp \amp \rule{.6in}{.1ex} \amp \amp \rule{.6in}{.1ex}\\ P(E) \amp\spacer\amp 1/7 = 14.29\% \amp\spacer\amp 1/7 = 14.29\%\\ P(F) \amp\spacer\amp 1/7 = 14.29\% \amp\spacer\amp 1/7 = 14.29\%\\ P(G) \amp\spacer\amp (2/7)^2 = 8.16\% \amp\spacer\amp (2/7)\cdot (1/6) = 4.76\%\\ P(F|E) \amp\spacer\amp 1/7 = 14.29\% \amp\spacer\amp 1/6 = 16.67\%\\ P(E|F) \amp\spacer\amp 1/7 = 14.29\% \amp\spacer\amp 1/6 = 16.67\%\\ P(E \AND F) \amp\spacer\amp (1/7)^2 = 2.04\% \amp\spacer\amp (1/7)\cdot (1/6) = 2.38\%\\ P(F \OR G) \amp\spacer\amp (1/7) + (2/7)^2 = 22.45\% \amp\spacer\amp (1/7) + (2/7)\cdot (1/6) = 19.05\%\\ P(H) \amp\spacer\amp {7 \choose 2} (2/7)^2 (5/7)^5 = 31.87\% \amp\spacer\amp 100.00\% \end{align*}
2.
Use the definitions of independent and dependent events given in Subsection 1.7.1 to answer the following questions.
  1. (Ch 13) Are events \(E,F\) independent or dependent in Game 1? In Game 2? Explain.
  2. (Ch 13) Are events \(E,G\) independent or dependent in Game 1? In Game 2? Explain.
  3. (Ch 15) Are events \(G,H\) independent or dependent in Game 1? In Game 2? Explain.
Answer.
  1. In Game 1, we have \(P(F)=1/7=P(F|E)\text{,}\) so \(E,F\) are independent. In Game 2, we have \(P(F)=1/7\neq 1/6=P(F|E)\text{,}\) so \(E,F\) are dependent.
  2. In Game 1, we have \(P(G)=4/49\text{,}\) while \(P(G|E)=2/7\text{.}\) Since \(P(G)\neq P(G|E)\text{,}\) we conclude that \(E,G\) are dependent in Game 1. In Game 2, we have \(P(G)=2/42\text{,}\) while \(P(G|E)=1/6\text{.}\) Since \(P(G)\neq P(G|E)\text{,}\) we conclude that \(E,G\) are dependent in Game 2.
  3. In Game 1, we have \(P(H)={7\choose 2} (2/7)^2 (5/7)^5\approx 31.87\%\text{,}\) while
    \begin{align*} P(H|G) \amp = P(\text{get non-vowels on draws 3,4,5,6, and 7})\\ \amp = (5/7)^5 \approx 18.59\%. \end{align*}
    Since \(P(H)\neq P(H|G)\)
     1 
    Another way to think about \(P(H|G)\) is to use the definition (1.7.1) of conditional probability. We have
    \begin{align*} P(H|G)\amp =\frac{P(H \AND G)}{P(G)}\\ \amp = \frac{P(\text{two vowels in 1st 2 draws} \AND \text{no vowels in last 5 draws})}{P(G)}\\ \amp = \frac{(2/7)^2(5/7)^5}{(2/7)^2}\\ \amp (5/7)^5. \end{align*}
    , we conclude that \(G,H\) are dependent in Game 1. In Game 2, we have \(P(H)=100\% =P(H|G)\text{.}\) We conclude that \(G,H\) are independent in Game 2.