Skip to the content

Topics Covered

Definition PMF Mean & Variance Recurrence Relation Limit to Binomial Sampling without replacement
On this page
  1. 1. Definition & PMF
  2. 2. Mean and Variance
  3. 3. Worked Examples
  4. 4. Recurrence Relation for Probabilities
  5. 5. Limiting Case: Hypergeometric → Binomial
  6. Key Take-aways from Unit 5

1. Definition & PMF

DEFINITION

Suppose a finite population of size \(N\) contains \(M\) items of type "success" and \(N - M\) of type "failure". A random sample of size \(n\) is drawn without replacement. Let \(X\) be the number of successes in the sample. Then \(X\) follows a Hypergeometric distribution with parameters \(N, M, n\):

\[ P(X = x) \;=\; \dfrac{\binom{M}{x}\binom{N - M}{n - x}}{\binom{N}{n}}, \]

for \(\max(0,\, n - (N-M)) \le x \le \min(n, M)\).

Compare with Binomial: Binomial samples with replacement (independent trials); Hypergeometric samples without replacement (dependent trials).

Validity: \(\sum_{x} \binom{M}{x}\binom{N-M}{n-x} = \binom{N}{n}\) (Vandermonde identity), so the PMF sums to 1.

2. Mean and Variance

\[ E(X) \;=\; n \cdot \dfrac{M}{N} \;=\; np, \qquad \text{Var}(X) \;=\; n \cdot \dfrac{M}{N} \cdot \dfrac{N-M}{N} \cdot \dfrac{N-n}{N-1} \;=\; npq \cdot \dfrac{N-n}{N-1}, \]

where \(p = M/N\) and \(q = 1 - p\).

The factor \(\dfrac{N-n}{N-1}\) is called the finite population correction (FPC). It reduces the variance below the binomial value when sampling without replacement.

Hypergeometric(20, 8, 6), Var = 1.06 Binomial(6, 0.4), Var = 1.44 0 1 2 3 4 5 6 Same mean (2.4), but the hypergeometric is more concentrated
Fig 5.1 — Sampling without replacement (hypergeometric, blue) gives the same mean as sampling with replacement (binomial, amber) but a smaller variance — the FPC factor \((N-n)/(N-1) = 14/19 \approx 0.74\) here. As \(N\) grows the two distributions coincide.

Sketch of mean derivation: Express \(X = \sum_{i=1}^{n} I_i\) where \(I_i = 1\) if the \(i\)-th item drawn is a success. By symmetry \(E(I_i) = M/N\), so \(E(X) = n M/N\).

3. Worked Examples

EXAMPLE 1 (Quality control)

A box contains 20 items of which 5 are defective. A random sample of 4 is drawn without replacement. Find the probability that exactly 2 are defective.

\(N = 20, M = 5, n = 4, x = 2\).

\(P(X = 2) = \dfrac{\binom{5}{2}\binom{15}{2}}{\binom{20}{4}} = \dfrac{10 \times 105}{4845} = \dfrac{1050}{4845} = 0.2167\).

EXAMPLE 2 (Mean & Variance)

From a deck of 52 cards, 5 cards are drawn without replacement. Find the expected number of aces and the variance.

\(N = 52, M = 4, n = 5\). Mean = \(5 \times 4/52 = 20/52 = 0.385\).

\(p = 4/52, q = 48/52\). Variance = \(5(0.077)(0.923)(47/51) \approx 0.327\).

4. Recurrence Relation for Probabilities

\[ P(X = x + 1) \;=\; \dfrac{(M - x)(n - x)}{(x + 1)(N - M - n + x + 1)} \cdot P(X = x). \]

Useful for computing successive probabilities without repeated factorial evaluation.

EXAMPLE 1

For \(N = 20, M = 5, n = 4\): \(P(X = 0) = \binom{15}{4}/\binom{20}{4} = 1365/4845 = 0.2817\).

\(P(X = 1) = \dfrac{(5)(4)}{(1)(12)} \cdot 0.2817 = \dfrac{20}{12} \times 0.2817 = 0.4696\).

\(P(X = 2) = \dfrac{(4)(3)}{(2)(13)} \times 0.4696 = \dfrac{12}{26} \times 0.4696 = 0.2167\) ✓ (matches direct).

EXAMPLE 2

Continuing: \(P(X = 3) = \dfrac{(3)(2)}{(3)(14)} \times 0.2167 = \dfrac{6}{42} \times 0.2167 = 0.0310\).

\(P(X = 4) = \dfrac{(2)(1)}{(4)(15)} \times 0.0310 = \dfrac{2}{60} \times 0.0310 = 0.00103\).

Sum = 0.2817 + 0.4696 + 0.2167 + 0.0310 + 0.00103 ≈ 1.000 ✓.

5. Limiting Case: Hypergeometric → Binomial

THEOREM

If \(N \to \infty\) and \(M \to \infty\) such that \(M/N \to p\) (a constant), with \(n\) fixed, then

\[ \dfrac{\binom{M}{x}\binom{N-M}{n-x}}{\binom{N}{n}} \;\to\; \binom{n}{x} p^x q^{n-x}. \]

So the Hypergeometric approaches the Binomial when the population is much larger than the sample.

Practical rule: If \(n/N < 0.05\) (sample less than 5% of population), Binomial is a good approximation to Hypergeometric.

The variance reflects this: \(\dfrac{N-n}{N-1} \to 1\) as \(N \to \infty\), so Hypergeometric variance \(\to\) Binomial variance \(npq\).

Key Take-aways from Unit 5