• Significance tests and confidence intervals for the difference between the means μ1 and μ2 of two Normal populations are based on the difference ˉx1−ˉx2 between the sample means from two independent SRSs. Because of the central limit theorem, the resulting procedures are approximately correct for other population distributions when the sample sizes are large.
• When independent SRSs of sizes n1 and n2 are drawn from two Normal populations with parameters μ1, σ1 and μ2, σ2 the two-sample z statistic
z=(ˉx1−ˉx2)−(μ1−μ2)√σ21n1+σ22n2
has the N(0, 1) distribution.
• The two-sample t statistic
t=(ˉx1−ˉx2)−(μ1−μ2)√s21n1+s22n2
does not have a t distribution. However, good approximations are available.
• Conservative inference procedures for comparing μ1 and μ2 are obtained from the two-sample t statistic by using the t(k) distribution with degrees of freedom k equal to the smaller of n1−1 and n2−1.
• More accurate probability values can be obtained by estimating the degrees of freedom from the data. This is the usual procedure for statistical software.
• An approximate level C confidence interval for μ1−μ2 is given by
(ˉx1-ˉx2)±t*√s21n1+s22n2
Here, t* is the value for the t(k) density curve with area C between −t* and t*, where k is computed from the data by software or is the smaller of n1−1 and n2−1. The quantity
t*√s21n1+s22n2
is the margin of error.
• Significance tests for H0:μ1−μ2=Δ0 use the two-sample t statistic
t=(ˉx1−ˉx2)−Δ0√s21n1+s22n2
The P-value is approximated using the t(k) distribution where k is estimated from the data using software or is the smaller of n1−1 and n2−1.
• The guidelines for practical use of two-sample t procedures are similar to those for one-sample t procedures. Equal sample sizes are recommended.
• If we can assume that the two populations have equal variances, pooled two-sample t procedures can be used. These are based on the pooled estimator
s2p=(n1−1)s21+(n2−1)s22n1+n2−2
of the unknown common variance and the t(n1+n2−2) distribution. We do not recommend this procedure for regular use.