EXAMPLE 5 A Gallup Poll
A 2015 Gallup Poll on vaccinations asked the question, “From what you have heard or read, do you personally think certain vaccines do—or do not—cause autism in children, or are you unsure?” Gallup reported that the poll found that 52% of respondents were unsure. Is it actually the case that a majority of Americans are unsure about whether certain vaccines cause autism in children? Ask first how Gallup selected its sample. Later in the article we read this: “Results for this Gallup poll are based on telephone interviews conducted Feb. 28–March 1, 2015, on the Gallup U.S. Daily survey, with a random sample of 1,015 adults, aged 18 and older, living in all 50 U.S. states and the District of Columbia.” Gallup goes on to clarify that the sample included equal proportions of landline and cellular phone numbers selected using random-digit dialing.
31
This is a good start toward gaining our confidence. Gallup tells us what population it has in mind (people at least 18 years old living in the continental United States). We know that the sample from this population was of size 1015 and, most important, that it was chosen at random. There is more to consider in assessing a poll, and we will soon discuss this, but we have at least heard the comforting words “random sample.”