Chapter 1. Statistical Power

Introduction

Statistical Applets

To set up the test, enter your information: What null hypothesis H0 about the mean μ do you want to test? Is your alternative hypothesis one-sided high, one-sided low, or two-sided? What level of significance α do you require? How many observations do you have (50 or fewer)? What is the known value of the standard deviation σ? Finally, against what specific alternative value of the mean μ do you want to find the power? When you have entered your information, click UPDATE.

Click the "Quiz Me" button to complete the activity.

This applet illustrates the power of statistical tests. Finding the power of a test assumes that you have set a fixed significance level α for the test. Review the "Statistical Significance" applet to recall how tests with significance level α work.

The top curve shows the sampling distribution of the sample mean when your null hypothesis is true. The yellow area under this curve is α, the probability of rejecting H0 when it is really true. The bottom curve shows the sampling distribution of when your chosen alternative is true. The red area under this curve is the power, the probability of rejecting H0 when the alternative is really true.

Question 1.1

Suppose you're planning to collect a set of data in an experiment where you expect the original population mean to be 10, with a standard deviation of 3. Your initial plan is to collect 20 observations, and you expect your experimental manipulation to increase the mean of your observations by 1. You plan to test with an alpha = .05 level of significance, using a two-tailed test (that is, testing whether μ ≠ 10). Enter the following values that you should enter in the applet to calculate the power for this situation:

  • H0: μ = Pz2PEfhsNWI=
  • alt. μ = cVy0Xs6Cud4=
3
Try again.
Incorrect. See above for the correct answers.
Great job.

Question 1.2

6xOJssOU45S0Ez97VhKeoxM/CA+hvsGnTLpUYlc5YihyHnSDsJIynp3RwZUG8kypfhOPFcBV7yJBTOdmDMJhdXtrjNKWt4CcGkrDQ6KAIOKrLhakAMU69WGxir38nVRQBIBON9DXFsAXucFJoO5MajTEIfBOJUMxfRE+Tr2JuQwysTpZ124+JZAor0CkWZnrjPsd0ZMILQDd84qovMaf/tj+vzZUyD2U
2
Correct.
Try again.
Incorrect.

Question 1.3

XO2Yo6u9rY2nrSZIAitHnBx44JLykPXI8rIFePSlznKsy8SGnW7GY8BfmY2acWfjf5s+iHttqvH7LvK1Ao3t17XaGXN3d9G/bK0heSKG0k1WGt+d+a4hBdRLHXTCBZ30WhLCKal9XdhqR2JiY4xCDpmcSTrNwIVLS+jecVeH/dvP2x19forRIaYZXQjEKg328ZZmptgDpljNrC4x9HaZSOKTn+dfwWINaMe3ITXYP9pKg4VMMy5KbUnw0gOOyMLtYJxHOwA/uN2nWFYI49qGMycBC0MjnOrRnf0/J7aGw05/wYFI/nty0u4dvyNUUmw1u9UXwMgRUOzqwYGGuSEm4eEiSPKu1AeDb3J/zeW1VEbvzwYpg2kg5iNuOTwO/FLYPmuEXxqeiF3nGySpJP0mqV556/dHfcfOqxWUPqBUvccBoK116ofJjPeODJmYzlZ/4Apw/izkymCTJYH+pyhpAgYOTtUlZiThYc1BNo6rFy9O4hSb7dkfEeUCmAkQbksy4wCmk26GBojrRJ67
2
Correct.
Try again.
Incorrect.

Question 1.4

2Home5qrpdc3sbv0ZWso65Rj/G4k2zx6uoLXrGKrtQxH4coVKJO8AFi5SWtN3UVKEraC5rLGyra14oaBEM1DPjZrPQVBuExhsrtQrBF17y3K4sW3H8vCLvKhjOX+xLBMVE8cOX2yVWT1uTs+Hcvy80cO2OnlmSU2KGshp0qHgqP+YTtb
3
Correct.
Keep adjusting the value for n over and over again (clicking UPDATE if necessary after each change) until you find that the Power estimate is just over .90. The value you have for n at this point is the answer to the question.
Incorrect.

Question 1.5

pjsKKwSP3/Y77FOGHcmdP5Ci9VFhVLCQXudn4Ol7azFUiOFfy+F/5pJqfKR61CoAWIwixJCqQ/l2bBzZhN98Qc+AYFrPiVXkxwHY2OdkBYDIQzECKAFizlJYVQh66LZTINiG/i6ueFv4hOSu9NMbaB0ZeYxUHJQAnk0476AUxdhKL9rhL1wDFRVXx+c4dREcWrfPTN22RZHXKrF2jnCqkJn8oONvmAel76jG3SJOuS3E+JfqSWspqXUYNCDV1VEI7JWCFaVYG4h2QrUzVzgKK9SkWckAtfFOFwTXSA==
Increasing alpha is, technically, another way to increase power. Indeed, this is the most direct way to increase the probability that an observed sample mean will fall in the "rejection region" for your hypothesis test, since increasing alpha directly expands this rejection region. However, many areas of study have accepted standards for the alpha level to use when evaluating null hypotheses (e.g. the .05 level is ubiquitous in behavioral science research), so practically speaking this is usually not an option.