Chapter 4. The Psychologist’s Building Blocks for Better Design

Introduction

Chapter 4
true
true
You must read each slide, and complete any questions on the slide, in sequence.
Self Report Measure
A measure that involves directly asking participants to express how they feel or what they think about a particular topic.
Behavioral Measure
A measure that assesses the actions a person took, how the person responds to a request, the person’s decisions, or simply what some researchers call “actual behavior.”
Behavioral Trace
A measure that uses evidence left behind by a person who is no longer present to determine a behavior occurred.
Behavioral Observation
A measure that relies on directly seeing or observing behavior as it occurs.
Behavioral Choice
A measure that assesses individual’s selection among a variety of options.
Raw Score
The score that a measure provides that is the combination of the true score and error.
True Score
The part of the raw score that is an accurate depiction of your actual ability, or what your score would be on a perfect test, free of extraneous factors.
Error
The part of the raw score that represents those extraneous influences that will cause the raw score to deviate (up or down) from the true score.
Random Error
Measurement error that is variation from one’s true score due to unsystematic or chance factors that occurs in a haphazard, disorganized, or arbitrary way.
Bias or Systematic Error
Measurement error that varies systematically or consistently pushes scores higher or lower in a way that leads to inaccurate or misleading conclusions.
Standardization
keeping the experimental situation the same for everyone
sensitivity
the range of data a researcher can gather from a particular instrument
Reliability
the stability or consistency of a measure
Validity
the degree to which a tool measures what it claims to measure
Random Sampling
selecting participants using an unpredictable method that give everyone an equal chance of selection in order to avoid potential bias
Convenience Sampling
non-randomly recruiting participants from a known, readily available population
Nonresponse Bias
those who do not respond to a survey may differ in meaningful ways related to the research question from those who do.
Volunteer Subject Problem
those who self-select or chose to be in a study may differ in some meaningful way related to the research question from those who make the choice to not participate
College Sophomore Problem
using a sample that relies on college students from a participant pool who may not adequate represent other populations as they tend to be all around the same age
Demand Characteristics
cues that make participants potentially aware of what the experimenter expects.
Social Desirability Concerns
the tendency for respondents to give answers that make them look good.

Got Swagger?
Evaluating the Swagger-Meter

Online Activity
Chapter 4: The Psychologist’s Building Blocks for Better Design

Something to Think About

Scenario: The mall is a popular place for the 16-25 year-old demographic. Companies know this and continually seek to develop new products that target this key segment of the market. In fact, a new company named YOLO Incorporated has designed a product that, according to their website and press release, “provides user-specific, science-based insights into a key aspect of young adults’ personality.” In addition, “the Swagger-Meter uniquely capitalizes on people’s desire for self-knowledge and data-based social comparison information.” Specifically, YOLO Inc. wants to place their new product the “Swagger-Meter 1.0™” in mall food courts throughout the United States.

Your job is to determine whether you should invest your money in this company.

Something to Think About (continued)

If you are thinking like a scientist, you are probably a bit skeptical about the “Swagger-Meter 1.0™.” To decide whether this product will be successful and ultimately worth investing your money in, you need to determine whether the “Swagger Meter 1.0™” is a quality measure.

Something to Think About (continued)

Before you can know whether something is a good measure, you first need to know exactly what it aims to measure. That is, you need to clearly define key concepts with an operational definition that describes exactly what a variable means.

Question 4.1

FJVOFl5kT77r14x5mZD0GrZNsOOO5Wv109UQ9coGwV1HG8mg7xyuqOFb/8STJCefd1T3mHBjho+5vPdW6hxJMlKJia9ssgZj6qWlqF+k1mN+5/nkSxOq7RQ+JZvJ+0FYNNMlnPQvb70Kw38yi0mWFJkuW1fWkKXBn50QrjADl1sl5cUFETDTDJWyPYkretYD/zIz3X8Da8WmaGmxD9/nIVoxLoTGwOU4wPwkic8puLH+fDjk20StROCixT+pL2Zk+PYabaqx2bgGLiJI4Lr4FKjoplHQE/Acmc4rSKQ1+Up4c8cc/lLq/19N1lwtK1MQaX1m8WD6+L49SZoE+eDpZrqTXp5/+fJmLwqFMwwTid55ltguf+qu0MssP9IQoxiR7zcTwXMvhrdyaQX0SSZhO3FjFiDocu1ubuX/g0B6XrYiAnG6H2X6f9njS5rzFKtmR6coKITtF9jJ4a82WdwlIKZZDITRJFm9YF4BikF6qYoHgdeLhDF17jWA8eWHXXK41biFtRBTAFPgQMJRT8IEhWzzJELC28SsWSivvE+aMq7NkYhCkol7uiMM1uUYwi9voXPTPIZa/pd0E6Ge7DyaXoZF6O+cnPhyJwp8zuaAHgCMSN3ix7QlQjMOD97fHKBG+KTeive2gd21PLg1gQAndLQOXN5Tt1lfEdPw6wfOse2pGjbR1C2TaIVEIOFAtuqazR4GkSWSvoJz5zNPGZ5LxsTfhTjoCYGs14+9vAaij0dhLmfGMvDyIcQChPTMiFLeOwpsswI6xAG4MfWxDxzGFYEUuGfvAqf59JCc1Q3L+VNuEF4GcKIfK48oMlsgRHCr
3
Correct.
Try again.
Incorrect.

Something to Think About (continued)

According to the YOLO Inc. press release, “Swagger is a mental state of being in which a person exudes a high level of confidence and composure. Swagger can border on arrogance, but is more about a sense of positive self-assuredness that makes the person charismatic and admired.”

Now that you know how YOLO Inc. is defining what is meant by “swagger,” the next question is to understand how they are actually measuring “swagger.” Yolo Inc. is doing this by having individuals place their right hand on a mental plate. This plate measures their skin conductance and indicates the corresponding degree of swagger. This is what the “Swagger Meter 1.0™” looks like:

Swagger Meter 1.0™

Our Question

Now that you know what the “Swagger Meter 1.0™” looks like, and what it claims to measure, you can begin to answer two questions:

  1. Is the “Swagger Meter 1.0™” a quality measure?
  2. Should you invest your money in this company and product?

Picking the Best Measurement

Before you can know whether something is a good measure, you first need to know exactly what it aims to measure. That is, you need to clearly define key concepts with an operational definition that describes exactly what a variable means.

Let’s start by evaluating the nature of the “Swagger Meter 1.0™” measurements.

  • Self Report Measure
  • Behavioral Measure

Question 4.2

sd1/IRtEITvkclNlVOWQAvnIZlQTYW83SfO3tRF7xXZRpQd+WwBA+sX5blOxFyMCB5g+7yrNvPVx9N/wQQjfqvOK7/6M51S0LkASiCfGOb5ej9s4mT2yZpdXQX+ErwOUfG4rBP4GEHmAEjt8Krs68WQr2GXlH0fe1XI90HtOO9pEsDbmXfV+t0xLHmvxmm3p7SDnhV5jaVpOWN6QcyeSCeJCS+kreJSACX5HKKeXNaAISdHyl0jZLNlQo2hWPEurhmQqFLoof4sMJMgojD3vGSCFsD1M8K0aqi+BKNFkgTX661mcuzzlnyMbccP0Vblic8yIPUm69u7o5ARd8/zDfkfNYor+AHf98a5p4BAkC/Fh5EDBf/wrjpij196+/BSrAefySr5FuOUhjMxDxxOWw8mtceTkug/fpSj5MoLgsByvS1JB/y4zq8qI7m8J/ZioCPn0lE/BveBUgBdRS3Cappfn9gAg0R6Rxngjmgmx3vjLQZJL/RZSjw==
3
Correct.
Try again.
Incorrect.

Picking the Best Measurement

Question 4.3

rYCYPDGSxFbsQIuV+t2rER1h3P/Ra4FgWlw+xBjbUNaQWuzgcenllb4DZHdtGaXxfdFW7eYUVOsjTNz125wgdLbKX/JAY5NsbrNtBnoFJECiyJiNw+53lPAiImCPOyURUuqt7GH/E201c6PilUo5Tq5WLRysJlMuW2B34J57OFeUXhg/y2oSYZ0dZ5adsa+IFxFy7vNoYtjQ2WpvdIqW2whzuXp9oL6zXTkwV7RWYw9cnjZqB1NbpSoFIKjU7ZTVGoqCMafw1+YxgXjyoi8X2/nMDNVNFy5qeckfeE3eFa0azRz2RaJmQ9ottashw1M0ZV2nGgotC/KAOwl5AJBsBhNjfZ3JyrvNw9DmTS7lA8B/7qOH8mKfRt3ookXPY18zOP4lU3o1kZ+rfz+pFk0fl3nH0cVOFvaD3wDK3pIGLbRSvjyWy3YERCLvUUqlxDGl1Xg9IXWE4LScypy5pAZZVB+YCOONz/Au4BG1LOqQJj76yxu9SJKKxHjoMskjUxIBwzqKXRRHvYnbWCKMZMzkH5ltfT2ltjevyzd77JAaGEosHknGQu0l86fSu1p6TrAjQAJR+th2sUX1mvOZx74sMXGc3i2V1RrNRVWcamd4QIPZtvncb/OUT6BhS4t7PhhQ1+9W3PLjEZ6mxB4pTIITjPQagaFoEl8ivUlSmpZf/uZE3mysloBdjcVVPAv1HDNkJhaMPYWX+DvusSxU8zZNPGK8ccdjfYUaqqsMmNOKcEm4uk1xbQ93fHui0SSOtnYSh9TXqtS+UN3YuZt6QPPV+0P1t5nqg5YCssMAY+V8q3+xazhcquGOAhmbbrbWVzmsxXbx87B2c7wpLorYX0Aikk4mPXWE5S6ARyeM8PIa5TxDauamJp+s25RCf7HTS+qhEzDwQ3ecbrcmbChwDNdcT2+SFSiwFISS9y28RucB3Kxq9xPuFx4wpHCTzNpGRvXfUUr7x49ShY6eZ78oA6AS5vUIzzteeDvogjm+NKwv7rvsPgbwgNNWcqdyCANHY4eY
3
Correct.
Try again.
Incorrect.

Picking the Best Measurement

Using one of the types of behavioral measure was a good idea.

  • Behavioral Trace
  • Behavioral Observation
  • Behavioral Choice

Question 4.4

uVQHM9VF2qDZ4wSImkC/hxuYgoLzRoTRYQo/y+UwYY/D/aNz7xCLY+2Vk7oKJnI23cWRXbfYi2+hnQ6xON0fyfbGyIovUBe/RxAkP2bX7nnDcfEmtv1g/uvyy1IrLg+jSZrbC3RnrZEVf4hT/Lf3EsyR26bbnb72LZBs42DXgqyiMkShnOQ4xsPUZi/4CucrwiLmq6XAdvkol53VCL/quL9JIPie8m9Gp4frQxhZgrHKl4OmmBE8LRAjE8nQcvDphOjZLXBEEEbveozao4B/mkfrMPhGxKJ5qmELYeraDgPUs5XDt/qfwNzPPgw7JSPjV5UJWJ9mpu3le6SYW3YHAQTtNIxYe5cL5uyAWp7xX791Yt/MfKk5wFgfPy57QAwgZnioUxUHV7vMjeQc1D7r6RkwUnE7SiOIMzYht071oYIyTogRquny1qOiF/zIidkUn18PjCTNJfLgcEN9r5h38XM0oMbFTU1DuR8zQ2bxhnjfn953qiZiEWvEpYfh5YMNR2c47srr4Z6AbmtRHY5jXkprR/H6j8ayOirP0TCcA95VcdrAEVR8MnA8m23mZ+S5kOSdl/bgp+uCyJ6/24d/8e5ktpNHuJJZZIj04CD/t2zCsGvuhQozJSBGu169kRu/SbOO4PlFSLVSaPhm8eiv4gHsa1KhIt2PUHUKyopBhaPxJQ7eWzQFITjTeLo5MvmvXlOCPFvywkcyOQh2KlBKvi3j6E22YlSzadWdSeEthnQeyKgqQwTCXN1jySTRt+H42Q51xMxjU4D5ypMy3nCfRZ10H0g/0AAKny6oU3TJaAR8H5SaikO/ZDawyQlrQENT3DE/+++RNvk4NI8B0I7O2y4Cjcj47mlMVLmk6eMC0ecAtNZa
3
Correct.
Try again.
Incorrect.

Evaluating the Measure

Measurement is inherently imperfect. In fact, every measurement consists of three parts:

  • Raw Score
  • True Score
  • Error

Evaluating the Measure

If all measures contains some type of error, the “Swagger Meter 1.0™” will be no exception. The key will be to identify where error can creep in and determine how much of problem it may be. There are two types of measurement error.

  • Random Error
  • Bias or Systematic Error

Evaluating the Measure

For each of the following potential sources of measurement error, please indicate whether it represents random error or systematic bias.

Question 4.5

lAx3PODXteOCGIzsNw0BvsOP8z6Uf01ot3xb/lt7A/MCtUV6GSfTdfVmb5kjshZGZQX13cmlyF6E/+5iXS8AXQvlX/6sX91L0iX2ec6+sPatTroT/qGgFV4Ns9msb6ZrF9ZwoCqOU8cUmRYJjRcWebjIOSuwSHaARM1qdmcmQZW2XTnXaMYAnEpu+kYRmALRp49Ncb6KYNgkLI7Lux4bjYynAf3Sc99CNuUm5nfgOmnzLu3q4fP05IUpzc1oDzKLit51O95s4nD6ofbSEWQsormxbSVsh6cYZyV4wNChNGCxQQxCNF3fd1nrY9U1Tv8XmlYxgH8C67l/3CtN1b1f9Y5GwDRvs9m4nJO+LzNa4p4Lc8DvTZ92lTMmeDBPF+uQsEhnGXcBspMwZkdruhGrjk82jFCfNV4JGsVoo9ca9FYBN5sEtED2lqhRUnafVFYFXZVzNLaiXBfHbvSoz3GX0dWHWtEdT3+FA/ZNYuXpoQQ=
2
Correct.
Try again.
Incorrect.

Question 4.6

bl+ftXIxfe+9hRAXdR0aoxvxqVV3bCAwK0lFyQQcMzVmoubL2Ye24ENDyiFOGcSERky4NDcI2roEXRlGIpVkHD1EOPBTo6upZHYT6qNY0coOHsrHWWTq+NZAW8L3XTsf0CfzELHkNrjHCoPL6W3R+RamnrPf7OClUSQnQ6/SA8V/qWKo5jsByp0gYOt53YeYfLiQh8ZNDCYgS18I6va5eGmtkzTdiuWDUGwCZfyGbitLmLYNIYSCpFkdU0JNWt0BtE7wnkCZNwGOvPPKA5PQVanbfBnpCMxLX/sHTph9lCT90QGQtWcimmKu9VcOWtHCTYqiuackwSlsUWKjLBhAwszo2nJ3tizmM07IXE5MJ0a0zy5fQlOgmsIXZj/IAJVcIR/dHbfog13XJFkvLo+94RhGBFctsj8olzinGurRg/0fTjK5mKtaHYWApXx3oL99sYNDnQ==
2
Correct.
Try again.
Incorrect.

Question 4.7

JWl2P0oESpLwF1VyJ+JV/b7/BOOz30vt2V+msfBKMxfbVE+eoqwdw0ncSAYq7HTTHKxnLLDW9VkqicXEdq5pfC/+EiH6LNGVb6kHUk/1gmjcFgX72ghfmA+G/P0hQjYsG/DI8atCpkxeugE9Lv4/tkY8OfyWqxlwcrsQ9NEheO49/xqcRoM3biLUQyIdttHwuYdiGmwi6cT8j2+PUR6RCIA8nQZKsY2SgDEqZG75j90e1mIgAhpfAjjY1TJDZP7NJ8a8WUIEYtqVClpgi2hgV6vrufWF0V8JpKaaxINHm4P6DNf4QGe+sDAWDohp+1ZNL+rVe4qG9/6wcKzfryD71z11RYrOFKiyte6ST9d7Y4dc5K0wufqC0F53I57QdO/AFqd71AS03o1TtGOlHohOm7ebqorqKoSqQwSLZ3eVlwkrn72BaoPnK8Cu9/ueG5zZlp8pXjWEYo6vWwKYlY7AXPNQBy+JnLicC6CU7XMeE6k2YlT0l2Ovj6tkbWKBkx2283gkTwq7HTXnKYw4taHzMRm/DjEVq7Iruwri5tdF8vBIP0oyaxELeSk62Tm81QS2l4B2YZ2cWCtUasNCBsWg1FSHUbRt8GKB0mNe+Lhy3dI=
2
Correct.
Try again.
Incorrect.

Evaluating the Measure

To determine if the “Swagger Meter 1.0™” is a high quality measure, you need to determine if YOLO Inc. has developed a consistent process for measuring a person’s swagger. In other words, you need to know if there is standardization in the administration of the “Swagger Meter 1.0™.”

  • Standardization

Evaluating the Measure

Question 4.8

KXZLFbk57MoDg3iqj9Pw58/4zPXXplNqNIC+xmKQrTGgz5ryJPA2QZJmGfQjcEa7o807bKz58YjtQ96dLjPT9cs/B1tT4T0yTn5H4diEl0DnJxMVFG3Zcx3ELG0TIl01AuQLGIBKq+z2K+xMXEyNAGwu3efqvX6gKXksIhikGPkv4Djt4Bb0cV+k1QrltyT9L5Ap+5b8yHCEZ4sK60XRCB7MLSz7rMTKa4Dx59JP/65bfBh2Ax6Xrx39HSaZLtCgWYiJNy2ovI9QvoCEmi/PfTDCAwOUYesvrq9kkgI7rm57rhPPgDOLEONq1/7x3ppxpW48gaBcMCTTsBezZ/+6aJSSkQsV+Zaz7HMyAgFzQH3erRz9h/6NnY4AI7UqZsbP7YHh+h0/wQtWTLDdBDj0LEX0A3+ZMN5YFRd2CCOY9qAOjd44YNGP5UTZQfN2l6JrmSWSVi4QeQ5sDPSKPMsqLXQbq8SOxTUyxqKgFRTP9AYLG4iqrbClDcuNlLEuVdZsm2Vesto9RU84sueheFuo50EAs2DkXU0B3a8j8VpVQcsQ1FiyuT5jjTKE5gsPBbOeJqZu4iCn41KK6xwV/6envOPDLN3iQK0N+kqaZH93Av8Y4OB2ta1PY9BoiaId+7sqcsNqxw636zT+7OHSDCX+50G+t/lFrD5jy9L5MtJQ2AkSv/I2vrBIxQfiphxf1mKg+uLGrZoMbp7uXuHZN40oKkhAqapLEPhCV1E/QvSDeQ6PjngA7yemcenACBmlrFtj75XY6YCfDrdT/7MZt/94WcN8vbmjCBGzjTbKAL790IYCHD0xpP+I4rFg9kt7ABI+AaOHWebwvs+vquXyy2YT84GjUlm8xnuOIAaGh2m0wOxKGmW+idUEkKruC4qTgq4uNwZ3cKFeLm2tcDkKrhKPYFzlgAYwAhBISkK1ivbEvCzMsJGgGI8gQ1ERQxvPgUnxs2zdkcSs7DW5VW55swgE+y8dy9UbtkcY4FXp8Mfmu6W1CgAZrkpsCmL0ztMf2ESU3tY7L/wqSeyYGt8uNYf1IcfPtG/jGPznOr4gwluz/bXEUHapAseqIV8Jvuj9XnJLS37dIssLEnArURu4cPkyIhjo6+DfMWF3utMwpHY3xbOGPUYu1QELUEY4nXBk8ib6AQKorQmuvgKt3JCkvrqMGoVwQtJGzszuAJB2tAa8FHxcIHjMmHkXf+Ac+ie39CnVSR/Bt9VhJpU2E37Hbc3JGhosr/JooUU+H0PO8CRvBYxm7l+o03u5s3pWpGaTt71K/AjH40jGseCVXMPjl0IgAVoSUmUCvJp+882cM3/nuIcsNCw9i2wMxEmnaQlA40Ml5EpbbUCoiBpDGM0SuOYQiu4j0fheH7aGwkC3hd0lpwkt0JxQWapvmA==
3
Correct.
Try again.
Incorrect.

Evaluating the Measure: A Checklist

checklist_activity
checklist_question_1

Question 4.9

JC2lfNGHMvdJ1ggSuqq6eBUhMNFyY6+WwQW+6Cj6txKGXnONiYMFeVWZ+aIxCmyo0W6RTnvdhNunIUv4vONXOhmShZVJiqH/iMJ9XyocQMGIPZAuKsnDFRtYRIBPaSZDTd7HU494DnLsNdU2ptPb9jAXzvhy/iz1pDRxEkQ7bD8fgfPpFofR9HCrC35ILZwaUGsTMOjoTAectpwgJc4nVN4RrMeXDcDwmMrf5BZScYA4eqGC++AMcDvaZuDQgUibykfrVvMIV1cEfLUikevb0X8+higoMkNcR1wc0088jIqJH/k0L3wrVAKbuRS1gGLpQjeggsYinqFrnw+Mi1khVR6LaTvSgupv5A5nlU5iBY7UjTHgXSE89+de98+riKGty0P1CkUSfhuBsgI8Druy8zSeHrbkr+wAEcrEac/rBOmGVL7uas7weersuS6eVYZBHhDgU2q7yYvDjYzM5RWLfOxgUlShWq8euqPEBmqPpceWt7a0JLRYE1qRsTfsuxEqWTDePsntdgPMCDF4MeAbSlW9gyP5UTjuhPn3ZzPI1kXHtBa/B/P8ct5tk9vKt9YYZPptAhAW/qwOXTjNuqxQA1nuHEfGPQiUXh/3bXlcu3w0oWuNJ43BdOALH03uInuPIhW7LRq3wq79KaneE8bJyuV4pkunvfw5eKx9fIVK8obk2+dQMKIrVSIfo4Bevwe4vEJ+1yVlmbX7iAf7PpMUYiG47vCZhNHJCm+9q98XC2moXUPOMSH8+fUxydxhSDfjeGvEl0MLb94qTnIMvp6x+mzBkdNX5M2IIjOqXH2UJtj77ugixJOw4JGinw14lT4gOm+frCfNNcj+iFmL6VvAkAGcl67egWKL38lEIjeYGLwHoBCj1IoD4tvKYtTFBdTagXtuMto956H6BrVd/m2oHgEGy3EIxHCH0A9pTaKT7UEewGwOK6wBv60WDpFMMTKvJQuF/Gi3bquDbtWPOaWiftWUNIyjf63N1sZ1zzg+FgFKyaYaTvXm16ThSPJyoWgeCak9SPPaa+PuqNg5KNchYseNLI2LR6Bmn9whIUvBuznYMYlaDiRsrTF8fqB75e021+qi7txENRIDXUFfpr39zTVviAeW/4Zqd9o3r9++3Ckjj2zFlQRYIJf1yrwAt6HDzxo3V74TiggKSjsxCYz/usO5Z0u6RUt5E/4ibV57FrtNKeO3/uPWMaSB+Ymni2Ds5ssKDyiE25DXkEvm8FX8UkxLZvpripbIWxKD0RYBrnk=
checklist_question_1
2
Correct.
Try again.
Incorrect.
Adequate Poor
Standardization
Sensitivity
Reliability
Validity

Evaluating the Measure

If the “Swagger Meter 1.0™” is a high quality measure, it will have adequate sensitivity or a good range of possible measurement levels.

  • sensitivity

Question 4.10

8OQM7VuPOJafpGYq5tZ1QjlaWA0XgPapUWknTpgxWbqrWyewF29q7hsj4rjgluJT1jd4mMgg11Ld/XXh5Wt4FhJdKZFfZCecVoOYTTu6zELqxhD4IlulBLKIOZKHNgHkWO8HAuCgykCl6J6BDMdroq3DFFQtMvK8pjdQGaIoofsPsT/oZzs1e0ddbd1iN7hI/Q0jgexK/H2k7Ih9GnJCGJvpSp2WaUTWk/uTHMCB7cXr3+/1X4ErtWESNoEPrDYePN2HBnxNUh9ld/DtR542RhZI3lbZw3yRU6rAgR2l4w5ot9B9UVOUQ4Ea97D3/ZaUqT/uTnFqZTAOeuys0uhiN3jP9jsdLVJHsMYn1wL51vFM6d7ZjxGdBSXrfeUUhS9+YfxaBWYd5x0ZsZTkYca1vPziiXrnxchLJPMaI3bT7oOjpAPq5i/6UnQTep1YGW77/Nnl/lA5LSNfd8lyi+PTt0kPoGttDXT2XIiQq5LoR0AcPKDZEeryenUlsfkp7F7dEuBQ6XU9jK03aGG6TneqYtnc+481/jl8GS+9h6xMNeiNx18URoYEAehDm90V4QN+enk+0NBQiyWqUD/wcHWcYsNfxAvhv6vf8N0NsJ/LQmA3ltafvt5r+ips9gi+pQEh1yGBWjvEnkQG9HBZchthlEkSypX49tPvH9i7egvsA0xirrEar/hhkEPuZ/QzuBoLvNa+kqNxPpIxje6Nd6Bz57MLHAH6Z/m/nzQHigY6DQsqe2JnwErdM7IMdl38B+/mRGJv+XwcJMRiDeXs3Aenx7pufTJCIKHyU3N5+5SVvLb3En5NE3NbWRdmuQePJl5yUMTY/eo/ZVtaR+Di8mqY6meokfmFVJqwqUK/M1KzeQCMUNII+tX+cg7SKQFRE6uXtM86JE3ef+u5RpjeAsSitTLFik5N/HZ8DmfVphZ5bkCpRxC2KM2YNfjXomGbhKwcuzh2/QZuNdblCqtQteJ7wUb1owr2WX3ciZ55KVx58oj4T+PYCyZfxsVv7kMNlFINwAyJCSIg9I15Lo89G7UaV/TbyyrTZOA78sBdGmvHCo+zXtRO87kpeiM9B6vZ8Qi2lbEzeUGSY/frYEjKjkTJOW1zzvjLeRyNo1liAdXTyOZlIFVoArzglHyyIz9eOj9iRE1wsM1FZX6BRnbwFLL6CXtlaqegyxbZ3Tk4kJC4xf4xr/26R5NfyJIOLViiEkH8NiXRg7B9nsZpdOvnw9wB429CMmCz/7RR1lQ0Sbjsti3lc2AsvMICPAkBL9im8W7CjPZ6KuP9ru/uE0LlQYIqM9dc8d95P+AKXUzWNxIasFyD9421j9pRPCC/8qDfzbOLPMzkmzVMnfqPzcjhLxdMy1Gm9NY8JuQY8daAZHi/HCHwE4eUp2cuFUyNzL9oMqqXhZ5VRVu8ZEXtpWheDIxWFw==
3
Correct.
Try again.
Incorrect.

Evaluating the Measure: A Checklist

checklist_activity
checklist_question_2

Question 4.11

pRMZXFKQsIw6KqjuzpvOsDu+j/6gT7GK1YHxDP5E+SnCXekl6EDdsD4HDmXQ0LqZaGdmu6cw0OczVr2rgZKG3IpMkYVJmHE/Kn5r9cIIM0fSndeXyxWDs/L/zp5ymMc6bgEBPyi0yZOpt1vbtUWDvaKVdntI7nY7eaQXDT43KHhhFqw3jnSi0q48TK3oojY/nxOVHEPMVKopOlUb2WsxZAeaVrUe7azvxGtmeYFA7cixrKNjqsK32+9pR6T8CBXlrwwmx4rTky1Di+G1hocX34WLHu4977C4IkliEL1Bw2smaE1JTEMp0r42Gg7lWCZtgmH+WCLSfPK10kPTUdwp+n14s4/h1XK5qGzf84IIdbwJMKAMf/eZIZRgISaZE3NPmXw2k/dJCZXZspx7RUkngKyb4h0idWMymm4fsjFtAWS3AKBPOhGTo5O+OZIde+rm2IGKUI0HrPdy4d8EDj8UkT+lI3+w2XZbx/7JCymtvZKy2P34psRE5f5op1njpvhlizVq+qZ1c9sWP63T4aKeef5nCc7JtlENaH8lzowZgawyOtUnbBbt7fUTFgzbwqiiGCwf7jgngXIVmET21ISjQjgVuA2CHAcW98cjLkz1YCYHgqA2m8PcjnELfAa0IdcMcmStZOvMKSbpPlGtl7pIpFGbDlQmIBQM/u6GaocQ9KLXy5PjJ1bZG5MzDVwqUupYtaW9s2ALRMN95G/s1T1S0MADh6bbeQAC8eGzPQYsX+LE/U9uynhjm0sdadYgDvHlEoWM3laL1ZyUF/U2/7H05jKPO2LBoht3uEirEvYZ+IKnsAuqHNiGIDzuJQbo2Z/djljw+g==
checklist_question_2
2
Correct.
Try again.
Incorrect.
Adequate Poor
Standardization
Sensitivity
Reliability
Validity

Evaluating the Measure

If the “Swagger Meter 1.0™” is a high quality measure, it must be able to consistently or reliably assess users’ swagger.

  • Reliability

Question 4.12

k+P6q2Isq+OqtjnmnbG2mw+bHqCxQ76vSY8Xgfs8Y3qOeKcymrzJ9Im4nEuPyiyEm3mdFcuX3xJ17duGP4iDh4KMd9JjhAKvei/kGcg72y0vIx0HqQ9HbAS5ej5MnsfbNErDd7gChFM7PTRUd5isB2gnqYWtL4lLxByR7Xun2uqnkGBa1Uxq1Xy72Hr56gUBcZEOuWUHQKrREQgvxtwiJmwxw/MdFW3M7ZrITPoz6GCCGNl3PjRuMnMp2Z6V+ZsyP/n3jtzCNr5KONtpoCyE6TeNPD8KQoakPGyNhOlg69Oz+Q/GcKg21jmc8VikvCFnTRdomaReD44g8nWA/KkN5v0jmUkooWv19ZLK5xoOogkPCTps3pphW99xoFSJxT2Lq8SROW0DF0cZzaPMpSDGt4EzQMcnGBJX+Jbw8q6eY0LF5U6dP4Xqwar9EWvNUIB2UN+rjahbBj3JeCd9tPK+pFQ64haPYWMlQhbra1fxaPQobSfMNp62Ed1eNfen4BxsfYh+uhByDHqKeoQ6W48uTmm6TC3lypQLK+O/Zs5rWr9bAvrQapw5mkMl6HsjhG5j17oL8OfTHXMVUDtlGAP2sY1Btn6Ggoa+xMwiiW5NtluX4axhfzu4msrss8MdmJ2XThndIiYbJXB/dyxQP5YOS4kQa9qX6/8Xprc+sKtHpCL2hboMLaDlcq6CWWB4Sh/R1BRgD8nnriaGYSg0zj+n8XnzFjXKlCdMNId/naHPjbJLKmpzTaieG5d/94V12vtu+ObVR0CAPvdacsrlOUwe25n8okqWqlLSjnuAgmbsOZmQeCqwOMFaRigN+++H8mYlZgRvlvW8nHYRKSurgUmri+CIS3/etThZLg07D//bHhLgYVkrCT1FC4CS2qssnEmewBMTASx0NJmtxysynlW+YpSVpxmId+7lvou6jM6x/kX5YpKD7HKpGjUXopZM/fKus0d1SF3FKxfJJlBiORECWMfIzt75LnxXl7qqb7B6Om1n2FhMbrSMjbo8I1QTzuJKi1YMODiM+IIDaKiggYKtBWDAsj34vRCRNYcGs6Yn+PcUp6ocF6yeo3vFnBuumJz8U3kkN00lr723pCvWVtjQqeb4EWkDdB/NmgZUTQ7FD/s02SIbmGfiCL4DWHPxhTQiVOcQYNaT/N+LWj+wjvze+SBVQwN1s8kq
3
Correct.
Try again.
Incorrect.

Evaluating the Measure

Based on what you know about reliability, you decide that you need to test the “Swagger Meter 1.0™” prototype during an investor visit to YOLO Inc.

Question 4.13

16v9C0q2kUse9t6YTM+Rm/WmHrF3YtB+OFGccn1hvZ+GAz/rPvil6bupejlXULgW9pPMSIL/6fT39Qixn/2UNUusLgshz5jkKs5bPO3qFp3oOCLwHNmGSvHOvclbBVAU2NsmymYqvPp9X1NPpk2kpbVF8BptRGmMFjtWJvIq6IFAj0hSwHOttc2pa+KBUSEstaADfpFdK0VuXgo4kFoKgUHnlyKhl9z7upDnid1IrnRdIQtKFNxcuRJP+XqRtmf47wFmUOoATTbjPmBBpxNSOyx4LqqgpCXt7uAmiX9OzJ58XeocrV4lnwj/Deuz8U/4mZX9CwKAiVeq0n6fkeb1I4HwOcf3920ERiLCeX+vUFBRu8iTbHACRxGg0iVnzOE0eUKxjDjoYIzeU8MnmK8PuCJ7y8efgOkttEMyZoso0qtQL+FIYb8XfCGDHVtTDfedzX43YWiVp46GbvwQ6vCh2rM4q3mr3NlocFPqP9420+665+1nqIOvufnxBSWmH2GUTu2L8AHL8Xqz1JikGscj0+EpzO7NxNV7CvSAqcHG3SlXTJYAXszS+8kpCMV4Rz3zt980DqlwoFIi5F63aQYEaG0y2NS2zl40mVPmbFBT58OUodnEuB72ejlOICr/e3pbg8VpNokQOEJ/6FJzc7Wtskfz2Ec6TD3EyubANhytKLWeEqMXb9LCPXXW960rH4b6rizptmK4g6P+KnNktRfN0fhL24qjFZ1XG8gM42K777rJ00h4rXO1QhDsB2E5i40O2/c2PR/49aqSEzwpi0rnbLSPIdKQnCBveky6cVBchEQCpD83uQQgAdhNMSFVAUaEaB2m2FL7Ff3+zIPKA7v+hGRBE13+xly4zXNfXOGwJHxpvWMjwKU5pUCavvZd6mz4bFCiYrst353GaJsasT+CbNIaZQX2qmD1W1qXvlI7e+dJrRlTCsXOTdAJMHtCbTI/krVsp/w2T2jx2Yib8Sqzlj4lxE0DemQGX4ZvPFcK1QoPn5d/Jk58TGtyVLTL/4bE3H49sqZW+fzDyi8vBQk0pLVNgp3YEbeS6IL+E9WvKjoS1EecuzFg1dBgOcxKCorXyG3ijBXDTBbwCgZ/kIkrHFF4BldjIcC4ffbRJp1FqO+5p15htL29JdULqFpOCgYUKXHbefE8F3N/jiVY
2
Correct.
Try again.
Incorrect.

Evaluating the Measure: A Checklist

checklist_activity
checklist_question_3

Question 4.14

WIswINb/RYOxDk/4EeD0myXtsa/KdH/5kPSiPeF6Cl91C+qXEU9fY9OtHxBezFJrQxIdOnLsdfnc2XYA+pepok3VnOn5Xy6T9r1RvtXsIKyclvVhm75Qj0K1kezX6NRycT/3pntBvvJvWk9OPZQFKTP9v0BoHfZ1TUGkXZdBRMWYaeUyZGSovBtcCHcSrynrvB8kTccbe9O9bHs7LMhyXS5pp1om8sl5HIZuErEwCrnbzinftPCL88RIQvdMT+CzVE36orR0SirMrtGusBZmuWYeMpcbb7NzgQYoAGqL3g/w/QCRa1gVH6IR6QznWPDlsaKfxadrw0JOhgbFhNVC462csHrXFbZL7wzNO+Jjp2wX1VGneyWNYmPMZJXf9yCJV5jmAbRfw1GThNm2CXsJkoUTGQyabwiiHOXc5ki24nD9DbGQe49mPMokWyQTUO0H3we1JGURohfqRaH9ZwuztKCpCHtFUwA1VlqnyRFt1Kg7AaLQUjSA/BFEmZLOFeJIzBNPXMEBQObpCEl+wLHzb4QmUcTConCk1iV2qdWJCYh3qa0gfk0/KtTeawtwzLLblzXaDUWGtJTOU4kPR6YU7d0I1xk0NYTNL3Bx89IfZSBDSJ+ZGu2N0zErYC0Elj6qYI0vKcQESIpLLQYlPcloBfhnSp+Tf6UpfM3UD26vjOSjsREz
checklist_question_3
2
Correct.
Try again.
Incorrect.
Adequate Poor
Standardization
Sensitivity
Reliability
Validity

Evaluating the Measure

So far you have determined that the “Swagger Meter 1.0™” has adequate standardization, good sensitivity, and good reliability. Next you need to evaluate whether it actually measures what it claims to measure. That is, does it actually measure “swagger?”

  • Validity

Evaluating the Measure

One way to check a measure’s validity is to compare it to other measures of swagger. The YOLO Inc.’s press release states, “Our Research and Development Department placed a beta version of the Swagger Meter in the nearby mall where mall patrons of all ages could choose to test their swagger. Our test included 490 patrons with equal numbers of males and females ranging in age from 18 – 87… All test participants reported the Swagger Meter was uncanny in its accuracy.”

  • Random Sampling
  • Convenience Sampling

Question 4.15

VPdM9D/Zvxz0QF8SlfMO20Id+wBkSKX6xnks+CEgqDfJ+xApHxeh/tPixpvlVV4gnPBts/djZ49FjZVKZ6arydC1ZPDxXmysVoHX61d5t1y+VGW8RdaQ5zoUZZIiR7pHvU8GCvJYfElhOr01hVSUvdhUk6X5vXrL4TnqPzD6L8aHtQVAw45G3kaYf8Yh2NTRLVw+0JGR4b7+NnweXL04pWZHwXlpTLpB7+qsaNDi9boEib2+dLyM1qH/G8GpFK1oL199dbxaF7GCOOkei+FQPLcrxCC4a88Xodriqz8I6/QPzCsQRtcVLtfd0D1c3B3efRTymCcNuDV3sZp63IjOFL3cqE124iYEuBuHTeLqzwmCYC7Qq5sPk1mqH6Cim3ZSzPwBbjhteeS6embcWUo3ug1hT14AX7kUL1f2EPoqTcaHim0xfPbXGnatMhrpCueoX9RDqrjL+J38vPTGbcYYnxQfahWYAXSyCiAmhPNkdeJXMr2/+jkP33bwrKz2WpPoXFblzFagt0sZarJeVIJL2mLE6vO5rDFh2rClwoTva35GE7/IOB1ZZ8D19eWMK2ghRtD1xBaMt1jHTgsrt06MxWg0jVdiAsmujkBgnT1r5a4Ez3ppgyuARVO3k54jUYa9LWmJ4LpX9zZV98Qqwe4Jn6Le6E575ForHJzg70KYuogt0feLKi2eGpvmvoZUetXPoYO/t8NXs3YfaomdfoZ7nPHmkARRK9z0kg1K22tVTnnk27HfzVzB7qkiIU9PN+Yogg7QNzbuY6APJwxJzO5RcOS3ZygbtN/G0ajpSssvtiksVRdK
3
Correct.
Try again.
Incorrect.

Evaluating the Measure

Anytime someone uses data to support a claim being made on TV, in a magazine, an advertisement, or in this case on a business press release, you need to use your psychological literacy skills to critically evaluate that claim. After all, you don’t want to make the wrong choice based on potentially faulty information. A good place to start is to look at the source of the data, namely the sample used. Some common problems with samples that can bias the data include:

  • Nonresponse Bias
  • Volunteer Subject Problem
  • College Sophomore Problem

Question 4.16

V5wxR/0kFxZSsyzTcWkcgGxWUfMYzK8Hwx7k3JH+NWQ8jEgkIHpA924RxEIw8QTWjcyBRJzzXD7TCvJWjcI40DtGtvIHIMncfJF2ZZdgXshzCXyE6ba9rv73OPaQBIpPQT+Zd3a6FEXehVRVN5eQBjFmz7oDjs+5b2MvFR7YwE/9bsKxNCIfgFZdWQJpKfBl56W5YiTjMOIIu0Ifn/dUhNaQa8b85Zy08BZIWyXH4eZz9x13ohyrO40r8Tawmd5xDvPbdJCHbbKWJlfo6588vzAgt1Rc2nZysWkogjeBclaxZzRrEARDOezK3e3GD8vXX7qtfIr+Zrnky9TrXKKUVYBiPBkJg4QTqtcZdJtPb0DdkGgi25tkfezO+nDLCHSbkchz6kXWiRq1ri5mhdLbviFJHC/7OZuLg0JdpGVglYW3soYq0WJXiGbZjJJqDvPd1uCW3jarJ1eE8vleBzPEJTF3iuai1AYDjTyGM4VGv8IT+wEarQ04ffNmpu/yBcnTvN/nn5CakcUzQpxjJoTb6EYNP5WrsFOefi+jhHpSvo4pq8jOMlMzYic3IFFiZ5HbUuWS5jmaNgGNQaRT5GrGi+gqf0T1MedRfObX7ucwdYMTN0a3oMmKgmYdqJ8kpVeG2dG03ThwXt22UFPoByQwVOl5RikKClQ7DDlEOL5qIBDnIlxygEezakPxXZvEou8SVgAfHrd4SW6AZMnnIcsmL9yhr++7VpT8m6Tra14DJgVOmpwoeKgsuoXEGd0=
3
Correct.
Try again.
Incorrect.

Evaluating the Measure

YOLO Inc.’s press release states, “Based on field test data, the R & D department’s analysis demonstrates that the “Swagger Meter 1.0™” capably measures a user’s swagger based on user’s ‘hotness’ and the ‘electricity of their personality.’ The Swagger Meter accurately measures these constructs using a set of strategically placed titanium sensors that assess ‘tactile temperature’ and ‘skin conductance/galvanic skin response’ on the person’s palm. All test participants reported the Swagger Meter was uncanny in its accuracy.”

For each of the following, please indicate whether this finding undermines the validity of the “Swagger Meter 1.0™ as a measure of swagger.

Question 4.17

HWqyYqX4SAbhO0RcMh17NpiY+IMNU0xqeLRvZnsYZBC2osM0Pp7VOtXNB2uYC6zBwd8ApY2Sj9tBH6enoLMOnZSrm8SkJ67zV3m4BEY56VGqsotUt4fhRMsKTvVP7ZnWfyxFuWdo/06oWye1fbD/J9E05L5SmV6hRnn94OE2jFJXccbuD/U3bWQP7cyGSR4yDHbDpTCUvhdvZ6VCsSSLE0XySOdO+UwM9VwtZcGMXgJ0922PP7w+UG00oCy80tQl6Rblf/zG9TCfQgkhiGbQ6hLGLu9xKKcLLDkl2eN+KaqkkdZ+wx4eufQ7MQo4Svd25RDQ/3c8ESMSphUhUerp7VFbwClBLu7HIXx8Swe3oyxfwi6CPFrChT0gqUYeGIsstgbkjhrFKDHSPS2OCkqeFLL6GzAmfB2JI92brQDHGNIqgWxOBdrptrIl50MuAHEiEtUo2yT5J4Pkdkc8upbkbKbR82ySgJKoluv5tMUdfGFr9Ustftj4v7vi42jYcEhPudPj3Z9k9c+C5Ob6o8ugU/czynvAZoAj8nAE25awNxcaicbJA8IYsS7d7gbWWL/s0jUw761q7xCZHSu0L0o+n2gr/isHEGXqiHL0HehsLGHnVxauok3Ok+LRqgivz3fU1ClxAdOSFibIZx8p2Y4Uy4iglas5OBUW+0ajiLC6yi+InE0zCNHx6e0bP4GbQEKOAwLE721d8yAwqUEvhy+lGk3wcqhjkV3Z6rzzmFGoLrXQhAp5WapZviAsAdXyjlryXJwxXXY+Qrs3rsv0Lb2IzIrcbe2gt3Ocdt3hehZr6+Zolaf/bqjWAFQfsGF1YKf05T+eLtQVd730lKOSFnVisor57ziluXRuwxba94vXyBD7iAXtb8OZbw==
2
Correct.
Try again.
Incorrect.

Question 4.18

VMA0gqH5syMW38hJlDETnJg4YYzhlAAG1LA4aW619/3t98M3uDBLDtHZhJGxw5bfjJZIJZN6Km1KsRz4qLIR2DLl51uOwfr7gHavburEaoBStH+uqspcq0+7FjmtfEFcfS1SC1FSL+2ZtNNl1WAYfHlEa2IZd5YQrg4L9zPa70FOgBeTTW8tw7BMFYrpuKh5K9C/7bRIKYpmuxrH+O8iJceN1k1pu7KB29CtsUTeeE98YMRUCD+G8jdkhQFqp00JW9u7Bx5pLUujhNrzW9zZq7gdjqTmNdmi1+KzsYCrGTtRBvE6IG0/aJDp0QK/+o59KWP1KwIGXTVG02LRDoLS3Waefbm+bHS0Ve7K9mC3AKKTTY6BVjwMspUz44Visxm2OQhQPakrA4MgbT9jFHZN7raKHDoqIk6/mKiu5KWUFpVbGNY7uIj8tfKTVU53uGtJVD26SCOHKbCN6zaZfppMSJn9geS6snMhdUngSSaE0Po668rYrotDLIl2Lj9MPU4Z1z1y3RhSGwvLCepUkYhgK38WCZCch3ksgSKNwiVntFLt85mXl1amBqTXSWR+ZDoh2aUsvYviN8WwIpz2RunRtx2tpdSn/jIrcn57DjV0netiHDcpJ/uwsZaOxwhpD7f8FY+DJ/iPYeT1eRZlmuU+KA7h6XVCXczTwdlbLutNptrultfsfe8hCcOOb+2ygZJP3058fY2mMpUPZoyupmQTGh/4jvl/Lj+NcopqPjF24kZnJXT/9NWy5ktWbr8zAqOZpJL2GycaIhNgzvqFQzehN88WI3KnrTDHMqLCcMr5aTUSWukIAw/s+24Pxu2UV8WCRA4UyevZofFmByEW2LcGnwqRNMdfbObK3nFsjKAYHu5dtGWIa0lrnQ==
2
Correct.
Try again.
Incorrect.

Evaluating the Measure

  • Demand Characteristics
  • Social Desirability Concerns

Question 4.19

rmkAjDL+CYaeL7lfNOUh3Ay12+4f32rFQuEIt/KAvylAB/HKK1GBc0JQfQVoWNUm/MboLhM8pJI9uBMqPVdIinufNMQx7RwEXwJKpLOTZYrSfj8J22nuuGmnAbXRJjEANTxLfbdTPL0y7coYxV+nX6iRqRuxsPMU+g0TZ8FmCGtQ+1riwOU1nNdEaI2QHH8lD/GzK6KqGTKkjxH80PwTqrNdpTrWEE/8e+GeVWQ9rWS1OUhawHNtLIwYHgiLk4RXM4syuOVy7V8jgeAKeTjH8EBLPLEgQVuGIOSJ+s3/OjWGsBoH+Ztkd+7i7+VqjW3mNqx7reMHrFNVSosvi77V+gZvVO/3avRpT5HqKNg8Lwr01qWsLQZQ3yXXau+vxa578s+De5Cgzy6zJCmUz2NmC+pAEoGVAMDX2EJSr4/DYJZE1nufZyv5NOs0tUXDkF28uIun7jGUiA60UwL+UA//aoqZ3nOZe5ZXriV235H7EfH52HolOcxtUCFtOSa2jEJdI7xC39BFD3IwgXdP0Zoe2SDKONuvq367r7eP8dSWChzK3xUEGJw4192AJ5SosaTXILk6T8JRZyBxC3KbsL6uj6WfiErTBUu7rOjx+3p81C1dmpB3ERJ3z4CQfziYFXYzmMw1AmkbrNCgVZLYwRMDnGVUazQId4WPuXceAw13McBEb44u7s/sLUCC4B7Z6eS9XuW3CEKwqoS4HoN0EkVTkc9NoXdsmETexSPzWnVGnVjIeiZ7SR4REcaaIwPIFh9AfUpEXsBRXxXYMXwWahGhaAP4Mk5z+trb7CEkm3BT36ADmbpNs0PK8l9AAxcrot/4k9X3+CM2JicACnWNMlpvLzuaviFwyTi5qfGNuoA7p3CVLwKy2di+8S6bzm/dBp+ZmZUfhU8+3sRsTw1NReuWFexnI1Q8z5IASFYlsYSEKbngeeDMHSOZIOibVOOMxroWH+yGOhHbBYs6JooLoHeIQgnEiY9dRqZzuhHt0lUb+iUywQK2oshMXv8xSTmH5LL68TUb4SMz1F9rDjf6EwA+Idsk0rcS4QCleghcR0ViP2GuRsx7mFBnocvIeMfXNZhh2vTLULfy1dWjqfyTQ6npzEuLC1mbWU5foelcNA==
3
Correct.
Try again.
Incorrect.

Evaluating the Measure: A Checklist

checklist_activity
checklist_question_4

Question 4.20

voESzakMCEipkgeY5spOgMGTAoadv1K4HNnfY91nQtk9WjfTuXlg7Xq0ZXxMSAh8c6ZCR3Ek1Z0Qe5anua5OULkIijXH1zI9I0IYVYrrJiCiqUMjqaQJmj+sqx8v/VEP3sg08DOOJ9OLNV1xe2ijQPr/81HkfDtWgHXGFtMHLJ0nZepLf9mkodATFYetpvcqkZS/Jb/bxkZc9M29rgt8nfPwZ/wks8r6ZugFOQRa8+deUvkJCc4kMBHFJFDoXxDd1BId9PeL3ir83vrayBr6DY/gObDc8vU/g4BKoNDrvb84j9FDEAB29vis2PKa3KtXmEa6NlpBqebIidFqcXD3yWUqT8YGOsA4SGYyJZfJbTySGTji1ckDpHM67M7wdBdZzcn668tgsV+qQ6IS8B9iCpZT3iqxSVjXi+5iHYkOn57sbROYwB3wboDTKx11702HNxbfyTb8OOX2VpUqeJIbGFTEsNOp1lJEKjRXT2CppWirAS5VZRvd6tceT4PTt3M8LomLfUlbQfpbOn+3QSoTuvp/gLb0MaCCiddUYNWc5PFtnYbpc0tLmQD+bsqvSbAHFWMpZVwpLc3c1teYKAW8TJ8p//B7KWokzCL6d8ogZvRNphF+LM21X0P7XjYiq9ogDiH6h5A8l0EzdLoWP7/kr+cdBHGdy4h/JbTpxUP3NSfgDBoCfzSOXgY9Pe+ZH3umXkGCUTVQ4ofjE8eMHX+jOex8UkY4CeJHNNRrCkbgFntPrw4AcjoOlzs3hXEyQEtDeX2o8qE5gXo=
checklist_question_4
2
Correct.
Try again.
Incorrect.
Adequate Poor
Standardization
Sensitivity
Reliability
Validity

The Decision

As Warren Buffet advised, “Never invest in a business you cannot understand.” Now that you have spent time studying the “Swagger Meter 1.0™,” you now must make a final determination about whether the “Swagger Meter 1.0™” is a quality measure, and if so, whether you should invest your money in this company.

Question 4.21

UynKLwgsdf2OvJh2VbQTroPXbpvjosW34bTvrVrPYZiRwjDGG1g+mLzbECoU4Htn1vWHb52AxdbyItEhcBlA0TeTOxkWXhzWKZC0EuqiDFU7loJ/zXz/EbC31gg8WkF9xxlhW3tRAwjOZEoXt8dNCL8yLqq6G+EYg3Z2/hr4M6x3coxev4jSjyI/49EduJb3AUR3Rbt9uzxUB0dHth/OP8BeqynYIsknzJOz13qvOsTEQKs4B3r0HmvlZ6XFbtTn8+3xD799dULje5w6eMOMBdaatem1cMvlp6ZzknmPLgA+ghf3tM7Lr6hfnnxUAbIzIZNMCiv9swFUKT3g/sZ4edFqn3yCGIl/XIpXpvkzkf0H3pxM4VMN6qin0gF4QgrHqAxgdj0FHYA7WC55mj/x9Wkiiwk9IPiT6KomT8KGu1Xzic1PYMXRViwFHKokyM9Apjdb9GOiN0BHvX8va0fLYhfsVCECI+cg1jRE+KEFPtRovd9Qe1OX43c/ZssXBIbcUkPp+nYpgTb3XxhsOyOG5b/CoS7ge3j3Ok/Wl4VnB2I4vJcSg+3huYDeehmmqUaMIdW77JpTCJ5Agd/beddvOjhrSMo5aD5MEPUUHKiZjh1xDUMdzKmzYF2GJODyBIz2gZ7lJ90xRsNyjE8nWSwsODY83PP0cihxlGQfb6qaSheUZHPsgfzD9u8gxgrmjH+E9GABz9xHrW9AWSzy2fyUyuaIMrqxcQvMq3BqqinRnlPojpmINzeD4Cy3MVqwXj/pkQnVLmH+GLR6JAo5cQ6CxVuKdFESC0LHUk0KY3BPANDZfW0w956tNODb+u75EJI/dToU8BuEzKzu31w+OFwHJ9DXw/c2ajf5hDlK05JTeOKiRDJNrvI2RaKrE2erRo7bBqi5xBM3U7NHni6WBw7h8b8fSiAmA0Ci1y35rAocWVxMKhXIWJDOS09REKuk6cym7/yfZBZo2nWTXbEugOermDCF7aYEkLplBwwxWFnBLHhn6Z16PabIjUkRv1QnqNkQxAjvDuPPnwVpfecj/T7bLqUGK+r5+j9vJKVNKQE7kUoLNFi8J5dTc6TqCB924YHrvvhrSWrMFKI3Lf79zCq5lvdzeNoerNOZzMCIiUyqaudo5o0JG1Di5ZTL+YK7aR8nT6DzzHvc1FQRebn/dTkOycq+bE2YTUgak0pidYI3vAcXS/ge6XV92SLECb9pNc9EyMF096epWI9z/qC7o/ROrLlinJdVk7r6WNKaNKltB5ll4aYhlFebfqEcb7izX8VpqBRKFdEhPY9eIWZD8LhKoFZ4ul9q6N+Q72GMkg+jsJuI8MlzLVt6/RpqO4mK9xvwvacY3nWjJ12UMVuLburrbC2CqsqW9UpLaxF15ezaCWgJhWCcQzgeTwAvVjN9YSV7PfSKPzjZ5JaszzE57l33i2/9qsLHoESCCSTypQGIhQCerHFKO2LOJdVniwJRtFmgyt1gbApwtE4gEJCVzbtArZ7wNciF2u3sCY94OlbznSAJS4wrxKHwYM/4BvbIqtZdMMAsh+SlhDiUuSfWZ1os7Jbm5nsAHjAQapVWFEGjrp6NxM891vuPv2pFgc9iSUyVGyc0PIAthBIOnxbXWwFYA1uh9Yy989VJqIbmlto02T9Xo62zgTGonleARF+glkXZiXIW5tDrBcEc7rwL4a6BsAUXsR6S+tzPD9Z+/c0AjA2yyS2A4VwNjyXbltRCNNog0GLYqhQUTJxFVsa3h086zTRIgQ8MfGyu1tDMzJfRcINDUS72
3
Correct.
Try again.
Incorrect.

The Decision

Because you contacted YOLO Inc. for a copy of its press release, someone from the Investor Relations Department gives you a call as a follow-up to answer any questions you may have. During that call you explain your evaluation of the measure and concerns about its lack of validity. The company representative freely admits that the “Swagger Meter 1.0™” may not actually measure swagger. But, he goes on to explain “Users are confident that it measures swagger. Besides, if people believe it is true, who cares whether it is. People are free to believe what they want and believe all sorts of things that aren’t true all the time.”

Question 4.22

WIedQIBMdWwF61fv7GofPMsUAslihxLQCFcZ/BcZbVw+EFwvd13g9AGzasP7U1tDZaS5LvNfM3psOJcOsx4b5NAPY/7/rFkewkJnOA2n/9gbcavVQS3Boe1RaKe+32jY2vW2770u8gKsY14ZFOvsgTd4XvSF+QmWkteXe/8PyBUk/5HE3Ny/K/1CGKU08vSVezQ+r6+6cfZt8NJJARZrSzVfJR9YZeK4jy4VV/qhBRRIlZtfIgYnTd69LcQZjVIXBgwQLSGYh6RhGfo/AeIM4bLqLmx2kyDSxsDjG0/TewJ/cD0icGhT9QjLx+JRJ5nvQkBJXQVWUQII/qx+VQ60duEECn9jIVKVWsMyhyLJ9b4e9dHoVF+BcYjorKL78g8bRB/ogTtHEEwAIPHzQfgZ3lcAQyaOaoqDPpKK28DRXm5R2pt248Z59pg+zQePbf1GPCcD/XwjuiAgf0QOcKM/iPZjZrVe+b59Ui3He4B3/Vnwez6xCeJkVraAHTwWwacOaPMrJWOeG+PDE426MiSH9SUgbw+IPqtQuqfLxhes2Cf9qpFiLY+v2VNq5JMKpK/qFaO3fvcZi8Vj97yonLk0cxT2nMODIgWoaDqdZ3pKGblGAmAQoQU/vm7pV1we0fwID0r71gHcVER6bs2Blsc51gmf1Fhn1x0LLoBv1lEzLy62AbwawHhAKpHzRJ5AHJkthRzApvjmdeU7yTt8AFY19lQxGgyRdR59nHdRUDK4/+8Hts0dm0IMOpLKXVNrfd793HYBiRDRKDTPctrvtg8YwFbSN5vThPV8ufbHtpkhb5VwvgodgpUi/ACAobgM2hozGNvwszGzMauFe8mMOWpfnp0KfDkzdae3+8YplLSMWPkKjFtIij+SRdQyFOuRu/eviRHmPbVRxX7iyPmxoNPpsOK45FlD2D3cBpTEwj0c3mvjvPUc1R10Lor8lKxGbKEh4nE5NMFeekBor/dC2B5mt11XOboYClcGWMjXhmK3r4oTK/CyvdEfyoBetKRcy4U8NDV09fSz/LFRnqCzXCjcss7RyK+htQuGRFkvkLKPi67PhqzSMwpPA8W67SCoGEQ3ZGv3GjgTQQZYMPhYxF6XbS7vRu6Ymj7cnkCsUBWhR0CQdHMRJ2lIJgKLRnIWpy5/pBlywVY+60KtbNe/Ac7Hjf+sh+JVfQfT1zG+ZFH2xANJqRDEnSZ7IYHtMRyNHGbUZX70zuDjZ6OMNL0BFtz3jl2hRCB5TmNpNRRUAwYGTU6iQdCmu5rGbjHddVn0b7m9u/7gaamDCJGd3kdvMoLUMI2qqGMF321jllmkUsWX9yDe1MZ4R3PYReNaaibEEUdE7/QLTdcuWLiqXeDMEExdX4LQzxndw+Z70pMJGz5EktmylYHFWjaj4h5MhKh7oUqv1n1J4ptgprmOlRhugfc6Ng==
3
Correct.
Try again.
Incorrect.

Take Home Message

Now that you have decided to not invest in YOLO Inc.’s new product, it is useful to explain what your findings mean in everyday terms so that others can benefit from your evaluation.

Question 4.23

GeCQ0SVbTMzbpX036gpbZuU70sqj21fUZptT4HVQBEH06oJHNxKSrHo9Nx9WSRkq0aCXOJWiR5KBy84FnyCikPfsCtC5SSajjmudk58co1I2xsLX0eSMDB05eh0bFAbjPk1vQrrqNImMWAQOi+w0/sez0ui1nwvMt0+8YCGV7L5Px7NnjiSb9kHzm1YusHQ3TZ6lzX5E9i+77qwlwTNXnm9n7T+KdsdB/XzZXZ4J7ZlcvrKdXmmaOJbAsqNLwq1B7febGDq/kQpowcTnD5Pcjqe5tyLuuCorV9v5KIp3kGdJqylhVX8eDxZ2iGd/DmCoqLLajweo7zLqFFYtxEf7Bxn1w/aAMq7+YbRCxBbaij0RsT69NNAOhaGfbtaFzoc4ivTbGYVX9glAkNXl708Iv8ZsM77xU3eGQ3VWJmNeGXPMpp0Wue/ELxPz+SRIAJoAHDIOsLShGLITJsUrGhw33DEYBkP7hzYDAx2tF2uY3SDqw7izt5YL+RA+hSRr3QfIFRKvE1nMY2e94CeEjYj00+OhUt6/sAb0bPFUesX6J3RLwXupfFzsoDfdSyc84lnXaNM2nQf9zELLmEYPWv+Xn+rtPXIZZYXP6CkWuWXxOSUvUTATIRaRzJYpN1QNNx0e9Ytts9IwGPF4p+xNOWZ9x9ICaYe1Nmo3PdYJMHh2ioRdEbULDLqDDqTKzPqHve3hbYcwAUwi/ONIs3Wfh9WRnEI6UOWoH8gB7aSTyLnwGkJ1c2D+MUVWkoTMsLcjgpPwnx7wB7a+aDp2roquflttpyV16kUb4xZ8N+guOcbc+Ju4oH7Ljbz/8C8a+6X9L1ymej6BTeQYyJiofoQYcEkHpkk5vImo8EDAKyj0shx38pmwa5axVwOx1nCCsnKol1CFb9LSkZMYHMcyqEGEPFCV+qJLvFclXZ7ABKjrGxsxserGi0++ut6Te/iVvXmrStbZM0BqKaCmg+FPMz1zKJcwmwaRlJiDQcQKwFDRBcL5P7/EBN16YjlswW6x5W+vEdnKDDRItYCKltYwYVjidqGXiTBJKnNrsQXJoElUIrHX0UQm33id7uQco8W1RdpP7kcVp0+v3n+FgdHXr5Mql0OP41U7DdgfYVVDV/pxA/fFow/wd41fSrr7GFMnVVG7sWDCks/qglDs7IcCl3xSIonlwrCCmAAy147XQmmPvM3Xf6SyFF9X9z6B2PZYrnQZrCjCUhmcj8rrIJuQ2QevNpycgFLbn8j9eChdm4UOJwYru2miIfHJiP2vUKkERFBzgSJTF8flnTZGBnfFuzCHyLvHSCqZUi1DiVpTY5jL9tN6/Xjq1tEYWGvXVFEdqW/4h9EuI/ls+QRLMvQa0XKe4a4THw9zXmIczCGhV02UY5EyygWKEcVPM9OX8BOw/VKrFoemAGryPo1Htdgs0XZ3d3wCQC7xMtc1x8e36d5vk3wTL6HdAXHQTbxd3kgR2dEL+nNRoqxQKaXVqC4jXAeQ4qSJTzPTCse4DRyofPQN4VMdfXCthMNUMSpGv2jyuTPYmTw38dBto0vcs6AQVeTnRTAT6e+hbdt+W/OKWrCTOiRADBD+sNBegzi9C/eayVYonUpPfzl+C5ViOml4/CwkfIpSqYElznmjKCMnmVwX45hUFXo8/h2ccM/7RXnSJNqJReJjIRcZTcD0PJS97fqVtwYiVgZ/zRsxL3CHW3eTuvLO7ToUv3QMO9FBDX67lcPMQ4PrfyXeVHe0kuIDpPxU3+lTvpt9cRPLeU0LAPojgWHv+mkN0NyrcVj4KoLEAGYH+s62hr+HoBkG30bfc/PLd0Ga4PAEZE1BZBxPF68brdxai4+XAQuMzte+E+ByKQSRiLyn
4
Correct.
Try again.
Incorrect.

Next Step

Question

I81Xy4d+JWhYtphQtSBDcbChCKLnHqMGWBJAMo54v43TyToAmx4H2RJs/lS4ipDR+UWdrvPXmR5hykJYFZPXCRtYXA9jAWDn3yARqJxWiVXmLPbHzaMPlQWY2iA1cO8HnGOvMUsZU640mf7gOnekAVu0LrD4cr4N4T0UEjOBdlmeqIPMYyQHhOIcxkLWAurJpsAuNzFuxi+5AUYqY3EewEBV+y4OKo3f9ZZiM6bvkr6/neskjbKnal79zzk9YboCcBcFrHPX3onLb4kdEkQPiwSuamsZhTLhlI6J0oR6RT+kYgu9vrxdAE/ZzovO4tX6xnlh5bK3xhG79T3db6TWKDEhV8N/F0mnys3V07C26EBTB+XqijE+AlD4cRz678aMP9p3Gj+T+YcVwX8IG7/Ae4E8y1oL8/vglRCA+hEGTr5A8ogGpBaKavOZO+vHQNfExwrT5lLvfk9PS+7RE+QJjsUuHW4BfnHPPXyZHE5+ibyX8U/gXZQBE4CELq48Xa3hBN82UCIIpMKHkprvQ/JAu4glfOtXJcOPZ/Pp+vBSG/L9bAvxeXNfHcwupaHsSjSqXuklU7gyGFDSl4BnNiJ1AGv/U5Fos6PFPPkqC1Vi5ovSomcXCnTrxCnOaEwU9KdIERTOp+22WX2Gl0VOMNFXnSvsx5h1S9Rn4CHl7vHCxYHOjQrqNtRi275ZmNNO1N4b4REbXkv9aZnae4rsLsnGvim1LNpU5eJsGcEqc+53/8CjiGqczWjPz6Yis+B4t14Zg+CfvMTBODJHG6yGoC1QVeSUsRp27b3X

Your Turn

Before you can know whether something is a good measure, you first need to know exactly what it aims to measure. That is, you need to clearly define key concepts with an operational definition that describes exactly what a variable means.

Question 4.24

qtSju8+4NxrpecUZ0Cxm32DPWjdosnNpCbIAqhQZegpvKlqDYv/bSKDU9KttHQxdkoCpkIOQPZQ1ufKiwjXECCyt8KsqydqS5IHoBpG7LNg9bD2p7FmZt9XXnRgcuXh7OLTWhQlvwKj69QUWq1qhkW9RJDqxnoojFcopDUNaPTlhK1DV44L7arTAWFsFYrrQzeG369rhwnBIy9Z23YVsqzVOkcgyZEzHtnluWrRp3usAUFIJalp3ZmfspUW7XilNECoX31kC/5O/wXOBSPJDxs0lTrmpORY1mzCzjWs1AVcXfdHosahUajJETtfhSPF4bf5OmtJd1WVyT0iWdPdGNyjp+uf+/EXJLljvyy3t9b8BgXazEBDJq/QK/fWD9eENOPOyVjpR/PixEZQGpKfKGNvCD0C4In/GTregxDIhU5PfDf6T05M+mchsrLkxy8FfNWqSOoqfXQvmTcfP1p5qMPJk5RbQHpi3TRcyWB32uXbkGlQD7ZX7pMBY0B5GS69I1j8AwsBA4mH8yX3TYSjifUg355vLL9RlqJ2mBaeZuuDenz1HAhzlzduBtUsp6z8zQ2SoxYa45RxYTbE3cyTmidDFZok=
3
Correct.
Try again.
Incorrect.

Question 4.25

dRiuWAUvAvxRukrnEgDsAJ3A3E09c5IdAKDwW4nxXzMU+C/j9co4LaeJY+88qq+8BkKdIRlS95ocIFEPQ+trPlhJu0mp1GWNylaJOHMlYDtJ7y6gWp4UvW47UuEWruxahZQSpkDUWviVrddCwkyoEPrfZbZ04JoFHp06ELvXoFBmUU54wM0t570Iiopw4mODyxQJkIKBCOfvQHpuzyWgAmWZhtRKtD0/i3zA5wteCP7kfxpbBiGBdvL/Kk3Y/n2+P2s8jC4RuWhcxYnSOes+CA==
3
Correct.
Try again.
Incorrect.

Question 4.26

Ug+KFkeLVwyATtf6iqxdL1rMn6A9L8DA5CMpe9ZlMWBrSWSJ/OnyXk2yUesbp2sZAgwUzxgB0YENVc/5fVAaVSwZ6huaIjGlcN0Fvsx3a8r0vfFj78JW7bYDtttrRH+wRc0ZGuQc5zoUBf5gOcIHSqOG+BLsH2otfIIxd64U571HGytDwCyVGHavElaHBvWV0s4b3/wuos5YD/TMLSIsSWygfzg0g//tUcfmaEZkpi3brUdV1nOmh+pl2zLzHWtvE2Xvij5lpfKgHn58
3
Correct.
Try again.
Incorrect.

Your Turn

Question 4.27

B1LNuh2+IYgpN0Qt2jjePFELSuRYPJlmbyDsIXm+pw1oWURzc9IRee8A7eLO9GOL1s/Ckv2Wi3DfKiWDLROmlkF8PiGUf5doyp/buTV557bpggrewgh9/Yr2+UWFmndUfouDHEJbllq9OsStwwJ87A1D56Tc+A3vo5bNfX5/SBmf9gHwK9Hy7cAkYC25RPM0sm6YbEz8N5uuf0R1jUHsexOSp+nxyloH0Ch49VfM6TSjyAnXrDGLbbW3qlXd9xlr1vm1Vn2DWjFSPQ6HtMVNFQ3vt4pU6+6DYU6baCumxsMp/Ll1ydLTVTsTDj2D163FGMEtwWKWDAM=
3
Correct.
Try again.
Incorrect.

Question 4.28

ehnt+OoFsUQmDLTf3Mo99+hOM4zuVNOVRGUcJI2pXhlUo1V+E3n5Tk+8Q6b/dmQjpgMXVzrhcyD8/pc64SX3UjlowC1QGC+qSzef0uMxNFy+Thfp7Cr53io0xP45EiEOKQF4ll9A3sUmNZKE16H2ga5ISOW171yZrgHSoh/qeFiGmlYtz3+XG+S27ORMLLlzLIpnumANKgr9whnloJA7BQxs/3qFgMpPLNSJh5M1S5pRHHOlNRuj7tbr6+9NXn2jrDyLL01RoYTPKA5HxrQgg7Tj+YaWJ4e8+BccwHG8YfWW24jTrYZFyrnJFmBRlelk+2dRmXpUrcnY9drLLfg+Copb2YqanDTE401bsC2wufYeYhHypQZNwp5Y08g0eEQdPIz4VSYuiREuAQB1L/QomOOX4V1O5pP5vIPotm2Ls4lAuykRd7tAMYYejaiDGhQkI/5f85kMGmK3yVE2flea3h+6Jej77kP+ZzeqWnBdwTK1xeklcXXZUIsVoLm0yzCGAyCxgAHF1WWbolpeeSsX8yWPQlr2HyQKi5HrWiA8R5lqcRsikBw0kYkp+qG6oi261XQpGigGn3W4yZmJBG4bRIWK+iy+zNxShH6JGc5gGlUVKNpTPSjS7DXQv5vwPFf/trxKAaUn8TwpVhvS3kYMNiMu/UioTGnpV47xhGQZxnlIYOornevNxHVDIdIkOsRygHpLAGB9oVzTfjYmVQOMN05/heTrtcbBKnDwk3yKA/mgQWvLAa6DpdvVCY55nmSHAg3MB4q0Odw=
3
Correct.
Try again.
Incorrect.

Activity Completed!

Activity results are being submitted.