Chapter 1. Sampling: Is Everyone Else Having More Fun?

1.1 Sampling: Is Everyone Else Having More Fun?

SAMPLING: IS EVERYONE ELSE HAVING MORE FUN?
Is Everyone Else Having More Fun?
true
true
true
You must read each slide, and complete any questions on the slide, in sequence.

Welcome

Is Everyone Else Having More Fun?

Authors:

Kelly M. Goedert, Seton Hall University

Susan A. Nolan, Seton Hall University

Kaylise D. Algrim, Seton Hall University

As human beings, we’re pretty good at protecting our egos. Generally, we think we’re smarter, funnier, and more charitable than our peers. Unfortunately, we’re not particularly good at guessing whether those qualities result in an active social life. A series of studies looked at how people assessed their social lives in comparison to other people to see if they considered themselves to be social butterflies or social caterpillars (Deri, Davidai, & Gilovich, 2017). In one study, researchers asked participants to report how often they engaged in various social activities in comparison to other people. Here are two examples from the study – one on this screen and one on the next. If you were a participant, how would you respond?

Friends Exchanging Presents at get-together barbecue party
FG Trade/E+/Getty Images

Question 1.1

azwdrDw5XgfItfO5BpsdKYskPFGsgXFdLIpgiUs8UUELaQSoCf5ocboNmI4zgcyFC60ZG88NdbPX2B31uAiTZ4TxXgJ96h8t0sDUjDkibDN3PARmbRnFIL/N/FD0OYcA8DjJtJXWZNofO0ex+37ncxw5S0eS0B2CooO3G2WakNTXOXMkGbDk4NJFJTeZNRcae46SqiGSG8H7Hhj8ooVxCAFMRJW3C+rKW5boEMBM0ugh4lyLw9kG5Pkt/qj8h0kUfXzhDqFK4ukvAIez4Qsyg6TmujKla5yXLiPRoO4jmBOea6NEH0YTnjGMyXDeLRWV7UDu98aZwJ3PHemTkTbnuvBnqP1Rx2zDeFcqnEYxhXJI7G4DluR+Y099GAk75d6m6MLky3bA83FJsvYBGF7e+vIUDtOwC3pGpjVLbkcK+4EdPuGxYrXM8O8RKiz03cuoFBmzXTao/b3/5I2G

1.2

How would you respond to this second question if you were a participant?

Question 1.2

BQNxBHLAnk0WGzint7teb4Sv64p2k6QZE0Bq2eyr2B/gkNHMzh8yUL4wjQIuirWDhTLsFL+nRWPkrA05MHiHAF/D+a4zdh6hGYkMRqTLozDEzgE9DfNcVh251nWdA7GP+wA/thFWNcb5MNtvQOKD3klD8vJ6VJ0fqxAI0g/RmYN2Or2XgaK9vCVojy5WkyxfSWhUKkvynkhGxPETgZXRk6G1xlBlfWegaenfHUNutqZtSLipxQMDuzSVQUas2rIq65QlOoC1gqansnzzEUJ9k8Bh4PHWj6yCWlAg2IrjbMOHqw24rHV6HfZP+9lSRk0wuW+4v9RhSqgKqjMNHSgAHVK8QeW5IpRoIOlrFQHnP0nIyQyZHQMXvrofVNwlESYHAkhdKP3ZDA0ZbuJRef7C8EBkDbnQN9Ny3uy1wnzCnLGgy8kEyxDu5g==

1.3

In a series of studies, Sebastian Deri and his colleagues (2017) asked multiple groups about the number of friend groups they had and how often they attended different social events. They then asked participants how they thought their own numbers compared to other people’s: Did participants see themselves as less social, the same as, or more social than others?

Question 1.3

In the first study, the researchers reported that: “Three hundred four participants from Amazon’s Mechanical Turk (150 women; Mage = 37.1; 78% White, 10% Black, and 6% Asian) completed a survey in exchange for modest payment” (p. 860).

m6cZmQzruc18lmDw6L7aXwIb3JhoKIYjk7Vgf70lgT5dWeyVJX7MTqmTW/MxO0uatb9g1Tze5CvCyl7fpM65vIilhwclLdzaMYfjdE4QrkuK55uhq2loandrZEqZEkbuAAmjDsErsECLkZqo2Ec3pwFlqstxRWEMQmHeD4Xat+Y9ONFrY1My2/WQzezQbRgQKo34Lyq4M6tmIwrl3TK1sG5IJATwFCbwIppXaYDTimh/S65hulc97SYJHLRrpMtTeWror5BzZO+ncwLX1ZiByiJkoEcGUJIq3AZXm5B+Fh7VpC5AVtFaHqDpdA03Mu7rnaWsDw5H9WRhd27bEJs4iDMPaysV5N7briqI3M2hevbagV7XfFkqbyvo0SouUx/SaEB8Jp4Biz5TFG2WucTW8JCnYI2RBirOixbaY44eY7aP6+aMKMmyQW8bAJ9z52xsOcPfUmgZ6fk0Q2kkVkTMaXPzKRN/VyUGvKaJIeuXUv60pSz3XMeoK+pVxarQYVbTVI4Z6pLmKyHctqxEHXyhcyDqGR0AI28yZkQL/MNL8X65t1kJgHWPH030RW4ch9HCMipU7lI1Gzl6hnqfxJzRf9cDAYzXJwGA4dyEyE4vUDYLi1vQ3qOC7hK45ySzmrQoZ0MHF96mdN4KPzAtmKfowIrKwV41qDCGu02AHjO5Zb0=
Correct! Amazon’s Mechanical Turk is an online platform where people may sign up for a free account, provide basic demographic information, and participate in online surveys for monetary payment.
Actually, Amazon’s Mechanical Turk is an online platform where people may sign up for a free account, provide basic demographic information, and participate in online surveys for monetary payment.

1.4

Question 1.4

Here again is the description of the sample for the first study: “Three hundred four participants from Amazon’s Mechanical Turk (150 women; Mage = 37.1; 78% White, 10% Black, and 6% Asian) completed a survey in exchange for modest payment” (p. 860).

7mY9RnEZHa0a5bNrACF12ZjmKlpaWNSv2bF0d1glVJTv+XVR6sLE1Iikt4Z3ZZrZ2xQ67MgfVc9poRLcTxhaAJ84BVB7JqHYccqqVNVUZNoXG/21+d/D+eb924JgeMXPuzhemGL+uxmCHYygK/AuQJ6dEXW6Wh/XNCz5HiaRqMUuryqDMUF/mSHvR3YDCMwBuPH1uQlTNSPCm28rH8hdQOMPhVw=
Correct! Because potential participants must sign up for Amazon’s Mechanical Turk, this is a volunteer sample.
Actually, because potential participants must sign up for Amazon’s Mechanical Turk, this is a volunteer sample.

1.5

Here again is the description of the sample for the first study: “Three hundred four participants from Amazon’s Mechanical Turk (150 women; Mage = 37.1; 78% White, 10% Black, and 6% Asian) completed a survey in exchange for modest payment” (p. 860).

Question 1.5

4I+HKtSQA8+z5+3RA8gMfV9ThIMbyF47hk9Vz0fUB76OcNm1m7YkZxMbixq7U3y6ZddxKR8M6w1z9m2VDovMuYS9PMuz5Mv+g/ORejGu7rTc/KRxA8vmMeyRZ1tNBZovI+6GXPvn2/n6vFHxavJxHakeBSCPqT11Kxy9j9MyR68QseZVc5/Zl31PIf4xwIuk8lz2f7fnvMQGW++Jeuq2bHh3rX5kNHnAvO9D6E4PcXj761Zabc23m+SNrjjSvYWJrASfZauUr3omnJimTumOKt7q8XiKJbXeFtvoHiDzPvKA4I/mrREswR3L0gGu9HssxMuZFZ6kTfeGYwkcge1hQ6GbC97/svSVme/JJCXFU3JxHS2aIGXh2SlSdE/gnME9z2FFxX3SoYK9bRh7egzY+IEu3vmD1E08WMiuhJX+nu4ZNu4mrBtb59jGP1fiMTvx1Yb2yRaSRHqM0ZgWjbItJdjmlLHK6EAOEVH5FKJ1TVOLTueDP5faAXBssEYQWQ6ixA0ZvnyhhYIB6DKTkifDK9zglafeQ5k7L94CINRgKZgksuizZegcjOdq+3JE72+NsbescdU3Zj99tcESYR3noOyaddDNk2wkHGKBKvRAhhwoHhpjyECVf4Bf6sT6ABeMSNbfP+X8f34u3rfjThEftge1VjwUPbmXzwG6P8+0G7ACIIxgJEJQukXsCfOu5NDSqTz97R/fbAqrgAeEVg4S82Hz+s4zKnxn6H9iden3UJPoDiQ9viJ86aW2+oZMG/uAfQ9nrv9vmdw=
Correct! MTurk helps researchers recruit lots of participants quickly, and tends to result in a more diverse—and therefore representative—sample than many convenience sampling methods do.
Actually, MTurk helps researchers recruit lots of participants quickly, and tends to result in a more diverse—and therefore representative—sample than many convenience sampling methods do.

1.6

Here again is the description of the sample for the first study: “Three hundred four participants from Amazon’s Mechanical Turk (150 women; Mage = 37.1; 78% White, 10% Black, and 6% Asian) completed a survey in exchange for modest payment” (p. 860).

Question 1.6

9fcpKsn9m6YVsiIMl7GrccbPEkoymz8rLbuWV5BTpd1HdPU5GnGyW1OMPfIzoJ/Dd/3jkfOVGolVMz8gsNsPu2penQMMKev08nXxdm5p3Mo1N0OAiFeKbI1F+NFkoSxLLIqG0W3Mbxakncu3s4wFyaPMt64f+kIhYZJRjhz2QN9iutNu4xsAVT7ChMN48yQGuxuX6fo5E5bKke6YKyG935Auk/DnlS2LumjSuS6rrKW6/K3w6sORhTvYLZx5IgSqV/nIYyA53WXcUqR4hGV6kdOhVcYPmQ2mzsbRj7wRd5CCF0gx4PzACeoGkQYfOp/ukmLSDGzQp+siKqwqSiCf0KjEMFS/w24AEZSVeRCkdE4TupxTB0q9Ca4fcp0wK3Ee8kiq6s/JGe6c+uYofabuzowRotcco+x9j+RfdCpPR5d5JIx3fbSulofw3UoNfUfbZcGBFzg9fo2PErTxy69L7coOtKNwayE9dIi2/5e824sC7HTAWCU7S09zydHChJ6XbixFOyEfT9/0no4/IfMSqq2Ea1D758oD+nHwngczsijh0Dz+Amu13X9SuiMo70npVbytIrqsy3NjRLZL/S4nOugwoitjH6okQg6amLIPWrGX9rRy4GC1lSEKQD4Y7BBHWwKdgkAo3SxRjRQAckn1c80mum2gXwZsj/vN28cX1M8X29AfGyAaXwxbB8nrJXHLhiObcYcg/8mkb0PPe4EEWSyXjp9Ednzih5SMHHVquPYEZjVjll6aGoWP4YkoUUNVG9YJjKoKSHsxUxa24N84dXImlxIOhmWfZ+MDFpYiWPsa3vAwMVWRU8ZaUkYP2LVH56TQUO3dfg9D3in2XrCb6ddxgKVsLMopc38FFeZcVKgFAVKhXFpr72lAxcA=
Correct! MTurk does not automatically share data with other researchers. It has, however, been criticized for all of the other reasons listed here.
Actually, MTurk does not automatically share data with other researchers. It has, however, been criticized for all of the other reasons listed here.

1.7

Here again is the description of the sample for the first study: “Three hundred four participants from Amazon’s Mechanical Turk (150 women; Mage = 37.1; 78% White, 10% Black, and 6% Asian) completed a survey in exchange for modest payment” (p. 860).

Question 1.7

B3Vnrb+hnjYMxMzHxg2ByMZMC/kS4mgsJRNgTK+//N8Sw7LX3zIqt8hRAVW61rFcMlsxnrNLziwwz2TstzAR6yHjLS2TLbMtUoXmuk4ehv2jcsTe2X6UKVzz3rJgQ8s0CTlp1jLrrYBfl1BXYUArMgiw2awCy8AzuUtjT7lN9uN159YPDFGhSEUJwZJiuRjhyyKZbBNNCR2QNUVSz+uXIwiwPdjrzcuJv42KZvLzzdLiBrgbAfdP3muadrqh+dZEBXYzapW7c3cvJpJueSSYbau6ze6I88Jurm/UxgkDIJJUptzRsCKlbwoGx7Cni0awvSYB4MZPl8bt/XIGdB9xeUF7W/0mLLiyGG+BQn84YF6mm0AZEHCFYHAKZiU9cCLskIL4Dm0rLd1KaRPq8MVva55jLHhLYzh6LUL5LlK9Ue3Q8K01uKgKKFv34u32yvDiTuiRSymLx+MtqaMsn9PNt7YgqozujVIrurPeOhRBFFqSXewyObGegabTn1CfPFWENW0N1Q==
Correct! The symbol M refers to the mean.
Actually, the symbol M refers to the mean.

1.8

In the first study with MTurkers, the researchers found that their sample, on average, saw themselves as less social than other people on every item they measured. However, the researchers also noted other research suggesting that MTurkers may be less outgoing than people in the general population. For this reason, they used other samples as well. They summarized the different types of samples they used in their study as follows: “In 11 studies, we examine whether people believe that others lead richer social lives than they do themselves. We begin by directly asking Mechanical Turk respondents (Study 1), shoppers at a local mall (Study 2A), college students (Study 2B), and respondents from a large, income-stratified panel (Study 2C) whether they believe their social lives are less rich and active than those of others” (p. 860).

Question 1.8

For Study 2C, they further clarified: “Data were collected using an online survey agency … that commissions large-scale stratified samples by recruiting participants from a wide array of sources on the web” (p. 861). (Note that “income-stratified” means that the agency explicitly recruited participants from across a range of incomes.)

Y/9E+ol86tPYLGPtU59dfhqmjMlR5INWkJ+erLt5tZp3K6zklXyF57LyPej0I5L9JSRO0YZPyuYXPUvdlitSdx8hMx5I9hOZBNJMMXkX3KZP7LthIFvyKsQiHh7Qnb1na7OKQWeHt+FwoNTzhB6PcloudCHxpmZa64rZREChihWS3Gh+Qomr8cLNFuhHKlJAmksQ+fzVo4gMZynETAGsJgjluHxn+UHq8gbH986Ei5ybrfwUT7v32a+7zdxKKY5jJB5H+j+cm31ZhdzxyyJQGg==
Correct! The large, income-stratified sample included participants from a range of incomes and recruited them from a wide array of online sources. The MTurkers, shoppers at the mall, and college students are all less likely to be representative of the general population.
Actually, the large, income-stratified sample included participants from a range of incomes and recruited them from a wide array of online sources. The MTurkers, shoppers at the mall, and college students are all less likely to be representative of the general population.

1.9

It wasn’t just the MTurkers. Participants in all kinds of samples tended to see themselves as less social than others. Let’s look at another sample that the researchers used in the series of studies: “Three hundred one participants from Amazon’s Mechanical Turk (137 women, Mage = 37.44; 77% White, 9% Asian, and 7% Black) participated in a preregistered survey (https://aspredicted.org; #3311) in exchange for modest payment” (p. 867).

Question 1.9

H+NtoaeSjRaSTcb0YxIZwxZPjrtWiR1LBCLHNA35/rQEWzkw9pqQtbvkGnao+6+p09lBXndO+h7chGzpRUevbn+XsL+Lg/BRXyvgE1tA073yd+y9/d7gO3uxHfyqo+Ab6k2NO1ccAfgnwsWNfqbv/lsG2B5d7wU1xItx9S9yixZXHXY8ZHMakgePdWdJaGG9YVB/U9A/GOtgKYRIVPHsTh/IBDQsgRwo2dwkIGhY5CGw1/L4FFkUmbe79/Tjh2JQsRzv7eJAyspdbaDt/ZTOBKHayaySUpyVH+/tsG+JbZsCZFvemLdKdl2mkLKucT1vukFk/RECWQ1ILfBDBuvGfeFj1afcCYaETSvKkPVH1/BApgNC7iJzdzpmODjH2yTfnOabodp24ktqBqfSZX4XQxY0s8Wbz+Q8RM6nJXiXvHy1MBAwurmvEdUlp5wz7zlToY5dXSkeQoYWA7QRPvQcx1reHIAtrFPJlbNOz5F2vWp72J1bvf8BOWR+76P64/WTjd6927Gv/9QblabC5un926m77n0KEW6HTGNLAMK7BYznVPrY9Wxc82D+n724SjN+eRe8y0TmMTJMuPA8SDO9rU4Xm2Z/JR8NvN+opLjD2CHGKXQldqFlGzo1BnK1XTtBQUuYUVxmRmKc9PVeO1IkM0Dt5YBgkCT+t0pRueKkqjDzBf64sXPfRPBEh/C66JZ/aVCmTSqbOZlQOgkDcyOFB0lBFYzdNktbBusYD5bCX4GSrSd1kTnsGoif4EF1j66aiPnCy0ghkeZ2vUBUAovIpHF6yOrHGcNI4/W75czhJ0F5Ue8v5bmw0Q==
Correct! Preregistration is an open-science practice in which researchers outline their research design and analysis plan so they can’t change it later. And yes, this study found the same results. The researchers reported, “Once again, we found that participants thought their social lives lag significantly behind their peers” (p. 868).
Actually, preregistration is an open-science practice in which researchers outline their research design and analysis plan so they can’t change it later. And yes, this study found the same results. The researchers reported “Once again, we found that participants thought their social lives lag significantly behind their peers” (p. 868).

1.10

The bottom line: No matter the sample, people tend to believe they are less social than others. So when you feel as if you’re the only person at home reading a book, remember there is more to life than what you see on social media.

Woman texting with cell phone at laptop on dining table
Hero Images/Getty Images

REFERENCES

Deri, S., Davidai, S., & Gilovich, T. (2017). Home alone: Why people believe others’ social lives are richer than their own. Journal of Personality and Social Psychology, 113, 858–877. https://doi.org/10.1037/pspa0000105