Think Like a Scientist
Employment-Related Personality Tests
By:
Susan A. Nolan, Seton Hall University
Sandra E. Hockenbury
REFERENCES
CareerBuilder. (2012). Thirty-seven percent of companies use social networks to research potential job candidates, according to new CareerBuilder survey. Retrieved from http://www.careerbuilder.com/share/aboutus/pressreleasesdetail.aspx?id=pr691&sd=4%2F18%2F2012&ed=4%2F18%2F2099
Employment Personality Tests. (n.d.). Retrieved from http://www.criteriacorp.com/solution/personality.php
[Home page]. (n.d.). Retrieved from https://www.calipercorp.com
King, Joe. (2012). Facebook beats personality tests for predicting job success, NIU management professor finds. NIU Today. Retrieved from http://www.niutoday.info/2012/02/20/facebook-beats-personality-tests-for-predicting-job-success-niu-management-professor-finds/
Kluemper, Donald H.; Rosen, Peter A.; & Mossholder, Kevin W. (2012). Social networking websites, personality ratings, and the organizational context: More than meets the eye? Journal of Applied Social Psychology, 42, 1143–1172.
Morgeson, Frederick P.; Campion, Michael A.; Dipboye, Robert L.; Hollenbeck, John R.; Murphy, Kevin; & Schmitt, Neal. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729.
Society for Human Resource Management (2011). Personality Tests for the Hiring and Promotion of Employees SHRM Poll. Retrieved from http://www.shrm.org/research/surveyfindings/articles/pages/shrmpollpersonalitytestsforthehiringandpromotionofemployees.aspx
FAQ
What is
Think Like a Scientist?
Think Like a Scientist is a digital activity designed to help you develop your scientific thinking skills. Each activity places you in a different, real-world scenario, asking you to think critically about a specific claim.
Can instructors track your progress in
Think Like a Scientist?
Scores from the five-question assessments at the end of each activity can be reported to your instructor. To ensure your privacy while participating in non-assessment features, which can include pseudoscientific quizzes or games, no other student response is saved or reported.
How is
Think Like a Scientist
aligned with the
APA Guidelines 2.0?
The American Psychological Association’s “Guidelines for the Undergraduate Psychology Major” provides a set of learning goals for students.
Think Like a Scientist addresses several of these goals, although it is specifically designed to develop skills from APA Goal 2: Scientific Inquiry and Critical Thinking.
“Employment-Related Personality Tests” covers many outcomes, including:
This activity invites you to test the claim that personality tests can predict how well people will perform in a particular job. First, you will think about personality tests you have taken—or if you haven’t taken one, you can try one. You will then examine evidence about whether tests like these are useful predictors of job performance, and you will compare this against employers’ use of a different source for hiring-related personality information—social media. You’ll evaluate an alternative explanation for situations in which personality tests are less accurate in predicting job success. Finally, you’ll consider whether companies that sell hiring-related personality tests are good sources for information about the effectiveness of the tests they sell.
1
Identify the Claim
When applying for a job, have you ever been asked to take a personality test? Approximately one in five U.S. companies reports using personality tests to aid in hiring decisions (Society for Human Resource Management, 2011). Given their widespread use, it makes sense to ask whether pre-employment personality tests work well as a hiring tool. Are they effective predictors of job success?
Because you may be asked to take a pre-employment personality test one day, it’s important to understand what these tests are and how they work. You learned about empirically supported tests in the section “Self-Report Inventories” in your textbook. Self-report inventories, also called objective personality tests, help to differentiate among people based on specific personality characteristics, such as how outgoing or conscientious people are. Your answers are compared to standardized norms that are based on the answers of a large group of people. A typical test might ask people to rate themselves on various dimensions of behavior or psychological functioning—for example, “I feel comfortable around people” and “I start conversations.”
Have you ever taken a test like this? If you haven’t, try one or both of the personality tests linked here:
Not all personality tests are based on research on personality, however. Some companies develop tests on their own. Others unwittingly use non-valid tests. You’ve probably taken a test like this before, perhaps in a magazine or online. If you haven’t, Google one and try it. There are some really goofy ones out there if you search for “personality test” and “what kind of ______________ am I?” Fill in that blank with “cartoon character,” “dog,” “car,” or even “fruit”! Just about anything you can think of will work. These tests are fun, but unlike empirically supported tests, they have not been shown to provide accurate information about personality.
How will you know if the personality test an employer gives you is a good one? You might not know. Companies rarely share such information with applicants. Bottom line: Always be yourself and take the test seriously. Personality tests often have built-in checks—questions that verify you’re answering consistently and honestly.
What’s the point of a pre-employment personality test? There’s no good reason for using a non-valid test, like one that tells you what kind of fruit you are. But what about an empirically supported test like the California Psychological Inventory that you learned about in the chapter on personality?
Many companies advertise the use of evidence-based personality tests to hiring companies. Let’s identify their claims. For example, Caliper, with 28,000 client organizations worldwide, claims to use data measuring personality and other characteristics to help employers figure out “which candidates have the greatest potential to succeed” (https://www.calipercorp.com).
Similarly, Criteria, whose clients include Allstate Insurance, Domino’s Pizza, and Harley-Davidson, states:
Personality tests are intended to describe aspects of an individual's character that are relevant to their job performance…. Does a candidate have behavioral traits that are statistically linked to success in this job? (http://www.criteriacorp.com/solution/personality.php)
2
Evaluate the Evidence
So, is the claim true? Can the outcome of a personality test really predict job success? Thinking like a scientist involves considering all of the available evidence. There has been a lot of research on this topic, but it’s often quite contradictory (Morgeson & others, 2007). Reviews, which are journal articles that describe a number of studies on a given topic, can help us to come up with an overall conclusion about a body of research. So, let’s look at a review on personality tests and hiring.
One team of researchers reviewed more than 7,000 articles on personality testing (Morgeson & others, 2007). None of the researchers has a stake in the companies that sell personality tests. So, they are objective in their review of the data.
The team drew two main conclusions in their review. First, it is impossible to prevent people from faking their responses on personality tests. If you went online to take one earlier in this activity, did you find yourself tempted to respond in a way that would help get you hired—even if you had to fake it?
Below are questions that might show up on a pre-employment personality test. If this were part of a real test, you would indicate how strongly you agreed or disagreed with each statement. For this activity, however, indicate for each item whether you would definitely tell the truth or would be tempted to stretch the truth.
The team of researchers also concluded that personality tests are just not very good predictors of job performance. This was demonstrated, for example, when tests identified people as “good fits” for a job, but these people did not later receive positive supervisor ratings.
If you went online earlier to take a personality test, did you feel that your results would be useful to an employer? Despite claims to the contrary, research does not support the usefulness of personality tests for hiring—even when they are “good” tests based on the research on personality. As much as we’d like them to be, personality tests are not some kind of crystal ball that lets us see secret check marks or x-marks over the head of each candidate.
In fact, personality tests are so poor at predicting job success that social media might be a better option. According to one survey, almost two-fifths of companies use social media when making hiring decisions, about double the number of companies that use personality tests (CareerBuilder, 2012). So, how useful is this tool to companies?
In one study, students completed personality tests and allowed their Facebook profiles to be quickly evaluated by trained raters (Kluemper & others, 2012). The students and raters tended to agree about the students’ personalities. Six months later, researchers received performance evaluations from students’ bosses.
Are you surprised that employers look at candidates’ Facebook and other social media when making hiring decisions? After all, an employer can run into a lot of problems with that tactic (Kluemper & others, 2012). Click each category to learn more.
Legal problems:
Social media could contain information that an employer is not legally allowed to use in hiring decisions, such as details about a candidate’s race, disability, or family status.
Reputational problems:
Companies might develop a negative reputation for using candidates’ social media as a resource for hiring. Some people find the practice intrusive. Others resent the lack of any opportunity to address concerns.
Problems with equal treatment:
Companies routinely gather the same information from all candidates—for example, résumés and recommendations. But not everyone participates in social media to an equal degree. Use—or non-use—of social media could put some candidates on unequal footing.
Regardless of the problems with personality tests, twice as many companies use social media as use personality tests when hiring. Let’s see how this might work. Imagine you’re an employer who wants to hire a server for your new upscale pizza restaurant. What kind of person do you want to hire?
Now look at three fictional social media pages for your pizza server candidates. These appear below and on the following two screens. What is your gut reaction to each profile? For each person, write a sentence about her personality in the essay box below her profile. (Click to enlarge the profile image. You can click a second time to enlarge it more. You’ll then have to return to the main screen.) What was it about the page that led to your conclusion about her personality?
Based only on your sense of their personality from their social media pages, which of these three job candidates would you hire? Click the box below your choice.
You wrote:
New Paragraph
Hire
You wrote:
New Paragraph
Hire
You wrote:
New Paragraph
Hire
3
Consider Alternative Explanations
With so many problems surrounding the use of social media as a hiring tool, it was surprising even to the Facebook researchers that it outperforms personality tests (King, 2012). When research findings are surprising, a scientist will consider alternative explanations.
Why might personality tests not be as useful as hiring organizations think they are? One reason is that, as we noted earlier, people sometimes give false information on personality tests (Morgeson & others, 2007). As the lead researcher on the Facebook study said: “Personality profile questionnaires are subject to people providing what they think is the socially acceptable answer. It’s harder to do that on Facebook—your friends will call you out” (King, 2012).
Another explanation has to do with how well personality test questions connect with the qualities that companies seek. Some questions may be flawed (Morgeson & others, 2007). For instance, one item asks respondents whether they see themselves as having “leadership qualities.” But what does that mean? Someone who is an effective leader in one context—the leader of an orchestra, for example—might not possess the qualities to lead in another occupational setting—say, as the captain of a fishing boat, or as a kindergarten teacher. If the employer and the respondent are not thinking about the same personality characteristics, the question is meaningless.
This problem prompted the review authors to caution against using personality tests at all when hiring employees, unless the questions are directly related to the job requirements (Morgeson & others, 2007).
4
Consider the Source of the Research or Claim
What sources do employers turn to when considering whether to use a personality test? Often, it’s the companies that sell these tests. Both of the hiring assessment companies that we described earlier refer to research supporting their claims. Caliper’s Web site cites “prestigious publications” that have featured their work (https://www.calipercorp.com), and Criteria’s mentions their “Scientific Advisory Board, which is made up of leading psychologists and test development experts” (http://www.criteriacorp.com). But how can these companies talk about their grounding in science if personality measures haven’t been shown to be effective as hiring tools?
Science, when taken piece by piece, is often contradictory. It is only when scientists look at the fuller picture across many studies that a consensus starts to emerge. Remember that there is a tremendous amount of research on this topic—more than 7,000 articles! If you only look at some of the research, you might get an incomplete picture.
It’s possible that people marketing pre-employment personality tests are aware of negative reports, but ignore them. Their goal is to market the test, so they focus on good news. It’s also possible that they are subject to confirmation bias; that is, they may notice the studies that match what they believe about their tests and fail to notice those that do not. The bottom line: When there’s money involved, always look at the big picture made up by many studies, not just what is highlighted by those who stand to profit. Only then can you see the broader story the science is telling.
Assessment