You must read each slide, and complete any questions on the slide, in sequence.
Basic Research
Research dedicated to expanding the existing knowledge on a topic.
Applied Research
Research dedicated to solving a problem and helping people by improving quality of life.
Program Evaluation
Using the scientific method to assess whether an organized activity is achieving its intended objectives.
Survey
A quantitative research strategy for systematically collecting information from a group of individuals, which is then generalized to a larger group of interest.
Experimental Design
A design in which the experimenter controls and manipulates the independent variable and makes comparisons among the different levels, allowing the establishment of cause-and-effect relationships between the independent and dependent variables.
Naturalistic Observation
A technique of data collection in which the researcher observes events as they occur in a natural setting.
Open-ended Questions
Questions participants answer using their own words.
Closed-ended Questions
Questions participants answer using a predetermined set of response options.
Descriptive
Describes what is happening.
Inferential
Tests a specific prediction about why something occurs.
Programmatic Research
A systematic and planned sequence of related studies where subsequent studies build directly on a previous study’s findings to provide a more comprehensive understanding of a phenomenon.
Survey
A quantitative research strategy for systematically collecting information from a group of individuals, which is then generalized to a larger group of interest.
Two-group Design
An experimental design that compares 2 groups or conditions.
Factorial Design
Any experimental design that has more than 1 independent variable.
Independent Variable (IV)
The variable that influences the dependent variable. In experiments the researcher manipulates or changes this variable.
Dependent Variable (DV)
The variable measured in association with changes in the independent variable; the outcome or effect.
Likert Scale
A scale where a participant evaluates a series of statements using a set of predetermined response options.
Acquiescent Response Set
A response bias where a participant tends to agree (or disagree) with most, if not all, of the items on a scale, regardless of what it is asking.
Experimental Hypothesis
A clear and specific prediction of how the independent variable influences the dependent variable.
Confound
A variable that the researcher unintentionally varies along with the manipulation.
Focus Group
A data collection format where several participants, typically strangers, gather together to discuss a topic.
Experimental Design
A design in which the experimenter controls and manipulates the independent variable and makes comparisons among the different levels, allowing the establishment of cause-and-effect relationships between the independent and dependent variables.
Multigroup Design
An experimental design with 3 or more groups.
Qualitative Research
A generic term representing a variety of methodologies that focus on obtaining an in-depth account of participants’ perspective of their own world and their experience of events.
Quantitative Research
A generic term for methods that seek to objectively examine associations between variables, predict outcomes, and make comparisons.
Interview
A data collection technique where the researcher elicits self-report data directly from the participant.
Narrative Analysis
An examination of first-person stories of one’s life that the researcher analyzes.
Content Analysis
An analysis technique that involves the systematic analysis of communication where researchers organize responses in order to summarize the substance of the communication.
Conversation Analysis
An analysis technique that involves an examination of the natural patterns of dialogue that focuses on features such as turn-taking, gaze direction, and how speakers sequence speech.
Repeated-measures ANOVA
A statistical test used to test a hypothesis from a within-subjects design with 3 or more conditions.
Using Research in the Real World
In this activity, you will complete a comprehensive review of the research skills you have developed as you help a candy company make informed decisions about a new product they would like to introduce to the market.
Dr. Natalie J. Ciarocco, Monmouth University
Dr. David B. Strohmetz, Monmouth University
Dr. Gary W. Lewandowski, Jr., Monmouth University
Something to Think About...
Scenario: You are a junior market research analyst at a firm that has just landed a large account with a candy maker. The company’s most popular candies include mint- and peanut butter-coated milk and dark chocolate pieces. Based on informal customer feedback, the company has decided to introduce a fruit-coated version of this candy, but they are unsure which fruit flavor—banana, cherry, orange, passion fruit, raspberry, or strawberry—would be most successful. It is up to your marketing team to help the candy company determine which fruit flavor would be best to add to their chocolate selections.
FADEDinkDesigns/Shutterstock
Something to Think About...
Rawpixel.com/Shutterstock
Basic Research
Applied Research
Program Evaluation
Although we might think that the sole purpose of research is to help us gain knowledge of a topic (as in basic research), we can also use our research skills to solve practical, real-world problems (applied research) that may not immediately seem relevant to the field of psychology. Program evaluation is one example of how you can apply your research skills in a real-world setting. Another example is market research, which involves the gathering and analysis of data about issues relating to marketing products and services. People that work in this field combine aspects of psychology and business to study the best way to attract a customer to a new product. There are many ways to use your research skills to make a difference in peoples’ lives!
Our Research Question
Jesse Kunerth/iStock/Getty Images
You want to be sure your marketing team has a clear goal for this project, so it is time to determine your research question.
Now that you have a research question (“Which fruit-flavored chocolate would be the best to develop?”), you must decide which type of research design will best answer your research question.
Your team has decided to use a survey with closed-ended questions to collect information about potential flavors. You plan to list 6 fruit flavors that the candy maker can create and ask participants to rate each flavor on a rating scale. These flavors are banana, cherry, orange, passion fruit, raspberry, and strawberry.
Using your scale, participants will consider the 6 fruit flavors that can be combined with chocolate and rate their liking of each flavor based on 5 response alternatives. Each response alternative will be assigned a numerical value, which you will use to summarize the likeability of each flavor. Higher values indicate a more positive response to the fruit flavor.
1
2
3
4
5
Like not at all
Like a little bit
Somewhat like
Like quite a bit
Extremely like
Developing the Survey
Lev Mei/iStock/Getty Images
Now that you and your team have created a survey to assess preferred fruit flavors to combine with chocolate, you begin thinking about what information would help the candy company market its new product.
You work with the computer programmers at your company to set up your online survey and send invitation emails to a list of 2,000 people who previously said they would participate in research for your company. You review this list ahead of time to ensure the participants represent a wide range of ages, socioeconomic statuses, and geographic locations.
After giving their informed consent and confirming they are 18 years of age or older, the participants rate their liking for each of the 6 flavor combinations, report their age category (based on age groups your company generally uses for market research), and report their preferred form of chocolate. You close the survey after 2 weeks and find that 900 of the 2,000 people contacted completed the survey.
Analyzing the Data
This is an example of what your data set would look like. The top row shows the variable names; the other rows display the data for the first 5 respondents. In this data set, the labels for categorical data are displayed.
Participant
Age Group
Banana
Cherry
Orange
Passion Fruit
Raspberry
Strawberry
Candy Type
1
18-30
4
4
2
2
4
3
Pieces
2
56+
2
5
3
2
5
4
Fun-size
3
31-55
3
5
3
3
4
3
Full-size
4
56+
2
4
3
3
4
4
Fun-size
5
18-30
1
5
3
2
4
3
Pieces
Analyzing the Data
Ines Koleva/E+/Getty Images
Now that you have collected your data, you must decide the best way to summarize your findings. The decisions you made about how to collect your data dictate the statistics you can use with your data now. First, you need to consider if your study is descriptive or inferential.
Congratulations! You have successfully completed Part 1 of this activity.
KMGS Photography/Moment/Getty Images
Your work on this activity has been saved until you are ready to proceed to Part 2 of the activity.
Something to Think About…
FADEDinkDesigns/Shutterstock
Programmatic Research
Scenario: The work you completed with your team leads your client to develop 2 new candy-coated chocolate flavors (raspberry and cherry). Once the candy is manufactured, the candy maker returns to your marketing team and asks for further help. While they believe both products could be successful, they are only interested in launching 1 of them next year. Per your advice, they ask your team to determine which flavor customers would prefer more. Now it is time for you to delve into programmatic research!
Our Research Question
Jesse Kunerth/iStock/Getty Images
A new research project means your team needs a new research question.
Now that you have a research question (“How does flavor influence likeability of a candy-coated chocolate?”), you must decide which type of research design will best answer your research question.
You already know that the groups in your two-group design will be based on your previous recommendation to the client: One group will taste-test raspberry-flavored chocolate candy pieces and the other will taste-test cherry-flavored chocolate candy pieces. Before proceeding, however, you need to specify the exact nature of your dependent variable: candy likeability.
To gauge what people think, your team decides to create a self-report measure with closed-ended questions to assess various aspects of the candy. To accomplish this task, you develop a Likert scale with 5-point response options (1 = Highly Disagree to 5 = Highly Agree).
For your measure, you will ask participants to indicate how much they agree or disagree with 5 statements about the candy fruit flavor they tasted. Your next step is to develop these statements. The key is to have 5 high-quality items that address the likeability of the candy. To avoid an acquiescent response set, we will add at least 1 reversed item.
Acquiescent Response Set
Based on a quick literature review on taste sampling, you decide to have participants indicate how much they agree or disagree with the following statements:
I like the taste of the candy.
I enjoy the texture of the candy.
I like the appearance of the candy.
I dislike the taste of the candy.
Overall, I like the candy.
Determining Your Hypothesis
lculig/iStockphoto/Getty Images
Now that you have determined what you will manipulate and measure, you must formulate an experimental hypothesis.
With your sample, hypothesis, and variables in place, it is now time to think about conducting the study. You need to control the data collection process as much as possible. You also want to be sure your study eliminates any confounds.
After giving informed consent, participants taste 1 of the 2 flavors—as determined by random assignment—in a private cubicle. They are instructed to sample 3–10 pieces of candy to answer questions about the candy. Regardless of the flavor, all candy pieces are the same size, shape, and color, and are presented in the same disposable bowl for each participant. Once participants feel they have sampled enough of the candy, they complete the self-report measure. When participants finish, they are thanked for their time, debriefed, and released.
You are able to recruit 60 participants from the shopping malls to participate in your study. It is time to see what data from this study might look like.
Image Source/Photodisc/Getty Images
Example Data Set
This is an example of what your data set would look like. The top row shows the variable names; the other rows display the data for the first 10 participants.
In the “Group” column, a 1 = Cherry and a 2 = Raspberry. The other columns represent responses to each item on the survey.
Participant
Group
Enjoy_taste
Texture
Appearance
Dislike_taste
Overall
1
1
5
4
4
1
5
2
2
2
2
3
4
2
3
2
3
3
5
3
3
4
1
4
5
1
2
5
5
2
2
1
3
2
4
6
1
5
4
3
2
4
7
2
1
2
4
4
3
8
1
3
3
2
3
4
9
2
4
3
4
5
1
10
1
4
2
2
1
3
Selecting the Proper Tool
Ines Koleva/E+/Getty Images
Now that you have finished running the study, you must decide the best way to analyze your data. The decisions you made about how to collect your data dictate the statistics you can use with your data now.
Each participant’s overall likeability score was calculated by first reverse-coding the “dislike taste” statement and then taking the mean of the ratings for all 5 scale items. This score is the dependent variable you are testing.
Congratulations! You have successfully completed Part 2 of this activity.
KMGS Photography/Moment/Getty Images
Your work on this activity has been saved until you are ready to proceed to Part 3 of the activity.
Something to Think About…
FADEDinkDesigns/Shutterstock
Scenario: Based on your team’s recommendation, the candy maker is almost ready to go into production of the cherry-flavored chocolate. But 2 issues remain: due to the ingredients required, the cherry-flavored chocolate is more costly to make than other flavors, and the color of the new candy is yet to be determined. For your client to achieve success, consumers must be willing to pay a little more for this flavor, and they must be able to distinguish this flavor from the others. To address these issues, your research team is asked to step in once more.
Our Research Question
Jesse Kunerth/iStock/Getty Images
To ensure the team stays on track, it is time to determine a new research question.
Now that you have a new research question (“How does the color and price of the candy influence its likeability?”), you must decide which type of research design will best answer your research question.
After talking to your client, you discover that they are considering 2 colors for this product: a solid rose color and a swirled pattern of light brown and rose. The coloring process for each is of equivalent cost to the candy maker.
In addition, you learn that the candy maker sells their current flavors of candy pieces for 99 cents, but is hoping consumers will be willing to purchase the new product for $1.25 in order to make up for the more expensive fruit-flavored ingredients.
Below is a visual depiction of this study design. Participants will be randomly assigned to 1 of 4 conditions, or combinations of independent variables.
Color
Rose
Swirl (rose and brown)
Price
$.99
Condition 1
Condition 2
$1.25
Condition 3
Condition 4
Identifying and Operationally Defining the Dependent Variable
Now that you have determined what you will manipulate and measure, you must formulate an experimental hypothesis. Because we have multiple independent variables, we will also need multiple hypotheses.
In this phase of the project, your client is not expecting any particular outcomes, and just wants to use empirical research to make an informed decision. However, your team believes that people will prefer the candy when it has the swirled rose and brown coloring over the plain rose color, as past research you have conducted indicates that people like novel things better. Your team also expects people will like the candy more when it is priced at 99 cents, not $1.25. Additionally, you expect that the combination of swirled color and 99-cent pricing will significantly increase likeability compared to all other combinations.
Finding a Sample
Caiaimage/Robert Daly/OJO+/Getty Images
Before you can conduct your experiment, you need to determine exactly whom you want to study and where you can obtain this target sample. You are again interested in the average consumer, so you head back to the mall to collect your data. Like before, you will conduct the study at various locations, on various days, at various times to be sure you have a diverse sample to represent your population of interest (chocolate candy consumers).
After giving informed consent, participants taste candy in 1 of the 2 colors—as determined by random assignment—in a private cubicle. They are instructed to sample 3–10 pieces of candy to answer questions about the candy. Regardless of the color, all candy pieces are the same size, shape, and flavor (cherry), and are presented in the same disposable bowl for each participant.
Also as per random assignment, there is a sign next to the candy bowl that states whether the price of the candy is 99 cents or $1.25. The prices are written in the same font and size. Once the participants feel they have sampled enough of the candy, and have looked at its price, they complete the self-report measure. When participants finish, they are thanked for their time, debriefed, and released.
Collecting Data
Image Source/Photodisc/Getty Images
You are able to recruit 120 participants from the shopping malls to participate in your study. It is time to see what data from this part of the study might look like.
Example Data Set
This is an example of what your data set would look like. The top row shows the variable names; the other rows display the data for the first 10 participants.
In the “Color” column is the color of the candy (rose or swirl). In the “Price” column is the price on the sign (99 cents or $1.25). The other columns represent responses to each item on the Likert scale.
Participant
Color
Price
Enjoy_taste
Texture
Appearance
Dislike_taste
Overall
1
Rose
99 cents
5
4
4
1
5
2
Swirl
99 cents
2
2
3
4
2
3
Swirl
99 cents
3
3
5
3
3
4
Rose
$1.25
4
5
1
2
5
5
Swirl
$1.25
2
1
3
2
4
6
Rose
99 cents
5
4
3
2
4
7
Swirl
$1.25
1
2
4
4
3
8
Rose
99 cents
3
3
2
3
4
9
Swirl
$1.25
4
3
4
5
1
10
Rose
99 cents
4
2
2
1
3
Selecting the Proper Tool
Ines Koleva/E+/Getty Images
Now that you have finished running the study, you must decide the best way to analyze your data. The decisions you made about how to collect your data dictate the statistics you can use with your data now.
Each participant’s overall likeability score was calculated by first reverse-coding the “dislike taste” statement and then taking the mean of the ratings for all 5 scale items. This score is the dependent variable you are testing.
Congratulations! You have successfully completed Part 3 of this activity.
KMGS Photography/Moment/Getty Images
Your work on this activity has been saved until you are ready to proceed to Part 4 of the activity.
Something to Think About…
FADEDinkDesigns/Shutterstock
Scenario: Your client is so pleased with your work that they ask you to take on 1 final project: With the flavor, color, and price of the candy established, the candy maker wants to know more about how to market the product. The client plans to invest a substantial amount in advertising the new flavor, and they want to make sure they have sound research to back up their marketing campaign.
Your team needs to switch focus from helping to develop the best candy to selling this candy the right way to consumers. Good thing your research skills can be applied to so many areas! And even better—your boss told your team that if this final research phase goes well, the whole team will receive a bonus.
Our Research Question
Jesse Kunerth/iStock/Getty Images
Your team has a new focus and, therefore, needs a new research question.
Now that you have a research question (“What is the best way to sell cherry-flavored chocolate pieces?”), you must decide which research approach to use to answer this question. There are 2 research methods you can choose from:
The next step is to determine which qualitative data collection technique is best suited for your research question. Below are a few of the techniques you can choose from:
While you want people to talk freely in a focus group, you still need to establish a planned list of questions for them to answer. These questions will help the discussion stay on track, while allowing you to get the information you need through the flexibility of unplanned follow-up questions. But before you figure out what to ask, you need to determine the best number of questions to ask.
Your team determines that they want to learn about participants’ typical chocolate consumption. They also want to know what participants think about your client’s new product and how they might use it. You draft the following 5 questions for your focus group:
What role does chocolate play in your weekly eating habits?
What are your first thoughts after trying this new candy?
What aspects of the candy do you like and dislike?
Who would you buy this product for (e.g., for yourself, for a friend’s party, for your children)?
When do you think you would likely eat this candy (e.g., at night as a treat, after lunch, for a snack)?
Finding a Sample
Caiaimage/Robert Daly/OJO+/Getty Images
As you plan your study, you need to identify your sample. In this case, you want to target people that are most likely to buy the new product. These are the people the candy maker will want to focus on for their advertising campaign, so they are your target population.
You are ready to start the data collection (focus group) process. After the participants give their informed consent, you will allow them to eat as many of the cherry-flavored chocolate pieces as they like. You will then moderate the focus group, asking the planned questions in a predetermined order, and following up with other questions to clarify meaning and elicit additional information. In this role, you must be as unbiased as possible. You may also need to keep some people from dominating the discussion by encouraging others to contribute more. You will video-record the session for later transcription.
You recruit 9 people to contribute to your focus group. After your 90-minute session, the video recording is transcribed.
Example Data Set
Below is an example of transcribed data from the focus group.
Questions
Representative Statements
What role does chocolate play in your weekly eating habits?
I am total chocaholic. I eat something made of chocolate every day.
I like chocolate. I eat it when it is around, but I don’t specifically go looking for it. I probably eat it about once a week.
What are your first thoughts after trying the candy?
Umm . . . I like it. I was surprised by the cherry flavor at first, but I like it. They are fun.
I love it. I was thinking it was like a luxurious treat in the middle of the day.
I could take it or leave it. I am not a fan of fruit and chocolate combinations. If it was around, I would eat it though.
When do you think you would likely eat this candy?
It seems like a special treat to me. Something I would eat watching my favorite T.V. show after the kids go to bed.
It seems like something I would put in a bowl at a party to have people snack on.
Analyzing the Data
Ines Koleva/E+/Getty Images
With your data in hand, it is time to consider strategies for analyzing the focus group results. Below are a few of the techniques you can choose from:
Below is a word cloud generated using key words from the focus group. The frequency of which each word was used is represented by the size of the word.