Study Guide

Chapter Key Terms

You should know the definitions of the following key terms from the chapter. They are listed in the order in which they appear in the chapter. For those you do not know, return to the relevant section of the chapter to learn them. When you think that you know all of the terms, complete the matching exercise based on these key terms.

classical conditioning

reflex

unconditioned stimulus (UCS)

unconditioned response (UCR)

conditioned stimulus (CS)

conditioned response (CR)

delayed conditioning

trace conditioning

acquisition (in classical conditioning)

extinction (in classical conditioning)

spontaneous recovery (in classical conditioning)

stimulus generalization (in classical conditioning)

stimulus discrimination (in classical conditioning)

operant conditioning

law of effect

reinforcer

punisher

reinforcement

punishment

appetitive stimulus

aversive stimulus

positive reinforcement

positive punishment

negative reinforcement

negative punishment

Premack principle

primary reinforcer

secondary reinforcer

behavior modification

shaping

cumulative record

acquisition (in operant conditioning)

extinction (in operant conditioning)

spontaneous recovery (in operant conditioning)

discriminative stimulus (in operant conditioning)

stimulus discrimination (in operant conditioning)

stimulus generalization (in operant conditioning)

continuous schedule of reinforcement

partial schedule of reinforcement

partial-reinforcement effect

fixed-ratio schedule

variable-ratio schedule

fixed-interval schedule

variable-interval schedule

motivation

drive-reduction theory

incentive theory

arousal theory

Yerkes-Dodson law

extrinsic motivation

intrinsic motivation

overjustification effect

instinctual drift

latent learning

observational learning (modeling)

mirror neurons

Key Terms Exercise

Identify the correct term for each of the following definitions..

Question 4.1

1. A classical conditioning procedure in which the conditioned stimulus precedes the unconditioned stimulus but the two stimuli do not occur together.

trace conditioning

Question 4.2

2. A stimulus that gains its reinforcing property through learning.

secondary reinforcer

Question 4.3

3. In operant conditioning, giving the operant response in the presence of stimuli similar to the discriminative stimulus.

stimulus generalization

184

Question 4.4

4. The stimulus that comes to elicit a new response in classical conditioning.

conditioned stimulus

Question 4.5

5. The finding that operant responses reinforced on partial schedules are more resistant to extinction than those reinforced on a continuous schedule.

partial-reinforcement effect

Question 4.6

6. A stimulus that is unpleasant.

aversive stimulus

Question 4.7

7. Training an animal or human to make an operant response by reinforcing successive approximations to the desired response.

shaping

Question 4.8

8. A partial schedule of reinforcement in which the number of responses it takes to obtain a reinforcer varies on each trial but averages to a set number across trials.

variable-ratio schedule

Question 4.9

9. A partial schedule of reinforcement in which the time that must elapse on each trial before a response will lead to the delivery of a reinforcer varies from trial to trial but averages to a set time across trials.

variable-interval schedule

Question 4.10

10. The application of classical and operant conditioning principles to eliminate undesirable behavior and to teach more desirable behavior.

behavior modification

Question 4.11

11. The desire to perform a behavior for external reinforcement.

extrinsic motivation

Question 4.12

12. Punishment in which an aversive stimulus is presented.

positive punishment

Question 4.13

13. A principle developed by Edward Thorndike that says that any behavior that results in satisfying consequences tends to be repeated and that any behavior that results in unsatisfying consequences tends not to be repeated.

law of effect

Question 4.14

14. A partial recovery in strength of the conditioned response following a break during extinction training.

spontaneous recovery (in classical conditioning)

Question 4.15

15. The diminishing of the operant response when it is no longer reinforced.

extinction (in operant conditioning)

Practice Test Questions

The following are practice multiple-choice test questions on some of the chapter content. If you guessed or incorrectly answered a question, restudy the relevant section of the chapter.

Question 4.16

1. In Pavlov’s classical conditioning research, a tone was used as the ______, and food inserted in the mouth served as the ______.
  1. UCS; CS
  2. CS; UCS
  3. UCR; CR
  4. CR; UCR

b; CS; UCS

Question 4.17

2. In classical conditioning, the diminishing of the CR following removal of the UCS is called ______.
  1. acquisition
  2. discrimination
  3. extinction
  4. generalization

c; extinction

Question 4.18

3. In stimulus generalization in classical conditioning, the strength of the CR ______, as the similarity of the generalization stimulus to the ______ increases.
  1. increases; CS
  2. decreases; CS
  3. increases; UCS
  4. decreases; UCS

a; increases; CS

185

Question 4.19

4. In reinforcement, the probability of a behavior ______; in punishment the probability of a behavior ______.
  1. increases; increases
  2. increases; decreases
  3. decreases; increases
  4. decreases; decreases

b; increases; decreases

Question 4.20

5. Negative reinforcement occurs when an ______ stimulus is ______.
  1. appetitive; presented
  2. appetitive; removed
  3. aversive; presented
  4. aversive; removed

d; aversive; removed

Question 4.21

6. Which of the following is the best example of a primary reinforcer?
  1. a cheeseburger
  2. a grade of “A” on an exam
  3. praise from your teacher
  4. winning the lottery

a; a cheeseburger

Question 4.22

7. The stimulus in whose presence a response will be reinforced is called the stimulus ______ in operant conditioning.
  1. generalization
  2. discriminative
  3. acquisition
  4. extinction

b; discriminative

Question 4.23

8. Piecework in a factory is an example of a ______ schedule of reinforcement; a slot machine is an example of a ______ schedule of reinforcement.
  1. variable-ratio; fixed-interval
  2. fixed-interval; variable-ratio
  3. fixed-ratio; variable-ratio
  4. variable-ratio; fixed-ratio

c; fixed-ratio; variable-ratio

Question 4.24

9. The Brelands’ difficulties in training animals were the result of ______.
  1. the partial-reinforcement effect
  2. instinctual drift
  3. a token economy
  4. latent learning

b; instinctual drift

Question 4.25

10. Tolman’s research with rats in mazes indicated the occurrence of ______.
  1. observational learning
  2. latent learning
  3. the partial-reinforcement effect
  4. instinctual drift

b; latent learning

Question 4.26

11. Which of the following is an example of a secondary reinforcer?
  1. money
  2. a money order
  3. a check
  4. all of the above

d; all of the above

Question 4.27

12. The ______ effect is a decrease in an intrinsically motivated behavior after the behavior is extrinsically reinforced and the reinforcement discontinued.
  1. overjustification
  2. partial reinforcement
  3. shaping
  4. instinctual drift

a; overjustification

Question 4.28

13. A steep cumulative record in operant conditioning indicates ______, and a flat cumulative record indicates ______.
  1. a slow rate of responding; no responding
  2. a slow rate of responding; a fast rate of responding
  3. a fast rate of responding; no responding
  4. a fast rate of responding; a slow rate of responding

c; a fast rate of responding; no responding

Question 4.29

14. The results of Bandura’s Bobo doll studies illustrate ______, and Tolman and Honzik’s studies of latent learning indicate the importance of ______ in maze learning by rats.
  1. observational learning; the overjustification effect
  2. observational learning; cognitive maps
  3. the partial-reinforcement effect; the overjustification effect
  4. the partial-reinforcement effect; cognitive maps

b; observational learning; cognitive maps

Question 4.30

15. Continuing to take Advil because it alleviates headaches is an example of ______, and no longer parking in “No Parking” zones because you lost money in fines for doing so is an example of ______.
  1. positive punishment; positive reinforcement
  2. positive reinforcement; positive punishment
  3. negative punishment; negative reinforcement
  4. negative reinforcement; negative punishment

d; negative reinforcement; negative punishment