CHAPTER REVIEW

KEY TERMS

Question

behavior modification
behaviorism
biological preparedness
classical conditioning
cognitive map
conditioned reinforcer
conditioned response (CR)
conditioned stimulus (CS)
conditioning
continuous reinforcement
discriminative stimulus
extinction (in classical conditioning)
extinction (in operant conditioning)
fixed-interval (FI) schedule
fixed-ratio (FR) schedule
higher order conditioning (also called second-order conditioning)
instinctive drift
latent learning
law of effect
learned helplessness
learning
mirror neurons
negative punishment
negative reinforcement
observational learning
operant chamber or Skinner box
operant conditioning
operant
partial reinforcement effect
partial reinforcement
placebo response
positive punishment
positive reinforcement
primary reinforcer
punishment
reinforcement
schedule of reinforcement
shaping
spontaneous recovery
stimulus discrimination
stimulus generalization
taste aversion
unconditioned response (UCR)
unconditioned stimulus (UCS)
variable-interval (VI) schedule
variable-ratio (VR) schedule
The learned, reflexive response to a conditioned stimulus.
The phenomenon in which behaviors that are conditioned using partial reinforcement are more resistant to extinction than behaviors that are conditioned using continuous reinforcement.
The occurrence of a stimulus or event following a response that increases the likelihood of that response being repeated.
Skinner’s term for an actively emitted (or voluntary) behavior that operates on the environment to produce consequences.
A classically conditioned dislike for and avoidance of a particular food that develops when an organism becomes ill after eating the food.
A phenomenon in which exposure to inescapable and uncontrollable aversive events produces passive behavior.
The gradual weakening and apparent disappearance of conditioned behavior. In classical conditioning, extinction occurs when the conditioned stimulus is repeatedly presented without the unconditioned stimulus.
Learning principle, proposed by Thorndike, in which responses followed by a satisfying effect become strengthened and are more likely to recur in a particular situation, while responses followed by a dissatisfying effect are weakened and less likely to recur in a particular situation.
School of psychology and theoretical viewpoint that emphasizes the study of observable behaviors, especially as they pertain to the process of learning.
A formerly neutral stimulus that acquires the capacity to elicit a reflexive response.
A situation in which a response is followed by the addition of a reinforcing stimulus, increasing the likelihood that the response will be repeated in similar situations.
A stimulus or event that is naturally or inherently reinforcing for a given species, such as food, water, or other biological necessities.
A reinforcement schedule in which a reinforcer is delivered for the first response that occurs after an average time interval, which varies unpredictably from trial to trial.
Learning that occurs through observing the actions of others.
A reinforcement schedule in which a reinforcer is delivered for the first response that occurs after a preset time interval has elapsed.
A reinforcement schedule in which a reinforcer is delivered after a fixed number of responses has occurred.
The operant conditioning procedure of selectively reinforcing successively closer approximations of a goal behavior until the goal behavior is displayed.
The gradual weakening and disappearance of conditioned behavior. In operant conditioning, extinction occurs when an emitted behavior is no longer followed by a reinforcer.
The occurrence of a learned response to a specific stimulus but not to other, similar stimuli.
A specific stimulus in the presence of which a particular response is more likely to be reinforced, and in the absence of which a particular response is not likely to be reinforced.
A reinforcement schedule in which a reinforcer is delivered after an average number of responses, which varies unpredictably from trial to trial.
The presentation of a stimulus or event following a behavior that acts to decrease the likelihood of the behavior being repeated.
The application of learning principles to help people develop more effective or adaptive behaviors.
A situation in which an operant is followed by the removal or subtraction of a reinforcing stimulus; also called punishment by removal.
The delivery of a reinforcer according to a preset pattern based on the number of responses or the time interval between responses.
A procedure in which a conditioned stimulus from one learning trial functions as the unconditioned stimulus in a new conditioning trial; the second conditioned stimulus comes to elicit the conditioned response, even though it has never been directly paired with the unconditioned stimulus.
The experimental apparatus invented by B.F. Skinner to study the relationship between environmental events and active behaviors.
An individual’s psychological and physiological response to what is actually a fake treatment or drug; also called placebo effect.
Tolman’s term for learning that occurs in the absence of reinforcement but is not behaviorally demonstrated until a reinforcer becomes available.
The reappearance of a previously extinguished conditioned response after a period of time without exposure to the conditioned stimulus.
A situation in which a response results in the removal of, avoidance of, or escape from a punishing stimulus, increasing the likelihood that the response will be repeated in similar situations.
The process of learning associations between environmental events and behavioral responses.
The basic learning process that involves repeatedly pairing a neutral stimulus with a response-producing stimulus until the neutral stimulus elicits the same response.
A schedule of reinforcement in which every occurrence of a particular response is followed by a reinforcer.
Tolman’s term for the mental representation of the layout of a familiar environment.
The unlearned, reflexive response that is elicited by an unconditioned stimulus.
A process that produces a relatively enduring change in behavior or knowledge as a result of past experience.
The natural stimulus that reflexively elicits a response without the need for prior learning.
The tendency of an animal to revert to instinctive behaviors that can interfere with the performance of an operantly conditioned response.
A situation in which the occurrence of a particular response is only sometimes followed by a reinforcer.
The occurrence of a learned response not only to the original stimulus but to other, similar stimuli as well.
A stimulus or event that has acquired reinforcing value by being associated with a primary reinforcer; also called a secondary reinforcer.
In learning theory, the idea that an organism is innately predisposed to form associations between certain stimuli and responses.
A situation in which an operant is followed by the presentation or addition of an aversive stimulus; also called punishment by application.
The basic learning process that involves changing the probability that a response will be repeated by manipulating the consequences of that response.
Neurons that activate both when an action is performed and when the same action is perceived.

KEY PEOPLE

Albert Bandura (b. 1925)

John Garcia (b. 1917).

Ivan Pavlov (1849–1936)

Robert A. Rescorla (b. 1940)

Martin Seligman (b. 1942)

B.F. Skinner (1904–1990)

Edward L. Thorndike (1874–1949)

Edward C. Tolman (1898–1956)

John B. Watson (1878–1958)