7.1 Classical Conditioning: One Thing Leads to Another

American psychologist John B. Watson kick-started the behaviorist movement, arguing that psychologists should “never use the terms consciousness, mental states, mind, content, introspectively verifiable, imagery, and the like” (Watson, 1913, p. 166). Watson’s firebrand stance was fueled in large part by the work of a Russian physiologist, Ivan Pavlov (1849–1936).

Pavlov studied the digestive processes of laboratory animals by surgically implanting test tubes into the cheeks of dogs to measure their salivary responses to different foods. Serendipitously, his explorations into spit and drool revealed a form of learning, which came to be called classical conditioning. Classical conditioning occurs when a neutral stimulus produces a response after being paired with a stimulus that naturally produces a response. Pavlov showed that dogs learned to salivate to a neutral stimulus, such as a bell or a tone, after that stimulus had been associated with another stimulus that naturally evokes salivation, such as food.

classical conditioning

A type of learning that occurs when a neutral stimulus produces a response after being paired with a stimulus that naturally produces a response.

The Development of Classical Conditioning: Pavlov’s Experiments

Figure 7.1: FIGURE 7.1 Pavlov’s Apparatus for Studying Classical Conditioning Pavlov presented auditory stimuli to the animals using a bell or a tuning fork. Visual stimuli could be presented on the screen.

Pavlov’s basic experimental setup involved cradling dogs in a harness to administer the foods and to measure the salivary response, as shown in FIGURE 7.1. He noticed that dogs that had previously been in the experiment began to produce a kind of “anticipatory” salivary response as soon as they were put in the harness, before any food was presented. Pavlov and his colleagues regarded these responses as annoyances at first because they interfered with collecting naturally occurring salivary secretions. In reality, the dogs were exhibiting classical conditioning. When the dogs were initially presented with a plate of food, they began to salivate. No surprise here. Pavlov called the presentation of food an unconditioned stimulus (US), something that reliably produces a naturally occurring reaction in an organism. He called the dogs’ salivation an unconditioned response (UR), a reflexive reaction that is reliably produced by an unconditioned stimulus.

unconditioned stimulus (US)

Something that reliably produces a naturally occurring reaction in an organism.

unconditioned response (UR)

A reflexive reaction that is reliably produced by an unconditioned stimulus.

Pavlov soon discovered that he could make the dogs salivate to other stimuli, such as the ringing of a bell or the flash of a light (Pavlov, 1927). Each of these stimuli was a conditioned stimulus (CS), a previously neutral stimulus that produces a reliable response in an organism after being paired with a US (see FIGURE 7.2). When the conditioned stimulus, such as the sound of a bell, is paired over time with the US (food), the animal will learn to associate food with the sound, and eventually, the CS is sufficient to produce a response (in this case, salivation). Pavlov called this response the conditioned response (CR), a reaction that resembles an unconditioned response but is produced by a conditioned stimulus. In this example, the dogs’ salivation (CR) was prompted by the sound of the bell (CS) because the bell and the food (US) had been associated so often in the past.

conditioned stimulus (CS)

A previously neutral stimulus that produces a reliable response in an organism after being paired with a US.

conditioned response (CR)

A reaction that resembles an unconditioned response but is produced by a conditioned stimulus.

Figure 7.2: FIGURE 7.2 The Elements of Classical Conditioning In classical conditioning, a previously neutral stimulus (such as the sound of a bell) is paired with an unconditioned stimulus (such as the presentation of food). After several trials associating the two, the conditioned stimulus (the sound) alone can produce a conditioned response.

210

Why do some dogs seem to know when it’s dinnertime?

Consider your own dog (or cat). Does your dog always know when dinner’s coming, as though she has one eye on the clock every day, waiting for the dinner hour? Alas, your dog is no clock-watching wonder hound. Instead, the presentation of food (the US) has become associated with a complex CS—your getting up, moving into the kitchen, opening the cabinet, working the can opener—such that the CS alone signals to your dog that food is on the way and therefore initiates the CR of her getting ready to eat.

The Basic Principles of Classical Conditioning

When Pavlov’s findings first appeared (Pavlov, 1923a, 1923b), they produced a flurry of excitement. Classical conditioning was the kind of behaviorist psychology Watson was proposing: An organism experiences stimuli that are observable and measurable, and changes in that organism can be directly observed and measured. Dogs learned to salivate to the sound of a buzzer, and there was no need to resort to explanations about why it had happened, what the dog wanted, or how the animal thought about the situation. Pavlov also appreciated the significance of his discovery and embarked on a systematic investigation of the mechanisms of classical conditioning. Let’s take a closer look at some of these principles. (As the Real World box shows, these principles help explain how drug overdoses occur.)

Dennis the Menace © North America Syndicate. Courtesy King Features Syndicate

Acquisition

Remember when you first got your dog? Chances are she didn’t seem too smart, especially the way she stared at you vacantly as you went into the kitchen, not anticipating that food was on the way. That’s because learning through classical conditioning requires some period of association between the CS and US. This period is called acquisition, the phase of classical conditioning when the CS and the US are presented together. Typically, learning starts low, rises rapidly, and then slowly tapers off, as shown on the left side of FIGURE 7.3. Pavlov’s dogs gradually increased their amount of salivation over several trials of pairing a tone with the presentation of food, and similarly, your dog eventually learned to associate your kitchen preparations with the subsequent appearance of food. After learning has been established, the CS by itself will reliably elicit the CR.

acquisition

The phase of classical conditioning when the CS and the US are presented together.

Figure 7.3: FIGURE 7.3 Acquisition, Extinction, and Spontaneous Recovery In classical conditioning, the CS is originally neutral and produces no specific response. After several trials pairing the CS with the US, the CS alone comes to elicit the CR. Learning tends to take place fairly rapidly and then levels off as stable responding develops. In extinction, the CR diminishes quickly. A rest period, however, is typically followed by spontaneous recovery of the CR. In fact, a well-learned CR may show spontaneous recovery after more than one rest period even though there have been no additional learning trials.

211

Second-Order Conditioning

After conditioning has been established, second-order conditioning can be demonstrated: conditioning in which a CS is paired with a stimulus that became associated with the US in an earlier procedure. For example, in an early study, Pavlov repeatedly paired a new CS, a black square, with the now reliable tone. After a number of training trials, his dogs produced a salivary response to the black square even though the square itself had never been directly associated with the food. Second-order conditioning helps explain why some people desire money to the point that they hoard it and value it even more than the objects it purchases. Money is initially used to purchase objects that produce gratifying outcomes, such as an expensive car. Although money is not directly associated with the thrill of a drive in a new sports car, through second-order conditioning, money can become linked with this type of desirable quality.

second-order conditioning

Conditioning in which a CS is paired with a stimulus that became associated with the US in an earlier procedure.

Extinction and Spontaneous Recovery

After Pavlov and his colleagues had explored the process of acquisition, they wondered what would happen if they continued to present the CS (tone) but stopped presenting the US (food). As shown on the right side of the first panel in FIGURE 7.3, behavior declines abruptly and continues to drop until eventually, the dog ceases to salivate at the sound of the tone. This process is called extinction, the gradual elimination of a learned response that occurs when the CS is repeatedly presented without the US. The term was introduced because the conditioned response is “extinguished” and no longer observed.

extinction

The gradual elimination of a learned response that occurs when the CS is repeatedly presented without the US.

How does conditioned behavior change when the unconditioned stimulus is removed?

Pavlov next wondered if this elimination of conditioned behavior was permanent. When the dogs were brought back to the lab and presented with the CS again, they displayed spontaneous recovery, the tendency of a learned behavior to recover from extinction after a rest period. This phenomenon is shown in the middle panel in FIGURE 7.3. Notice that this recovery takes place even though there have not been any additional associations between the CS and US. Some spontaneous recovery of the conditioned response even takes place after a period of rest (see the right-hand panel in FIGURE 7.3). Clearly, extinction had not completely erased the learning that had been acquired.

spontaneous recovery

The tendency of a learned behavior to recover from extinction after a rest period.

Generalization and Discrimination

How can a change in the can opener affect a conditioned dog’s response?

Do you think your dog will be stumped, unable to anticipate the presentation of her food, if you get a new can opener? Will a whole new round of conditioning need to be established with this modified CS?

212

Probably not. It wouldn’t be very adaptive for an organism if each little change in the CS-US pairing required an extensive regimen of new learning. Rather, the phenomenon of generalization tends to take place: The CR is observed even though the CS is slightly different from the CS used during acquisition. This means that the conditioning generalizes to stimuli that are similar to the CS used during the original training. As you might expect, the more the new stimulus changes, the less conditioned responding is observed. If you replaced a manual can opener with an electric can opener, your dog would probably show a much weaker conditioned response (Pearce, 1987; Rescorla, 2006). Such diminished responding to the new stimulus indicates discrimination, the capacity to distinguish between similar but distinct stimuli. Generalization and discrimination are two sides of the same coin. The more organisms show one, the less they show the other, and training can modify the balance between the two.

generalization

The CR is observed even though the CS is slightly different from the CS used during acquisition.

discrimination

The capacity to distinguish between similar but distinct stimuli.

Your first electric can opener may cause your dog some confusion, but likely only for a little while.
GVictoria/Shutterstock

Conditioned Emotional Responses: The Case of Little Albert

Watson and his followers thought that it was possible to develop general explanations of pretty much any behavior of any organism based on classical conditioning principles. As a step in that direction, Watson embarked on a controversial study with his research assistant Rosalie Rayner (Watson & Rayner, 1920) to see if a healthy, well-developed child could be classically conditioned to experience a strong emotional reaction, namely, fear. To find out, Watson and Raynor enlisted the assistance of 9-month-old “Little Albert.”

The Real World: Understanding Drug Overdoses

Understanding Drug Overdoses

All too often, police are confronted with a perplexing problem: the sudden death of heroin addicts from a drug overdose. The victims are often experienced drug users; the dose taken is usually not larger than what they usually take; and the deaths tend to occur in unusual settings.

Although opium dens and crack houses may be considered blight, it is often safer for addicts to use drugs there. The environment becomes part of the addict’s CS, so ironically, busting crack houses may contribute to more deaths from drug overdoses when addicts are pushed to use drugs in new situations.
AP Photo/Chris Gardner

Classical conditioning provides some insight into how these deaths occur. First, when classical conditioning takes place, the CS is more than a simple bell or tone: It also includes the overall context within which the conditioning takes place. In the case of heroin, when the drug is injected, the entire setting (the drug paraphernalia, the room, the lighting, the addict’s usual companions) functions as the CS. Second, many CRs are compensatory in nature, counteracting the anticipated effects of the US. Heroin, for example, causes many changes in the body, such as slower breathing, so the body responds by speeding up breathing in order to maintain a state of balance. Over time, this protective physiological response becomes part of the CR, and like all CRs, it occurs in the presence of the CS but prior to the actual administration of the US (in this case, the heroin). These compensatory physiological reactions are also what make drug abusers take increasingly larger doses to achieve the same effect. Ultimately, these reactions produce drug tolerance, discussed in the Consciousness chapter.

Based on these principles of classical conditioning, taking drugs in a new environment can be fatal for a longtime drug user. If an addict injects the usual dose in a setting that is sufficiently novel or where heroin has never been taken before, the CS is now altered, so that the physiological compensatory CR that usually serves a protective function may not occur (Siegel et al., 2000). As a result, the addict’s usual dose becomes an overdose, and death often results. Understanding these principles has led to treatments for drug addicts. For example, the brain’s compensatory response to a drug, when elicited by the familiar contextual cues ordinarily associated with drug taking that constitute the CS, can be experienced by the addict as withdrawal symptoms. In cue exposure therapies, an addict is exposed to drug-related cues without being given the usual dose of the drug itself, eventually resulting in extinction of the association between the contextual cues and the compensatory CR. After an addict has undergone such treatment, encountering familiar drug-related cues will no longer result in the CR, thereby making it easier for a recovering addict to remain abstinent (Siegel, 2005).

213

John Watson and Rosalie Rayner show Little Albert an unusual bunny mask. Why doesn’t the mere presence of these experimenters serve as a conditioned stimulus in itself?
Watson & Rayner, 1920

Watson presented Little Albert with a variety of stimuli: a white rat, a dog, a rabbit, various masks, and a burning newspaper. Albert’s reactions in most cases were curiosity or indifference, and he showed no fear of any of the items. Watson also established that something could make Albert afraid. While Albert was watching Rayner, Watson unexpectedly struck a large steel bar with a hammer, producing a loud noise. Predictably, this caused Albert to cry, tremble, and be generally displeased.

Watson and Rayner then led Little Albert through the acquisition phase of classical conditioning. Albert was presented with a white rat. As soon as he reached out to touch it, the steel bar was struck. This pairing occurred again and again over several trials. Eventually, the sight of the rat alone caused Albert to recoil in terror. In this situation, a US (the loud sound) was paired with a CS (the presence of the rat) such that the CS all by itself was sufficient to produce the CR (a fearful reaction). Little Albert also showed stimulus generalization. The sight of a white rabbit, a seal-fur coat, and a Santa Claus mask produced the same kinds of fear reactions in the infant.

Why did Albert fear the rat?

What response do you think the advertisers of Budweiser are looking for when they feature a Clydesdale horse in an ad?
AP Photo/Kyle Ericson

This study was controversial in its cavalier treatment of a young child. Modern ethical guidelines that govern the treatment of research participants make sure that this kind of study could not be conducted today. So, what was Watson’s goal in all this? First, he wanted to show that a relatively complex reaction could be conditioned using Pavlovian techniques. Second, he wanted to show that emotional responses such as fear and anxiety could be produced by classical conditioning and therefore need not be the product of deeper unconscious processes. Instead, Watson proposed that fears could be learned, just like any other behavior.

The kind of conditioned fear responses that were at work in Little Albert’s case were also important in the chapter-opening case of Jennifer, who experienced fear and anxiety when hearing the previously innocent sound of an approaching helicopter as a result of her experiences in Iraq. Indeed, a therapy that has proven effective in dealing with such trauma-induced fears is based directly on principles of classical conditioning: Individuals are repeatedly exposed to conditioned stimuli associated with their trauma in a safe setting in an attempt to extinguish the conditioned fear response (Bouton, 1988; Rothbaum & Schwartz, 2002). However, conditioned emotional responses are not limited to fear and anxiety responses. The warm and fuzzy feeling that envelops you when hearing a song on the radio that you used to listen to with a former boyfriend or girlfriend represents a type of conditioned emotional response.

A Deeper Understanding of Classical Conditioning

As a form of learning, classical conditioning has a simple set of principles and applications to real-life situations. It offered a good deal of utility for psychologists who sought to understand the mechanisms underlying learning, and it continues to do so today. Since Pavlov’s day, classical conditioning has been subjected to deeper scrutiny in order to understand exactly how, when, and why it works. Let’s examine three areas that give us a closer look at the mechanisms of classical conditioning: the cognitive, neural, and evolutionary elements.

214

The Cognitive Elements of Classical Conditioning

Pavlov’s work was a behaviorist’s dream come true. In this view, conditioning is something that happens to a dog, a rat, or a person, apart from what the organism thinks about the conditioning situation. However, although the dogs salivated when their feeders approached (see the Psychology: Evolution of a Science chapter), they did not salivate when Pavlov did. Eventually, someone was bound to ask an important question: Why not? After all, Pavlov also delivered the food to the dogs, so why didn’t he become a CS? Indeed, if Watson was present whenever the unpleasant US was sounded, why didn’t Little Albert come to fear him?

Somehow, Pavlov’s dogs were sensitive to the fact that Pavlov was not a reliable indicator of the arrival of food. Pavlov was linked with the arrival of food, but he was also linked with other activities that had nothing to do with food, including checking on the apparatus, bringing the dog from the kennel to the laboratory, and standing around and talking with his assistants.

Robert Rescorla and Allan Wagner (1972) were the first to theorize that classical conditioning occurs when an animal has an expectation. The bell, because of its systematic pairing with food, served to set up this cognitive state for the laboratory dogs; Pavlov, because of the lack of any reliable link with food, did not. The Rescorla–Wagner model introduced a cognitive component that accounted for a variety of classical conditioning phenomena that were difficult to understand from a simple behaviorist point of view. For example, the model predicted that conditioning would be easier when the CS was an unfamiliar event than when it was familiar. The reason is that familiar events, being familiar, already have expectations associated with them, making new conditioning difficult. In short, classical conditioning might appear to be a primitive process, but it is actually quite sophisticated and incorporates a significant cognitive element.

How does the role of expectation in conditioning challenge behaviorist ideas?

The Neural Elements of Classical Conditioning

Pavlov saw his research as providing insights into how the brain works. Recent research has clarified some of what Pavlov hoped to understand about conditioning and the brain.

Richard Thompson and his colleagues focused on classical conditioning of eyeblink responses in the rabbit, in which the CS (a tone) is immediately followed by the US (a puff of air), which elicits a reflexive eyeblink response. After many CS–US pairings, the eyeblink response occurs in response to the CS alone. Thompson and colleagues showed convincingly that the cerebellum is critical for the occurrence of eyeblink conditioning (Thompson, 2005). Studies of people with lesions to the cerebellum supported these findings by demonstrating impaired eyeblink conditioning (Daum et al., 1993). Rounding out the picture, more recent neuroimaging findings in healthy young adults show activation in the cerebellum during eyeblink conditioning (Cheng et al., 2008). As you learned in the Neuroscience and Behavior chapter, the cerebellum is part of the hindbrain and plays an important role in motor skills and learning.

What is the role of the amygdala in fear conditioning?

Also in the Neuroscience and Behavior chapter, you saw that the amygdala plays an important role in the experience of emotion, including fear and anxiety. So, it should come as no surprise that the amygdala is also critical for emotional conditioning. Normal rats, trained so that a tone (CS) predicts a mild electric shock (US), show a defensive reaction (CR), known as freezing, where they crouch down and sit motionless. If connections linking the amygdala to the midbrain are disrupted, the rat does not exhibit the behavioral freezing response. The amygdala is involved in fear conditioning in people as well as rats and other animals (Olsson & Phelps, 2007; Phelps & LeDoux, 2005).

215

The Evolutionary Elements of Classical Conditioning

Under certain conditions, people may develop food aversions. This serving of hummus looks inviting and probably tastes delicious, but at least one psychologist avoids it like the plague.
Shutterstock

Evolutionary mechanisms also play an important role in classical conditioning. As you learned in the Psychology: Evolution of a Science chapter, evolution and natural selection go hand in hand with adaptiveness: Behaviors that are adaptive allow an organism to survive and thrive in its environment.

Consider this example: A psychology professor was once on a job interview in Southern California, and his hosts took him to lunch at a Middle Eastern restaurant. Suffering from a case of bad hummus, he was up all night long, and he developed a lifelong aversion to hummus. The hummus was the CS, a bacterium or some other source of toxicity was the US, and the resulting nausea was the UR. The UR (the nausea) became linked to the once-neutral CS (the hummus) and became a CR (an aversion to hummus).

Rats can be difficult to poison because of learned taste aversions, which are an evolutionarily adaptive element of classical conditioning. Here a worker tries his best in the sewers of Paris.
Boyer/Roger Viollet/Getty Images

How has cancer patients’ discomfort been eased by our understanding of food aversions?

This scenario makes sense from an evolutionary perspective. Any species that forages or consumes a variety of foods needs to develop a mechanism by which it can learn to avoid any food that once made it ill. To have adaptive value, this learning should be very rapid—occurring in perhaps one or two trials. If learning takes more trials than this, the animal could die from eating a toxic substance. Also, learned aversions should occur more often with novel foods than with familiar ones. It is not adaptive for an animal to develop an aversion to everything it has eaten on the particular day it got sick. Our psychologist friend didn’t develop an aversion to the Coke he drank with lunch or the scrambled eggs he had for breakfast that day; however, the sight and smell of hummus do make him uneasy.

Classical conditioning of food aversions has been studied in rats, using USs such as injection or radiation that cause nausea and vomiting (Garcia & Koelling, 1966). Food aversions are relatively easy to produce in rats if the CS is an unfamiliar taste or smell, but they are difficult or impossible if the CS is a sight or sound. On the other hand, the taste and smell stimuli that produce food aversions in rats do not work with most species of birds. Birds depend primarily on visual cues for finding food and are relatively insensitive to taste and smell. However, it is relatively easy to produce a food aversion in birds using an unfamiliar visual stimulus as the CS, such as a brightly colored food (Wilcoxon, Dragoin, & Kral, 1971). Studies such as these suggest that evolution has provided each species with a kind of biological preparedness, a propensity for learning particular kinds of associations over others, so that some behaviors are relatively easy to condition in some species but not others.

biological preparedness

A propensity for learning particular kinds of associations over others.

This research had an interesting application. It led to the development of a technique for dealing with an unanticipated side effect of radiation and chemotherapy: Cancer patients who experience nausea from their treatments often develop aversions to foods they ate before the therapy. Broberg and Bernstein (1987) reasoned that if the findings with rats generalized to humans, a simple technique should minimize the negative consequences of this effect. The researchers gave the patients an unusual food (coconut- or root-beer–flavored candy) at the end of the last meal before undergoing treatment. Sure enough, the conditioned food aversions that the patients developed were overwhelmingly for one of the unusual flavors and not for any of the other foods in the meal. Other than any root beer or coconut fanatics among the sample, patients were spared developing aversions to common foods that they were more likely to eat.

216

SUMMARY QUIZ [7.1]

Question 7.1

1. In classical conditioning, a conditioned stimulus is paired with an unconditioned stimulus to produce
  1. a neutral stimulus.
  2. a conditioned response.
  3. an unconditioned response.
  4. another conditioned stimulus.

b.

Question 7.2

2. What occurs when a conditioned stimulus is no longer paired with an unconditioned stimulus?
  1. generalization
  2. spontaneous recovery
  3. extinction
  4. acquisition

c.

Question 7.3

3. What did Watson and Rayner seek to demonstrate about behaviorism through the Little Albert experiment?
  1. Conditioning involves a degree of cognition.
  2. Classical conditioning has an evolutionary component.
  3. Behaviorism alone cannot explain human behavior.
  4. Even sophisticated behaviors such as emotion are subject to classical conditioning.

d.

Question 7.4

4. Which part of the brain is involved in the classical conditioning of fear?
  1. the amygdala
  2. the cerebellum
  3. the hippocampus
  4. the hypothalamus

a.