18.3 Sensory Interaction

18-8 How does sensory interaction influence our perceptions, and what is embodied cognition?

Our senses—seeing, hearing, touching, tasting, smelling—eavesdrop on one another (Rosenblum, 2013). In interpreting the world, our brain blends their inputs. Consider what happens to your sense of taste if you hold your nose, close your eyes, and have someone feed you various foods. A slice of apple may be indistinguishable from a chunk of raw potato. A piece of steak may taste like cardboard. Without their smells, a cup of cold coffee may be hard to distinguish from a glass of red wine. Our sense of smell sticks its nose into the business of taste.

sensory interaction the principle that one sense may influence another, as when the smell of food influences its taste.

Thus, to savor a taste, we normally breathe the aroma through our nose—which is why eating is not much fun when you have a bad cold. Smell can also change our perception of taste: A drink’s strawberry odor enhances our perception of its sweetness. Even touch can influence taste. Depending on its texture, a potato chip “tastes” fresh or stale (Smith, 2011). This is sensory interaction at work—the principle that one sense may influence another. Smell + texture + taste = flavor.

Vision and hearing may similarly interact. A weak flicker of light is more easily visible when accompanied by a short burst of sound (Kayser, 2007). And a sound may be easier to hear with a visual cue. If I [DM], as a person with hearing loss, watch a video with simultaneous captioning, I have no trouble hearing the words I am seeing. I may therefore think I don’t need the captioning, but if I then turn off the captioning, I suddenly realize I do need it. The eyes guide the ears (FIGURE 18.11).

image
Figure 6.47: FIGURE 18.11 “FaceTime” phone improvement Seeing an animated face forming the words being spoken at the other end of a phone line, which Apple’s FaceTime function provides, makes those words easier to understand for hard-of-hearing listeners (Knight, 2004).
© Albrecht Weisser/Westend61/Corbis

But what do you suppose happens if the eyes and the ears disagree? What if we see a speaker saying one syllable while we hear another? Surprise: We may perceive a third syllable that blends both inputs. Seeing the mouth movements for ga while hearing ba we may perceive da. This phenomenon is known as the McGurk effect, after its discoverers, Scottish psychologist Harry McGurk and his assistant John MacDonald (1976). For all of us, lip reading is part of hearing.

Touch also interacts with our other senses. In detecting events, the brain can combine simultaneous touch and visual signals, thanks to neurons projecting from the somatosensory cortex back to the visual cortex (Macaluso et al., 2000). Touch even interacts with hearing. In one experiment, researchers blew a puff of air (such as our mouths produce when saying pa and ta) on the neck or hands as people heard either these sounds or the more airless sounds ba or da. The result? People more often misheard ba or da as pa or ta when played with the faint puff (Gick & Derrick, 2009). Thanks to sensory interaction, they heard with their skin.

240

Our sensory experiences also interact with other aspects of our psychology. Our brain even blends our tactile and social judgments, as demonstrated in these playful experiments:

image IMMERSIVE LEARNING Are you wondering how researchers test these kinds of questions? Try LaunchPad’s How Would You Know If a Cup of Coffee Can Warm Up Relationships?

embodied cognition the influence of bodily sensations, gestures, and other states on cognitive preferences and judgments.

These examples of embodied cognition illustrate how brain circuits processing bodily sensations connect with brain circuits responsible for cognition. We think from within a body.

So, the senses interact: As we attempt to decipher our world, our brain blends inputs from multiple channels. For many people, an odor, perhaps of mint or chocolate, can evoke a sensation of taste (Stevenson & Tomiczek, 2007). But in a few select individuals, the senses become joined in a phenomenon called synesthesia, where one sort of sensation (such as hearing sound) involuntarily produces another (such as seeing color). Thus, hearing music may activate color-sensitive cortex regions and trigger a sensation of color (Brang et al., 2008; Hubbard et al., 2005). Seeing the number 3 may evoke a taste sensation (Ward, 2003).

* * *

For a summary of our sensory systems, see TABLE 18.2. The river of perception is fed by streams of sensation, cognition, and emotion.

If perception is the product of these three sources, what can we say about extrasensory perception, which claims that perception can occur apart from sensory input? For more on that question, see Thinking Critically About: ESP—Perception Without Sensation?

image
Table 6.2: TABLE 18.2
Summarizing the Senses
Sensory System Source Receptors Key Brain Areas
Vision Light waves striking the eye Rods and cones in the retina Occipital lobes
Hearing Sound waves striking the outer ear Cochlear hair cells in the inner ear Temporal lobes
Touch Pressure, warmth, cold Receptors, most in the skin, detect pressure, warmth, cold, and pain Somatosensory cortex
Taste Chemical molecules in the mouth Basic tongue receptors for sweet, sour, salty, bitter, and umami Frontal temporal lobe border
Smell Chemical molecules breathed in through the nose Millions of receptors at top of nasal cavity Olfactory bulb
Body position—kinesthesia Any change in position of a body part, interacting with vision Kinesthetic sensors in joints, tendons, and muscles Cerebellum
Body movement—vestibular sense Movement of fluids in the inner ear caused by head/body movement Hair-like receptors in the ears’ semicircular canals and vestibular sacs Cerebellum

241

THINKING CRITICALLY ABOUT

ESP—Perception Without Sensation?

18-9 What are the claims of ESP, and what have most research psychologists concluded after putting these claims to the test?

extrasensory perception (ESP) the controversial claim that perception can occur apart from sensory input; includes telepathy, clairvoyance, and precognition.

Without sensory input, are we capable of extrasensory perception (ESP)? Are there indeed people—any people—who can read minds, see through walls, or foretell the future? Nearly half of Americans have agreed there are (AP, 2007; Moore, 2005).

The most testable and, for this discussion, most relevant ESP claims are

  • telepathy: mind-to-mind communication.

  • clairvoyance: perceiving remote events, such as a house on fire in another state.

  • precognition: perceiving future events, such as an unexpected death in the next month.

Closely linked is psychokinesis, or “mind movement,” such as levitating a table or influencing the roll of a die. (The claim is illustrated by the wry request, “Will all those who believe in psychokinesis please raise my hand?”)

If ESP is real, we would need to overturn the scientific understanding that we are creatures whose minds are tied to our physical brains and whose perceptual experiences are built of sensations. Sometimes new evidence does overturn our scientific preconceptions.

parapsychology the study of paranormal phenomena, including ESP and psychokinesis.

Most research psychologists and scientists have been skeptical that paranormal phenomena exist. But in several reputable universities, parapsychology researchers perform scientific experiments searching for possible ESP (Storm, 2010a, b; Turpin, 2005). Before seeing how they do so, let’s consider some popular beliefs.

image
BIZARRO © 2014 Dan Piraro, Dist. By King Features

Premonitions or Pretensions?

Can psychics see into the future? Although one might wish for a psychic stock forecaster, the tallied forecasts of “leading psychics” reveal meager accuracy. During the 1990s, the tabloid psychics were all wrong in predicting surprising events. (Madonna did not become a gospel singer, the Statue of Liberty did not lose both its arms in a terrorist blast, Queen Elizabeth did not abdicate her throne to enter a convent.) And the psychics have missed big-news events. Why, despite a $50 million reward, could none of them help locate Osama bin Laden after 9/11? Where were the psychics on 9/10 when we needed them? In 2010, when a mine collapse trapped 33 miners, the Chilean government reportedly consulted four psychics. Their verdict? “They’re all dead” (Kraul, 2010). But 69 days later, all 33 were rescued. After Amanda Berry went missing in Cleveland in 2003, her distraught and desperate mother turned to a famed psychic on a national television show for answers. “She’s not alive, honey,” the psychic told the devastated mom, who died without living to see her daughter’s brave escape in 2013 (Radford, 2013). According to one analysis, this result brought that psychic’s record on 116 missing person and death cases to 83 unknown outcomes, 33 incorrect, and zero mostly correct. To researcher Ryan Shaffer (2013), that’s the record of a “psychic defective.”

The psychic visions offered to police departments have been no more accurate than guesses made by others (Nickell, 1994, 2005; Radford, 2010; Reiser, 1982). Their sheer volume does, however, increase the odds of an occasional correct guess, which psychics can then report to the media. Police departments are wise to all this. When researchers asked the police departments of America’s 50 largest cities whether they ever had used psychics, 65 percent said No (Sweat & Durm, 1993). Of those that had, not one had found them helpful.

Psychics’ vague predictions sometimes sound correct when later retrofitted to match events. Nostradamus, a sixteenth-century French psychic, explained in an unguarded moment that his ambiguous prophecies “could not possibly be understood till they were interpreted after the event and by it.”

Are the spontaneous “visions” of everyday people any more accurate? Do dreams, for example, foretell the future, as people from both Eastern and Western cultures tend to believe—making some people more reluctant to fly after dreaming of a plane crash (Morewedge & Norton, 2009)? Or do they only seem to do so when we recall or reconstruct them in light of what has already happened? Two Harvard psychologists tested the prophetic power of dreams after superhero aviator Charles Lindbergh’s baby son was kidnapped and murdered in 1932 (Murray & Wheeler, 1937). Before the body was discovered, they invited people to report their dreams about the child, and 1300 visionaries submitted dream reports. How many accurately envisioned the child dead? Five percent. And how many individuals also correctly anticipated the body’s location—buried among trees? Only 4 of the 1300. Although this number was surely no better than chance, to those four dreamers the accuracy of their apparent precognitions must have seemed uncanny.

Given the billions of events in the world each day, and given enough days, some stunning coincidences are sure to occur. By one careful estimate, chance alone would predict that more than a thousand times a day someone on Earth will think of another person and then, within the next five minutes, learn of that person’s death (Charpak & Broch, 2004). Thus, when explaining an astonishing event, we should “give chance a chance” (Lilienfeld, 2009). With enough time and people, the improbable becomes inevitable.

242

Putting ESP to Experimental Test

When faced with claims of mind reading or out-of-body travel or communication with the dead, how can we separate bizarre ideas from those that sound strange but are true? At the heart of science is a simple answer: Test them to see if they work. If they do, so much the better for the ideas. If they don’t, so much the better for our skepticism.

This scientific attitude has led both believers and skeptics to agree that what parapsychology needs is a reproducible phenomenon and a theory to explain it. Parapsychologist Rhea White (1998) spoke for many in saying “The image of parapsychology that comes to my mind, based on nearly 44 years in the field, is that of a small airplane [that] has been perpetually taxiing down the runway of the Empirical Science Airport since 1882 … its movement punctuated occasionally by lifting a few feet off the ground only to bump back down on the tarmac once again. It has never taken off for any sustained flight.”

“To be sure of hitting the target, shoot first and call whatever you hit the target.”

Writer-artist Ashleigh Brilliant

“A person who talks a lot is sometimes right.”

Spanish proverb

How might we test ESP claims in a controlled, reproducible experiment? An experiment differs from a staged demonstration. In the laboratory, the experimenter controls what the “psychic” sees and hears; on stage, the psychic controls what the audience sees and hears.

Daryl Bem, a respected social psychologist, has been a skeptic of stage psychics; he once quipped that “a psychic is an actor playing the role of a psychic” (1984). Yet he reignited hopes for replicable evidence with nine experiments that seemed to show people anticipating future events (2011). In one, when an erotic scene was about to be displayed in one of two randomly selected screen placements, Cornell University participants guessed the right placement 53.1 percent of the time (beating 50 percent by a small but statistically significant margin).

image
Testing psychic powers in the British population Psychologists created a “mind machine” to see if people could influence or predict a coin toss (Wiseman & Greening, 2002). Using a touch-sensitive screen, visitors to British festivals were given four attempts to call heads or tails, playing against a computer that kept score. By the time the experiment ended, nearly 28,000 people had predicted 110,959 tosses—with 49.8 percent correct.
Courtesy of Claire Cole

Despite Bem’s published research having survived critical reviews by a top-tier journal, other critics found the methods “badly flawed” (Alcock, 2011) or the statistical analyses “biased” (Wagenmakers et al., 2011). “A result—especially one of this importance—must recur several times in tests by independent and skeptical researchers to gain scientific credibility,” observed astronomer David Helfand (2011). “I have little doubt that Professor Bem’s experiments will fail this test.”

Anticipating such skepticism, Bem has made his computer materials available to anyone who wishes to replicate his studies. Multiple attempts have since been made, with minimal success and continuing controversy (Bem et al., 2014; Galak et al., 2012; Ritchie et al., 2012; Wagenmakers, 2014). Regardless, science is doing its work. It has been open to a finding that challenges its own assumptions. And then, through follow-up research, it has assessed its validity. And that is how science sifts crazy-sounding ideas, leaving most on the historical waste heap while occasionally surprising us.

“At the heart of science is an essential tension between two seemingly contradictory attitudes—an openness to new ideas, no matter how bizarre or counterintuitive they may be, and the most ruthless skeptical scrutiny of all ideas, old and new.”

Carl Sagan (1987)

One skeptic, magician James Randi, has had a long-standing offer of $1 million to be given “to anyone who proves a genuine psychic power under proper observing conditions” (Randi, 1999; Thompson, 2010). French, Australian, and Indian groups have made similar offers of up to 200,000 euros (CFI, 2003). Large as these sums are, the scientific seal of approval would be worth far more. To refute those who say there is no ESP, one need only produce a single person who can demonstrate a single, reproducible ESP event. (To refute those who say pigs can’t talk would take but one talking pig.) So far, no such person has emerged.

RETRIEVE IT

Question

m24ZQRf1xSfUxvUw0gO/jk75igYCOOW0kH6PzzY04WVTsPcz0aj7PMHhgou41eMFFUtTDJA+twEi3za1vFGMbjuTmCXBG1ygJzXW3V+gfrrvPnLa/8Eda5gWjRhguo9/h+BKbt6vA8CKr7RrbJB8t9Ju+BPCkfSl0CDOFzTwzP8=
ANSWER: The ESP event would need to be reproduced in other scientific studies.

* * *

To feel awe, mystery, and a deep reverence for life, we need look no further than our own perceptual system and its capacity for organizing formless nerve impulses into colorful sights, vivid sounds, and evocative smells. As Shakespeare’s Hamlet recognized, “There are more things in Heaven and Earth, Horatio, than are dreamt of in your philosophy.” Within our ordinary sensory and perceptual experiences lies much that is truly extraordinary—surely much more than has so far been dreamt of in our psychology.