Chapter 1. Signal Detection Theory

Introduction

Cognitive Tool Kit
true
true

Signal Detection Theory

You are downstairs watching a movie. The volume is up on your surround sound system and you don’t have a phone in the room. At a moment of great tension and excitement, and perhaps volume, you think you hear the phone. You are not sure. What are you to do?

Most of the time, we are aware of our surroundings. You can easily identify the door in the room you are in. It is obvious, but there are times when something happens, like the phone ringing, and you have to decide if something has actually happened. Signal detection theory was developed to explain these ambiguous situations.

This activity will use a simulated experiment to guide you through the elements of signal detection theory and how it describes how you determine if you think the phone actually rang.

Experiment Setup

Instructions

Instructions

In this experiment, you have to determine if something has changed on the screen. The situation is very simple. Dots will flash on the screen in front of you; sometimes there will be more dots than others. It is all random. Your job is to determine if the experimenter has added any dots to the screen.

Please follow the instructions on the experiment tab as you go through the activity to illustrate the elements of signal detection theory.

Experiment

Begin Experiment

Results

Results

Debriefing

Debriefing

Signal detection theory describes how we go about determining if something happened in a situation where it is not clear that something happened. For example, you are downstairs without a phone, watching a movie, and at an intense moment, you thought you heard the phone ring. You have to decide if the phone rang. Signal detection theory separates this decision into two elements: how easy is it for you to detect the stimulus (your sensitivity) and how much you get by detecting the stimulus (your criterion). To illustrate criterion, think of waiting to hear about a possible date: You want to hear the phone. Or think of hoping to avoid a call from your parents: You don’t want to hear the phone.

For any stimulus, you have a fixed sensitivity but you can adjust your criterion to any level. You can be very lax where you say you see the stimulus all the time. You will have a lot of hits but also a lot of false alarms. You could be very strict and say you never see the stimulus unless you are absolutely sure. You would have few false alarms but also few hits. To summarize all of the possible outcomes for one stimulus, the ROC curve was developed. The ROC curve plots the false alarms on the x-axis and the hits on the y-axis. As your sensitivity increase, the curve bends away from the positive diagonal which represent what happens when you cannot detect the stimulus at all (hits = false alarms).

References:

Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. Oxford, England: John Wiley.

Liu, S. S., Chen, J., Melara, R. D., & Massara, F. (2008). Consumer's product-locating behavior: Exploring the application of signal detection theory. Psychology & Marketing, 25(6), 506-520.

Quiz

Quiz

Question 1.1

LNtMq5vV5OmkWA1z/GnmfZ6tLwoQG6hA6oVUvpb2TIwR7dvZ1vnfiDdz0hXPXPX3RxaZx+dvObbXhMNe+4Lvfld9h3ADNPteS6o/JJeHYA+0HIE61P60DwX9rlpV+L8ee7DsApywV4WVkOaTYlnDeaHSJBFFLHsniYx04hjolYescXp7
1
Correct.
Incorrect.
In signal detection theory, the way we measure our ability to detect a stimulus, or our sensitivity, is called d’.

Question 1.2

jBMw3BmerCErGyROGdtZI279Ez9vNi/RNASWYp3w+q0O4+rK1UPFDbknHiEK7rfT6NNvxtg+iGivDLHFGMjvWzeOl7jjKA7M61b82jQq9Chlr83jHVQYAUOgqNelXOgGsSfminImiiNk4eF8GP5fq07TpCyQOzj+f9Yj8A==
1
Correct.
Incorrect.
There is no stimulus to report but you say there is. This is a classic description of the boy who cried wolf or false alarm.

Question 1.3

3ZjLm7areb5ndDqTqYFGimUhMkBu9kv3YS8XbL5Ab5+M1ixzJgqU9tKFJU08CBTDuo0Ihqy3JiOhKALZiO99Pt0HNCR2mlm3PtvvQ8FEhbjQuqtCtDFzHaKJMicml8NBBq5+E2h9KfeNXvPbMU6nazm7Hyq7UdErKfjCmkzcrayGaV1P+uYFymfxKJodIngCg24WsA==
1
Correct.
Incorrect.
The presence of noise in our systems is completely unaffected by the stimulus according to signal detection theory so nothing happens to the noise when a stimulus is presented.

Question 1.4

txEtU7fonBXwUcWtvisnyo9Fj8/KZgyE7nCZKmkpJKwQN/dbJ17gvagjPBt+uTC89z16Jsl6rOLcs2nCcPFPyyJSdLDCC31F4JdQNFdq1QyDWWjwcc0s+812IQ3maIQk5DA4Q7DippjevSok6T+u+Tub2DutFyH3qLmFDN5fzkckcTvcrgqz9+/Ow3hq5L8PFBVQQpghrwPFLGwI2ETndVZ99aOHcD0UbOK45ofZc8E9tfJAeBjJ8JgsxblWtPNMDaJFKmof20NrTlIqbFexNF2Pb2OvmnYMzTpPmg==
Correct.
Incorrect.
Generally, if I adjust my criterion so that false alarms go down, I also make fewer hits.

Question 1.5

LGkxWJ6mLd7CW4gXAlMRwTNrsDLoaKtC0CbDmfNLwCl1Hw3CDjmCPtDSwllv0cG8ipNtTM+xXnDcXhfQM6QvMHvr9b1xuvHerbF0Bktwk4qxkmO4v2BjXjAd/mIrMOTHUqdDeGbA2QToIU1YIst2MoOQSyE/eGh/Y8SHAtRbI6RR9PC0B12od3xQhzUqVK722xWCMRzV5ryq/jp3IM1yvZC7AqcYoKPkUotSIrlQ061ho0V5wHNzXKkqXGmde9NHHyY9D4rB715fp53tqK5znwn5J4an6M6A6rFvmssyMeYC6nUAnJRN9LWlEHw=
Correct.
Incorrect.
As sensitivity increases, the ROC curve bows out from the positive diagonal which is the line that represents no sensitivity to the stimulus.