Chapter 1. Research Methods and Cognitive Aging

Synopsis

Human Development Video Activity
true
true
You must read each slide, and complete any questions on the slide, in sequence.
cohort
A group of people born at about the same time in history who move through life experiencing the same historical events and cultural shifts.
cross-sectional study
A research design that compares groups of people who differ in age but are similar in other important characteristics.
cross-sectional studies
A research design that compares groups of people who differ in age but are similar in other important characteristics.
cohort-sequential study
Also called cross-sequential study or time-sequential study. A hybrid research design in which researchers first study several groups of people of different ages (like a cross-sectional study) and then follow those groups over years (like a longitudinal study).
longitudinal study
A research design in which the same individuals are followed over time and their development is repeatedly assessed.
longitudinal studies
A research design in which the same individuals are followed over time and their development is repeatedly assessed.
selective attrition
The tendency of some people to be more likely to drop out of a study than others. This tendency can threaten the validity of a psychological experiment.
A middle-aged man working on a laptop in a research library

Research Methods and Cognitive Aging

A middle-aged man working on a laptop in a research library

Author

Thomas E. Ludwig, Hope College
S. Stavros Valenti, Hofstra University

Synopsis

This activity explores how various research methods have been employed to study how intelligence changes with age. After considering the efficacy of the various research models, this activity concludes with a discussion of new research findings on cognitive aging.

REFERENCES

Botwinick, J. (1977). Intellectual abilities. In J. E. Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (pp. 580-605). New York: Van Nostrand Reinhold.

Botwinick, J., & Seigler, I. C. (1980). Intellectual ability among the elderly: Simultaneous cross-sectional and longitudinal comparisons. Developmental Psychology, 16, 49-53.

Hertzog, C. (1996). Research design in studies of aging and cognition. In J. E. Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (4th ed., pp. 24-37). New York: Academic Press.

Park, D., & Gutchess, A. (2006). The cognitive neuroscience of aging and culture. Current Directions in Psychological Science, 15, 105-108.

Park, D. C., Lautenschlager, G., Hededen, T., Davidson, N., Smith, A. D., & Smith, P. K. (2002). Models of visuospatial and verbal memory across the adult life span. Psychology and Aging, 17, 299-320.

Schaie, K. W. (1994). The course of adult intellectual development. American Psychologist, 49, 304-313.

Schaie, K. W. (1965). A general model for the study of developmental problems. Psychological Bulletin, 64, 92-107.

Wechsler, D. (1972). “Hold” and “don’t hold” tests. In S. M. Chown (Ed.), Human aging (pp. 25-34). New York: Penguin.

Measuring Intelligence and Cognitive Function in Adulthood

A middle-aged woman in a cap and gown holding a diploma
How, if it all, does intelligence change as you age?

Intelligence represents a complex intersection of cognitive functions, so any study of intelligence is inevitably an exploration of a multitude of cognitive abilities. You will examine some evidence from research on whether intelligence changes with age and how researchers have tried to measure such changes. The study of changes in adult intelligence and cognitive aging has progressed through several phases as the pendulum of opinion has swung from one extreme to the other throughout U. S. history.

The Army Alpha Test

Three soldiers loading a canon in World War I
Like all those who served in the U.S. Army during World War I, these soldiers could have been selected to take the Army Alpha Test.

Intelligence testing was first used on a large scale during World War I when U S Army researchers developed a paper-and-pencil IQ test called the Army Alpha Test. The Army gave this test to several hundred thousand new recruits as well as to thousands of career military men to determine whether they were better suited for officer training or for peeling potatoes. Although most of the soldiers who took the Army Alpha Test were in their late teens or early 20s, some were as old as 60.

In the years after World War I, researchers began studying the question of whether intelligence changes with age across the adult years. The first thing that they did was to go back to the Army Alpha Test to compare the scores from the various age groups. This is an example of a cross-sectional study, in which different age groups are tested at the same point in time.

Depressing Results

In the top graph, X-axis plots age, and y-axis plots Army Alpha score.  The plot line shows a rather steady decline in test results from 18 years old to 60 years old. In the bottom graph, X-axis plots age, and y-axis plots Primary Mental Abilities score.  The plot line shows an increase from 20 to the peak at 31-35 and then a fairly steady decline to age 70.

The standard scores on the Army Alpha Test for the various age groups are shown in the top graph. As you can see, men in their mid-20s performed much better than those in their 30s.

These results stimulated a boom in research on intelligence and aging. As the bottom graph shows, the pattern of results from these studies suggested that intellectual ability peaks during late adolescence or early adulthood and then declines steadily as shown in the bottom graph.

The picture looked bleak for older people. By the 1950s, hundreds of cross-sectional studies had been published on adult intelligence, and almost all of them showed a dramatic drop in intelligence after age 30 or 35. The results were so consistent that David Wechsler, a leading researcher, said in 1958, “Almost all human abilities show a progressive decline with age.”

Source:

Top graph: Jones, H.E. (1959). Intelligence and problem-solving. In J.E. Birren (Ed.). Handbook of aging and the individual. Chicago: Univ. of Chicago Press.

Bottom graph: Schaie, K.W. (1988). Variability in cognitive functioning in the elderly: Implications for societal participation. In A. Woodhead, M. Bender, & R. Leonard (Eds.), Phenotypic variation in populations: Relevance to risk management. New York: Plenum Press.

The Pendulum Swings from Pessimism to Optimism

X-axis plots age, and y-axis plots intelligence test scores.  The longitudinal study line shows a slight peak on test scores around 55-60, but otherwise, line is pretty steady from age 15 to 88.  The cross-sectional study line shows a steady decline in test scores from 25 to 88 years of age.
Do you think either of these patterns accurately represents intelligence as people age?

By the 1950s, some researchers had begun using longitudinal studies, a research method in which the same group of individuals is tested several times over a period of years. Studies of cognitive aging using this method showed a completely different pattern of results. IQ scores held steady or even improved through middle adulthood as shown in this graph that compares typical longitudinal results with typical cross-sectional study results.

The difference between the results from the two types of studies was dramatic and troubling. Which pattern represents the truth about intelligence and cognitive aging?

By the late 1960s, researchers thought that they had the answer. They had concluded that cross-sectional studies exaggerated the effects of aging, and they began to place more weight on the results from longitudinal studies. After all, even developmental researchers are afraid of growing old, so it is not surprising that the pendulum swung toward optimism with most researchers believing that intelligence holds steady or improves with age.

Source: (Schaie, 1988)

A Closer Look at Cross-Sectional Research

Two 20-year-old couples from the 1940s, a college classroom of women from the 1950’s, and a couple from the 1960’s.
These twenty-something-year-olds were typical of their eras, respectively, around 1940, 1950, and 1960.

Why did researchers begin to believe that cross-sectional studies exaggerated the effects of aging on intelligence? Let’s examine what actually happens in research that uses a cross-sectional design.

Researchers refer to a group of people born at about the same time in history as a cohort. Every cross-sectional study tests several different cohorts at the same time. A sample cross-sectional design is shown in this table with the values in each cell representing people’s age at the time of the testing.

Using this approach, can we conclude that a difference between younger adults (the 40-year-olds) and older adults (the 60-year-olds) is the result of aging? Maybe but maybe not. The problem is that cross-sectional studies confound age and cohort. These types of studies mix the effects of age and cohort together making it impossible to isolate what factor might be correlated or even causing a change in performance.

Table shows that 1940 cohort was 40 in 1980, 50 in 1990, 60 in 2000, and 70 in 2010.  1950 cohort was 30 in 1980, 40 in 1990, 50 in 2000, and 60 in 2010.  1960 cohort was 20 in 1980, 30 in 1990, 40 in 2000, and 50 in 2010.  This graph highlights how a cross sectional study would take a sample of different age groups and study them at the same time, so if, for example, you were conducting a cross-sectional study in 2000, you might pull your sample from those who were 60-years-old, 50-years-old, and 40-years-old in 2000.  It is a visual representation of how a cross-sectional study confounds the effects of age and cohort.
Source: (Schaie, 1988)

A Closer Look at Cross-Sectional Research (continued)

In cross-sectional studies of intelligence, the key difference among cohorts is education. Historically, younger cohorts have the benefit of growing up in a society that increasingly values education. Possibly because of shifts in the economy, younger generations are more likely to be freed up to and/or expected to pursue their education. Therefore, younger cohorts are likely to have had more and possibly better schooling, a factor that might explain the difference in performance on the intelligence tests among different age groups.

This first graph shows how a cohort difference in education could affect the results of a hypothetical cross-sectional study. At first, the difference appears to be an age difference. Click to the next screen to see what this graph looks like when we examine the performance of the cohorts over time (projecting into the past and future).

A Closer Look at Cross-Sectional Research (continued)

In the second graph, we see that it is actually a cohort difference.

A Closer Look at Longitudinal Research

Table shows that 1940 cohort was 40 in 1980, 50 in 1990, and 60 in 2000.  1950 cohort was 30 in 1980, 40 in 1990, and 50 in 2000.  1960 cohort was 20 in 1980, 30 in 1990, and 40 in 2000.
Source: Schaie, 1988

In the 1960s, researchers recognized that cross-sectional studies confound age and the effects of growing up in a particular cohort making the results about cognitive aging look more pessimistic than they may have actually been. The recognition of this flaw led to a period in which longitudinal studies were believed to be the path to the truth about aging and intelligence. Unfortunately, by the mid-1970s, researchers began to recognize that longitudinal research also has its own problems.

In longitudinal studies of intelligence, performance may differ simply because when people take the same test again and again over many years, their performance tends to improve. The more often that they take the test, the more familiar participants are with the intelligence skills or abilities being tested. Therefore, older research participants are likely to perform better on the tests as they have had more practice having taken the test more often. Because longitudinal studies mix together the effects of age and frequency of testing, we cannot tell whether a specific difference in performance is due to the test-takers age or to some other differences between the testing times.

A Closer Look at Longitudinal Research (continued)

This graph plots the performance of 30 participants in a longitudinal study on a test.  At the first test-taking of the longitudinal study, their performance ranged from 10% to 90%, and the average score was 50%.  At the second test-taking of the longitudinal study, only 20 participants remain.  Their performance ranged from 30% to 90%, and the average score was 60%.  At the third test-taking of the longitudinal study, only 10 participants remain.  Their performance ranged from 50% to 90%, and the average score was 70%.

An even more serious problem is selective attrition, the tendency of some research subjects to be more likely to drop out of a study than others. Because longitudinal studies take place over a very long period of time, research participants may drop out of these studies for various reasons. In many cases, the research participants who drop out by choice, rather than, for example, for health, job, or relocation reasons, may be the subjects who initially had the lower IQ scores or did not enjoy the test-taking experience. Those who remain in the study tend to have demonstrated more success on the earlier IQ tests. The continuing and consistent participation of these higher scorers can artificially inflate the research results over time.

This graph demonstrates an extreme example of selective subject loss and note how this non-random loss can affect the mean score of the group over time.

Summary

This graph addresses the complexity of IQ and measures how working memory, short-term memory, long-term memory, speed of processing, and verbal knowledge change over time.  The general trend is that working memory, short-term memory, long-term memory, and speed of processing do decline with age.  Verbal knowledge is the only aspect that increases gradually until the 70s when it then shows a slight decline into the 80s.

The realization that longitudinal studies of intelligence and aging have unique problems that can make their results overly optimistic has helped researchers to achieve a more balanced view of the whole process of cognitive aging.

Combining the features of both longitudinal and cross-sectional research, some researchers employ a cohort-sequential design that begins with a longitudinal study of one cohort and then repeats the longitudinal study with the next cohort at the same age intervals as the first cohort. This method allows researchers to address the weakness of the cross-sectional study by isolating the effects of cohort. Cohort-sequential studies of IQ generally show results that are nestled between those of cross-sectional and longitudinal designs.

Still other researchers have studied a broad array of tests of mental performance yielding a more nuanced view of IQ across the life span. The fact that IQ has been so readily tested throughout our history gives an oversimplified impression of intelligence. In fact, IQ does represent a very complex blend of a multitude of cognitive functions. In today’s research environment, researchers must ask which cognitive facet of intelligence is being studied. For example, speed of processing and working memory capacity generally do diminish to some degree with age whereas vocabulary and world knowledge generally remain steady or even increase over time.

Taken as a whole, the study of IQ and cognitive aging is a good example of the evolving nature of scientific research.

Source:

Park, D. C., Lautenschlager, G., Hededen, T., Davidson, N., Smith, A. D., & Smith, P. K. (2002). Models of visuospatial and verbal memory across the adult life span. Psychology and Aging, 17, 299-320.

Assessment: Check Your Understanding

A middle-aged man working on a laptop in a research library

Question 1.1

dpdhCJqNqczBjUj9hlqL4tbiDfSNeN7j/pi5STehxMKQPGGQGjKYlw1iu64g9nQZuF8UKu7RYD5EgSNdaILRI5oNtLuLUVPhBxm1nZqhvoaOd+3DuPP8wpQxVmlaypto5yC/VsM0WtPyaNODYoNt7QS6woJEnFXnaGSvYLlVvxnWYzZxDC4i+By07X8g10fzGwoJiiiPoxiSFofbwbVFC5BH5jGvq+8iSJcwdwSMGyBccy+rjCZ/wMG1F/AJu99uvaevqC26SD40mjv7yHTainQezStPcCbKuBgreDPi7cT8kY/1vlP6nMaNS7P3LR4kaI8nCvFbkB3y/PPBaOOu1koULEg8z3IqGkLHD8Iw4KvPcQp0kLzXLo8aoLA0BvWpapPKcKfRdWwFo2ctuMUAE53Z5YAABmWaTfyzgLKCS/a9w7SEwEM1vLv6/R3wLLJ16wOvZ78ucJnJnB0rjHM3O9eD5ndZRUFD/d92BesKjoYU6Q1HtXUaSw==
Correct! Cross-sectional studies test a cross-section of age groups at the same point in time. Researchers regard this method as less appropriate than longitudinal studies for measuring intellectual change.
Sorry. Cross-sectional studies test a cross-section of age groups at the same point in time. Researchers regard this method as less appropriate than longitudinal studies for measuring intellectual change.

Assessment: Check Your Understanding

A middle-aged woman in a cap and gown holding a diploma

Question 1.2

Gl/aTnah2QzpfPvWNqV2Rag0EUy21wltB02V0IZW2IWzuFrR0Ajt97hmfSYpJmLengQVLoj5qg6lQQvmYYOeLjvpuErJ1rlfjrbwJepyUwiIvD8jUqB4uRUJ1X9drQBgNLQqnPY43FovRKvOObBiUyk8ktcmXWCT5NhAhabiqXRZejgdQRsBLPOR21B1ZbNNk59wwc54nkXPsA3hGl1aljLbOK5xsKSoVSN0lsautrblFVoQfhtIYwhI56jFRDFRduxMTgh5qUM0G+DVyu7IIP1STEum9gbSd9EWpIEfJZ6+ZR4bJAr2EVjEQYKO4orVK16yPxiPbDwtsV8/Xq0M+znyWxTdTe+qLH6skKO5b2Z0GSPeRZ6qLR4CTSX6TX1YnarImGoI8eE3Jhj0YJVOuhWg51Jw2M7EoOR4XyPq6YSEEDpEtvpyMNsDs1bTNtv4bFCGiNm/ClfZJOkT81n2wTyTKMY=
Correct! Cross-sectional studies confound the effects of age and cohort so that we can never be sure whether any difference between the age groups is due to age itself or to different generational experiences.
Sorry. Cross-sectional studies confound the effects of age and cohort so that we can never be sure whether any difference between the age groups is due to age itself or to different generational experiences.

Assessment: Check Your Understanding

Three soldiers loading a canon in World War I

Question 1.3

/crmNi1XZFy7lBSo9rafw5a8atgdLKZ/QFL6fw2OtYOOU299H+uiKbzN4vaZXPiSzcrurmNr0hskpoiHGqvgoe+N45eMRNr6Rcs9yvA+hxoOS3X+Nbz/g15FFUcBP1k+YiB/RyqXv3YdrWQyZIotJnn6n8otXBWq
Correct! Longitudinal studies also suffer from confounding in that they mix together the effects of age and time-of-testing effects.
No. Longitudinal studies also suffer from confounding in that they mix together the effects of age and time-of-testing effects.

Assessment: Check Your Understanding

Two 20-year-old couples from the 1940s, a college classroom of women from the 1950’s, and a couple from the 1960’s.

Question 1.4

72AJjeU7oSfTjTKJpB7md1+AJligtITtU4F8aahLfMwq4Bztu3V3p8YNQ4Ivs07QgEIBNtp9F/JRUfMB/YypHjyQJSRuMuSson4BCQfFimQ605W+U5W2lL01RtKMqLEPN9620wmRJfWQB819HquXQmM0dR30RcPXrBAPRacqSS4haMRSYCbfGSbz4XXWpl1/6l/wsNCX4H+PXiur9Rx4Qw==
Your answer should include the idea of movement (like a pendulum) back and forth between two extremes. The early cross-sectional study results led to pessimism about cognitive losses during adulthood. When the pendulum swung too far toward pessimism, researchers began to wonder whether the method itself might be biasing the results. This skepticism led to longitudinal studies which yielded more optimistic results. Once again, when the pendulum swung too far in that direction, researchers began to realize that longitudinal studies had their own problems. Today, we have a more balanced view about aging, intelligence, and cognitive function, but we need to keep our minds open to the possibility that new research may change our perspective yet again.

Congratulations! You have completed this activity.Total Score: x out of x points (x%) You have received a provisional score for your essay answers, which have been submitted to your instructor.