US Department of Education Data on “Autism” Are Not Reliable for Tracking Autism Prevalence

Abstract
Many autism advocacy groups use the data collected by the US Department of Education (USDE) to show a rapidly increasing prevalence of autism. Closer examination of these data to follow each birth-year cohort reveals anomalies within the USDE data on autism. The USDE data show not only a rise in overall autism prevalence with time but also a significant and nearly linear rise in autism prevalence within a birth-year cohort as it ages, with significant numbers of new cases as late as 17 years of age. In addition, an unexpected reduction in the rise of autism prevalence occurs in most cohorts at 12 years of age, the age when most children would be entering middle school. These anomalies point to internal problems in the USDE data that make them unsuitable for tracking autism prevalence.
The prevalence of autism and whether that prevalence is rising are 2 of the many controversies surrounding this disorder. Much of the controversy is attributable to the difficulty of finding good data. A number of studies have examined the prevalence of autism and related disorders1–6 in a number of different populations and periods. However, all of these studies are constrained by time and funding to examining either a relatively small population or relatively few points in time.
Many autism advocates have used data from the United States Department of Education (USDE) in their presentations to lawmakers7 and the public to show a dramatic and accelerating rise in the prevalence of autism in the United States. Because these data are being used to influence public policy, it is critically important to know if they can be used to reliably measure the prevalence of autism.
This study examined the autism data collected by the USDE by following individual birth-year cohorts through time. It also examined the methods used to collect the USDE autism data and compared those with the methods used by medical practitioners to diagnose autism.
METHODS
Under the provisions of the Individuals With Disabilities Education Act (IDEA), the USDE Office of Special Education Programs collects data on children who qualify for special education assistance. This information is presented to Congress each year in an annual report that is available to the public. The number of children with a qualifying condition of autism has been collected and reported every year since 1992 (voluntary in 1992, mandatory 1993 to present).
USDE data provided the number of children in each single-year age group with the IDEA-qualifying condition of autism. This information was found in the Office of Special Education and Rehabilitation Services’ 14th through 25th Annual Reports to Congress.8 These data are collected by the USDE from the education departments of each state (also from the District of Columbia, Puerto Rico, Guam, and other US possessions and territories), which in turn collect them from the individual school districts. The assessment criteria for autism (and the other IDEA-qualifying categories) are based on legislation passed by the individual state legislatures, as interpreted by the state education departments and local school districts.
Only data from 1993 and later were used, as autism was not reported separately until 1992 and mandatory reporting did not begin until 1993. The study was also restricted to ages 6 through 17 years because children who are younger than 6 and older than 17 are generally not required to attend school and seem to be underrepresented in the USDE data.
Population figures for each single-year age group were obtained from the US Census Bureau and were derived from the 1990 and 2000 decennial censuses. Populations of noncensus years were estimated by the US Census Bureau using their estimation algorithm. Information was extracted from the US Census Bureau’s online database using the DataFerret search and retrieval program (www.dataferrett.census.gov).
Autism prevalence was calculated by dividing the number of children with autism of each age reported to the USDE by the total number of people in the United States of that age in that year. August census estimates were used for noncensus years.
Birth-year cohorts were developed by assigning children of each age to the birth year that corresponded to the middle of that age group (eg, all 6-year-olds in 2000 were assigned to the 1994 birth-year cohort).
χ2 analysis was used to compare autism prevalence within a birth-year cohort from year to year as well as between birth-year cohorts at a specific age. The expected number of autistic children was calculated by taking the prevalence from the reference group and applying it to the population figure for the group being analyzed.
RESULTS
According to the USDE data, overall autism prevalence in children aged 6 to 17 years shows an exponential increase (y = 3.2e0.19x; r2 = 0.999) from 1993 to 2003 (Fig 1). When the data are segregated by birth year, every cohort born after 1980 shows a continuing rise in autism prevalence as the cohort ages (Fig 2). The rise in autism prevalence is surprisingly linear, with r2 values >0.95 in all cohorts from 1984 onward. The rate of rise in autism prevalence also increases in later born cohorts: every cohort in this study had a higher rate of rise in autism prevalence than all earlier born cohorts.
Autism prevalence in the United States among children 6 to 17 years of age (from USDE data).
Autism prevalence in each birth-year cohort according to age (from USDE data).
The autism prevalence from year to year (Table 1) shows a statistically significant increase within birth-year cohorts as they age. This continues to 16 years of age in most cohorts, with half (5 of 10) of the cohorts also showing a significant increase in autism prevalence between ages 16 and 17 years. Later born cohorts have a higher initial prevalence of autism in addition to a faster rate of rise.
Autism Prevalence in Each Birth-Year Cohort According to Age (From USDE Data)
A regular exception to the rising prevalence of autism is the interval between ages 11 and 12 years. Most birth-year cohorts showed either no significant change in autism prevalence (7 of 10) or a small decrease in prevalence (1 of 10) during this interval. Even in the cohorts that had a rise in autism prevalence between ages 11 and 12 years, the rise during this period was less than half the rate of rise for the preceding or (if available) the following age interval (Table 2).
Percentage Change in Autism Prevalence Within Selected Cohorts (From USDE Data) Focusing on the Vicinity of the 11- to 12-Year Age Interval
DISCUSSION
The USDE data on autism seem to indicate that there has been an exponential rise in autism prevalence between 1993 and 2003. They also suggest that there are as many children who are newly categorized as autistic at 15 years of age as there are at 8 years of age. These data also seem to show a consistent break in the rise of autism prevalence between ages 11 and 12 years, with 1 cohort (1988) showing a statistically significant decrease in autism prevalence in this interval. Instead of showing a rise in autism prevalence at the age when most children move from elementary school to the more challenging and less structured environment of middle school, the USDE data show the opposite. All of these point to problems within the USDE data.
Autism, as defined in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV), is a developmental disorder that is usually first observed between birth and 3 years of age. Although it is often diagnosed later, the impairments must be present by age 3 years to make the diagnosis of autism.9 Four recent studies examined age of first diagnosis of autism and suggested that the majority of diagnoses are made before the age of 8 years.
A study of records from British general practitioners found that the mean age at first diagnosis was 6.25 years (SD: 4.52 years).10 A study of 2 cohorts (born 1974–1983 and 1984–1993) in Iceland showed an even younger age at first diagnosis: 3.6 years and 4.0 years, respectively (ranges: 1.7–17 and 2.2–13.8 years, respectively).1 A study of Medicaid-eligible children in Philadelphia, Pennsylvania, had a mean age at first diagnosis of 7.4 years (SD: 3.1 years).11
One study of a single health district in Northern England looked specifically at the difference in timing of medical diagnosis and educational assessment (statement of special educational needs). They found that, for children in mainstream schools, the mean age at diagnosis was 6.5 years (range: 2–12 years) and the mean age of receiving a statement of special educational needs was 5.6 years, indicating that the educational assessment of autism generally preceded the medical diagnosis.12
The interval between ages 11 and 12 years is the time when most children make the transition from elementary school to middle school. Although it might be expected that moving from the structured academic and social environment of elementary school to the more self-directed environment of middle school would “unmask” milder cases of autism, the USDE data show just the opposite. Most (5 of 6) of the cohorts that have complete data for the period surrounding this transition show a greater rise in autism prevalence for the 2 years before middle school than in the 2 years after the transition to middle school.
The USDE data suggest that the prevalence of autism is rising, but is this attributable to an actual increase in prevalence or to a broader definition of autism and greater public awareness? A number of studies have suggested that the diagnosis of autism, even by medical practitioners, has experienced significant drift over time.1,4,5 A review by Wing and Potter13 provides an excellent overview of this problem. A recent study of autism incidence between 1976 and 1997 concluded that the timing of the increase in autism diagnoses suggests that it was attributable to increased awareness and changes in diagnostic criteria.14
Despite the specific diagnostic criteria provided by the DSM-IV, the diagnosis of autism is completely subjective. There are no objective findings, radiologic studies, or laboratory tests that are diagnostic for autism. Even the presence of disorders such as fragile X15,16 or tuberous sclerosis,17,18 which are often associated with autism, are not diagnostic of autism, because only a fraction of patients with these conditions have autism.
Finally, at least 2 studies have suggested that autistic traits are not a discrete feature seen only in the presence of autism but rather are a continuum. As such, a certain degree of “autistic” behaviors can be expected in many “typical” individuals.19,20 This further complicates the diagnosis of autism, because there is no distinct “cutoff” point between typical and autistic. There are indications that the increasing awareness of autism in the medical and educational communities may have led to a gradual shift in diagnosis to include less disabled individuals who would not previously have been described as autistic13 or would have received a different diagnosis.5
Although the diagnosis of autism seems to have changed with time, the guidelines for educational assessment of autism also vary from state to state. With only 10 qualifying disabilities under IDEA,21 the assessment criteria used by the states are understandably broad. As, perhaps, an extreme example of this, compare a section of the diagnostic criteria for autism from the DSM-IV with the corresponding section of the assessment criteria used in the state of Oregon (from the Oregon Administrative Rules [OAR]):
DSM-IV:
“(1) qualitative impairment in social interaction, as manifested by at least two of the following:
(a) marked impairment in the use of multiple nonverbal behaviors such as eye-to-eye gaze, facial expression, body postures, and gestures to regulate social interaction
(b) failure to develop peer relationships appropriate to developmental level
(c) a lack of spontaneous seeking to share enjoyment, interests, or achievements with other people (eg, by a lack of showing, bringing, or pointing out objects of interest)
(d) lack of social or emotional reciprocity”10
OAR:
“(ii) Impairments in social interaction”22
The criteria found in the OAR are obviously much broader and more general than those in the DSM-IV. The choice of Oregon for this comparison was not random: Oregon has consistently had the highest prevalence of autism in the USDE data of any state (2 to 3 times the national prevalence) since autism was first reported as a separate disability.
As has been shown, the USDE data on autism are at odds with studies of autism prevalence, largely because the criteria used by the school districts (the source of the USDE data) to categorize children as autistic are neither rigorous nor consistent. They are inconsistent over time, as are the medical criteria, and are inconsistent from region to region. The USDE data are not reliable for tracking the prevalence of autism, and they in fact never were meant to fill this need.
Footnotes
- Accepted January 13, 2004.
- Reprint requests to (J.R.L.) Department of Biology, Portland State University, PO Box 751, Portland, OR 97207-0751. E-mail: laidlerj{at}pdx.edu
No conflict of interest declared.
REFERENCES
- ↵Magnusson P, Saemendsen E. Prevalence of autism in Iceland. J Autism Dev Disord.2001;31 :153– 163
- Chakrabarti S, Fombonne E. Pervasive developmental disorders in preschool children. JAMA.2001;285 :3093– 3099
- Bertrand J, Mars A, Boyle C, Bove F, Yeargin-Allsopp M, Decoufle P. Prevalence of Autism in a United States population: the Brick Township, New Jersey, investigation. Pediatrics.2001;108 :1155– 1161
- ↵Baker H. A comparison study of autism spectrum disorder referrals 1997 and 1989. J Autism Dev Disord.2002;32 :121– 125
- ↵Croen L, Grether J, Hoogstrate J, Selvin S. The changing prevalence of autism in California. J Autism Dev Disord.2002;32 :207– 215
- ↵Yeargin-Allsopp M, Rice C, Karapurkar T, Doernberg N, Boyle C, Murphy C. Prevalence of autism in a US metropolitan area. JAMA.2003;289 :49– 55
- ↵Autism—why the increased rates? A one-year update: hearings before the Committee on Government Reform, 107th Congress, 1st Session (April 25–26, 2001). Available at: http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=107_house_hearings&docid=f:76856.wais. Accessed May 5,2005
- ↵US Department of Education. Twenty-fifth Annual Report to Congress on the Implementation of the Individuals with Disabilities Education Act. Washington DC: US Government Printing Office; 2003 (data extracted from 14th through 25th annual reports)
- ↵American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed, Text Revision. Washington, DC: American Psychiatric Association;2000:70– 75
- ↵Fombonne E, Heavey L, Smeeth L, et al. Validation of the diagnosis of autism in general practitioner records. BMC Public Health.2004;4 (1):5. Available at: www.biomedcentral.com/1471–2458/4/5
- ↵Mandell DS, Listerud J, Levy SE, Pinto-Martin JA. Race differences in the age at diagnosis among Medicaid-eligible children with autism. J Am Acad Child Adolesc Psychiatry.2002;41 :1447– 1453
- ↵Keen D, Ward S. Autistic spectrum disorder: a child population profile. Autism.2004;8 :39– 48
- ↵Wing L, Potter D. The epidemiology of autistic spectrum disorders: in the prevalence rising? Ment Retard Dev Disabil Res Rev.2002;8 :151– 161
- ↵Barbaresi WJ, Katusic SK, Colligan RC, Weaver AL, Jacobsen SJ. The incidence of autism in Olmsted County, Minnesota, 1976–1997. Arch Pediatr Adolesc Med.2005;159 :37– 44
- ↵Philofsky A, Hepburn SL, Hayes A, Hagerman R, Rogers SJ. Linguistic and cognitive functioning and autism symptoms in young children with fragile X syndrome. Am J Ment Retard.2004;109 :208– 218
- ↵Bregman JD, Leckman JF, Ort SI. Fragile X syndrome: genetic predisposition to psychopathology. J Autism Dev Disord.1988;18 :343– 354
- ↵Bolton PF, Griffiths PD. Association of tuberous sclerosis of temporal lobes with autism and atypical autism. Lancet.1997;349 :392– 395
- ↵Baker P, Piven J, Sato Y. Autism and tuberous sclerosis complex: prevalence and clinical features. J Autism Dev Disord.1998;28 :279– 285
- ↵Constantino JN, Todd RD. Autistic traits in the general population: a twin study. Arch Gen Psychiatry.2003;60 :524– 530
- ↵Constantino JN, Hudziak JJ, Todd RD. Deficits in reciprocal social behavior in male twins: evidence for a genetically independent domain of psychopathology. J Am Acad Child Adolsc Psychiatry.2003;42 :458– 467
- ↵Education of Individuals With Disabilities, USC Title 20, Ch. 33, Sect 1401 (1997)
- ↵Special Education, Oregon Administrative Rules, Sect. 581-015-0051 (1998)
- Copyright © 2005 by the American Academy of Pediatrics