ARTICLE |
a Pallas, Health Research and Consultancy, Rotterdam, Netherlands
b Youth Healthcare Services, Regional Health Authority (GGD Regio Twente), Enschede, Netherlands
| ABSTRACT |
|---|
|
|
|---|
METHODS. This retrospective study assessed school performance and social-emotional behavior before and up to 3 years after the disaster. Objectively measured school test results in spelling and arithmetic/mathematics and multi-informant social-emotional behavioral assessments were compared between exposed and nonexposed primary school children. Multivariate logistic-regression was used to assess the relationship between exposure and cognitive and social emotional functioning.
RESULTS. On school performances, the children exposed to the disaster performed over a period of 3 years after the disaster as good as or better than classmates, controls, and a national reference population. Shortly after the disaster, exposed children even seemed to have better school test results than nonexposed children. Two to 3 years after the disaster, a significant effect of disaster exposure was found on social-emotional behavior. Problematic behavior was reported by teachers, parents, and the school doctor.
CONCLUSIONS. This study demonstrates a limited influence of disaster exposure on school performance in primary school children. This study also shows that teachers and youth health care practitioners especially should be aware of children starting school several years after a disaster. Although very young at the time of a disaster (1–4 years of age), they may experience disaster-related problems.
Key Words: disaster children school performance behavior epidemiology
Abbreviations: PTSD—posttraumatic stress disorder AS—affected area schools CS—control school SES—socioeconomic status LSPPK—National Checklist for Indicating Psychosocial Problems in Five/Six Year Olds SDQ—Strengths and Difficulties Questionnaire OR—odds ratio CI—confidence interval
On May 13, 2000, a storage facility for heavy fireworks exploded in a residential area in Enschede, the Netherlands. This disastrous event resulted in the immediate death of 22 people, and >1000 others were injured. The explosions caused tremendous damage to homes in the surrounding neighborhood; >500 houses were destroyed, and >1000 houses were damaged. More than 800 primary school children were exposed to the disaster.
Several studies of children exposed to traumatic situations have reported a spectrum of posttraumatic symptoms including posttraumatic stress disorder (PTSD), anxiety, regressive behaviors, problematic social behaviors, sleep disturbance, attention problems, and school problems.1–6 Yule,3 for instance, reported that 11- to 18-year-old children who survived the sinking of a cruise ship developed specific fears related to trauma and showed significantly higher scores on anxiety and depression. Fourteen months after a hurricane, exposed preschool children showed significantly higher anxiety and withdrawal and more behavior problems than did children who had not experienced the hurricane.7 Studies analyzing school performance generally report decreased cognitive functioning in exposed children. After the Buffalo Creek flood, for 5- to 11-year-olds, decreased school performance the semester after the disaster was most likely for the children with the most persisting postdisaster symptoms.8 Shannon et al5 studied self-reported school performance 3 months after Hurricane Hugo among 9- to 19-year-olds. Children positive for PTSD showed a significant decrease in school performance as compared with controls. A group of school-aged girls (adolescents) who survived a ship's sinking had had superior performance before the disaster but obtained only average grades a year later. The disaster survivors also had lower scores than control subjects on final examinations 2 years after the disaster.9 Decreased school performance might have severe negative consequences for children. Long-term impairment may lead to considerable learning disabilities. It also may lead to social emotional problems, that is, loss of self-respect and negative self-esteem.10 Moreover, behavioral and emotional problems are associated with the development of psychopathology.11
Information regarding school performance among disaster-exposed children is very limited. Most of the performed studies examined the relatively short-term consequences, used self-reported measures, or only analyzed postdisaster data. Moreover, few studies focused on primary school children. In 2003, the present study was, therefore, started to evaluate the cognitive and social-emotional consequences of the firework disaster among primary school children. It was conducted within the framework of the Enschede Firework Disaster Health Monitoring Project.12 The main objective of this health surveillance project was to acquire information for health care providers and policy makers to match aftercare services to problems of the target group. Our study was designed to determine to what extent cognitive and social-emotional problems occurred among primary school children (aged 4–12 years) exposed to a disaster and how the occurrence changed over time. We systematically analyzed school performance and behavior for 4 school years among a general population of exposed and nonexposed primary school children.
| METHODS |
|---|
|
|
|---|
Primary education in the Netherlands lasts 8 years, for children aged 4 to 12 years. The primary schools are divided into 8 classes, each containing one age group. The study population consisted of children who attended the participating schools in the school year 2002–2003 (all 8 grades), lived in the town of Enschede at the time of the disaster, and whose parents gave written informed consent. More than half (54%) of the actual school population participated in the study. The total subject pool consisted of 720 children (aged 4–12 years). Of these children, 452 attended the schools near the affected area (193 exposed and 259 nonexposed) and 268 attended the CS. Demographic characteristics of the study population are presented in Table 1. The proportion of exposed children among the participants in the study was equal to that of the complete school population at the 4 participating schools near the affected area. At the time of the firework disaster (May 2000), the children in the study population were 1 to 9 years of age.
|
Measures
Demographic Data
Information about the children's grade, ethnicity, nationality, gender, and socioeconomic status (SES) was obtained through school databases. The indicator for SES available was based on 2 variables: the child's country of birth and the parent's occupational or educational status. SES was scored "low" if children of Dutch origin had 2 parents with a lower educational status or if children of non-Dutch origin had
1 parent with a lower educational or occupational status and scored "moderate/high" for the other children.
Disaster Exposure and Other Life Events
Disaster-related information (ie, the child's location during the explosions and the locations of the child's home) was collected from school files. In some cases an additional questionnaire was filled out to provide these data. Children were included in the exposed group if they met
1 of the following criteria: (1) child's home was located in affected area (geographically defined area by city council); (2) child's home was destroyed or damaged; (3) child was present in affected area during explosions; (4) child was injured; and (5)
1 family member, friend, or schoolmate died or was injured. Information about life events other than the firework disaster also was collected from school files, that is, hospitalization, death of a family member, divorce, (possible) sexual abuse, and so forth. An event was considered present from the moment it occurred in the school file.
Cognitive School Performance
Information about school performance and behavior was collected from the children's school files. By using data usually registered at school, predisaster data about school performance and behavior also could be analyzed. All of the participating schools used the same standard tests to measure school performances throughout primary education. These are reliable and validated tests provided by the Central Institute for Educational Measurement, known as Cito-tests. The periodic nature of the assessments (half-yearly: summer and winter tests) made it possible to compare the situation at different points in time. Children's test results in the following 2 main educational domains were selected: Dutch language (spelling) and arithmetic/mathematics (numbers and operations involving addition, subtraction, multiplication, division, fractions, percentages, and proportions). Based on the number of questions answered correctly, the Central Institute for Educational Measurement constructs test scores. These test scores are transformed into 5 levels (A to E) based on a national representative sample. Levels A to C are assigned to the highest 75% of the scores, whereas levels D and E are assigned to the lower 25% of the scores.13
These tests were made by pupils in grades 3 to 8 (6- to 12-year-olds). Results of specific tests for children in the first 2 years of primary education (aged 4–6 years) were also collected. However, the study population of these young children was too small to analyze the data properly.
Social-Emotional Behavior
Information on social-emotional behavior was based on annual teacher's reports and data from the regional health authority (school doctor). Teachers regularly (yearly) keep a record of the performance of each child concerning playing behavior (quality and playing together), work behavior (attitude to work and working according to plan), and social behavior (social initiative, aggression, self-esteem, assertiveness, and rule-breaking behavior). They indicate behavior on a general behavior problem checklist on a 3-point scale. Behavior was scored "problematic" if the score was 1 or 2 and scored "desirable" for children with a score of 3. For instance, for the item "playing together," the corresponding scores were as follows: (1) "the child is mainly playing alone," (2) "the child is occasionally playing together with others," or (3) "the child is sufficiently playing together with others." Records were kept for pupils in grades 1 to 8 (4- to 12-year-olds). Those teacher's reports are structured questionnaires but have not been properly tested for reliability and validity.
To obtain data from multiple informants, data about behavior collected by the youth health care department of the regional health authority of Enschede were also analyzed. In the Netherlands, school doctors examine children several times during their school careers. Our population visited the school doctor in grades 2, 4, and 7. To identify psychosocial problems, question forms were filled out by parents and/or the school doctor. For pupils in grade 2, the LSPPK (Dutch acronym for National Checklist for Indicating Psychosocial Problems in Five/Six Year Olds) was used14; for children attending grade 4 and 7, the Dutch version of the Strengths and Difficulties Questionnaire (SDQ) for parents was used.15 The LSPPK is a 9-item questionnaire developed for the purpose of examining 5- to 6-year-olds. Parents are asked to fill out the checklist at home and discuss it during their visit to the school doctor (parent index). After the meeting, the school doctor adds his/her opinion to every item (child health professional index). The items cover 3 domains: behavioral, cognitive development, and emotional problems. Problems are considered present if the category "worried a bit" or "very worried" is indicated and absent with the category "not worried." Data from a national reference population are available.16 For a score of 3 to 4 items of concern mentioned by the parents, school doctors seriously consider referring children to mental health service for making a proper diagnosis and possibly further preventive actions.14 Any problem indicated on the child health professional index is also considered to indicate a serious problem that needs referral to a mental health professional.17 The SDQ is a short behavioral screening questionnaire consisting of 25 items. The SDQ version that was used was filled out by the parents. They rated the presence of certain behaviors on a 3-point scale (0 = not true, 1 = somewhat true, and 2 = certainly true). The time period was the last 6 months. The 25 items were divided between the following 5 scales: emotional symptoms, conduct problems, hyperactivity, peer problems, and prosocial behavior. The first 4 scales were also added together to generate a total difficulties score. Cases were allocated to a reference range, a borderline range, or a clinical range of the scoring distributions based on the British normative sample, because the Dutch normative sample was considered biased.18 Cutoffs were set at the 90th percentile for the clinical problems and at the 80th percentile for the borderline problems. LSPPK and SDQ data were only available 2 and 3 years after the disaster (school years 2001–2002 and 2002–2003). Because pupils visit the school doctor only in grades 2, 4, and 7, analyses were performed on part of the original subject sample. A total of 111 grade 2 pupils visited the school doctor in 2001–2002 and 2002–2003 (21 exposed, 50 nonexposed at AS, and 40 controls). SDQ data were available in those years from 247 grade 4 and 7 pupils (56 exposed, 73 nonexposed at AS, and 118 controls).
Data Analysis
A cross-sectional approach was used to evaluate school performance and social-emotional behavior before and at different points in time after the disaster. The percentage of children with low school performance levels/problematic behavior was compared between exposed and nonexposed children of the schools close to the affected area and between all of the children at the AS and the children at the CS. Because of small numbers, grades were pooled in the analyses. Therefore, in these analyses, the composition of the group for exposed and nonexposed children slightly differed for each year, because children in the lower grades were not yet attending school in earlier years (see data collection paragraph).
We also analyzed changes over time in school performance and behavior for the subgroup of children who were already attending school when the disaster occurred (grades 4 or higher; referred to as "longitudinal analyses"). In those analyses, every year the same group of children contributes to the group of the exposed, nonexposed, and control subjects. The proportion of children with decreasing school performance or behavior after the disaster compared with before the disaster was compared between exposed and nonexposed children of the schools close to the affected area and of all of the children at the AS with the children at the CS. The relationship between exposure and cognitive and social emotional functioning was assessed by means of multivariate logistic regression. In the cross-sectional analyses, the outcome was dichotomized as low score versus average/good score for school performance, as problematic versus desirable behavior for social-emotional functioning, and in the longitudinal analyses as a decrease in school test levels/behavior score versus stable or improved school test levels/behavior score. All of the independent child variables were dichotomized. Odds ratios (ORs) and 95% confidence interval (CIs) adjusted for SES, school/grade, and other life events are presented in the analyses of differences between groups in school performance and behavior. Significance was at an
level of .05. All of the statistical analyses were performed using SPSS 11.05 for Windows (SPSS Inc, Chicago, IL).
| RESULTS |
|---|
|
|
|---|
2 tests of independence for demographic characteristics in the third school year after the disaster. The percentage of exposed children was not the same for all 4 of the schools close to the affected area; for 1 school in particular it differed (data not shown). Exposed children had a lower SES than the nonexposed children. In the first year after the disaster, exposed children had experienced more life events other than the firework disaster than nonexposed children (data not shown). Children attending the AS had lower SES and were in different grades as compared with those attending the CS. In the logistic regression analyses, we adjusted for these variables. No significant differences were found for gender.
School Performance
Table 2 shows cognitive school test results before and after the disaster. At the AS, shortly (2–4 weeks) after the disaster a significant relationship between disaster exposure and cognitive functioning (spelling test) was found. The proportion of nonexposed children with low levels (32.5%) was higher than that of exposed classmates (22.5%). At that moment, the children in the sample attended grades 3 to 5 (aged 6–8 years). Overall, the study sample subjects performed similar to or better than the national reference sample subjects (25% low levels), except the nonexposed children shortly after the disaster, as mentioned before. In analyses by gender, shortly after the disaster an effect of disaster exposure was seen among both girls and boys. At the AS, 2 to 4 weeks after the disaster, exposed girls seemed to have performed better in the language test than nonexposed girls (5% vs 24% low levels). Exposed boys performed better the semester after the disaster in the arithmetic/mathematics test than nonexposed boys (8% vs 22% low levels). However, both of these differences were not significant (P = .17 and P = .06, respectively).
|
In addition, a longitudinal analysis of performance was conducted for a constant group of children from higher grades. Only those children who already attended school when the disaster took place were included. At the schools close to the affected area, no significant difference between the exposed and the nonexposed subjects was found on school performance (results not shown). Comparison of the total AS sample with the CS showed a significantly stronger decrease in test levels for both language and arithmetic/mathematics (1 and 2 years after the disaster, respectively) among CS children versus AS children.
Social-Emotional Behavior
Annual Teacher's Reports
At the schools close to the affected area, the variable on which the exposed and nonexposed children differed significantly was the teacher's report of problematic social behavior 2.5 years after the disaster, indicating 37.8% of exposed children as showing problematic social behavior versus 22.2% of nonexposed children (Table 3). Separate analyses for boys and girls revealed an effect of disaster exposure among boys (OR: 2.62; 95% CI: 1.13–6.09).
|
Parent's and School Doctor's Reports
In school years 2 and 3 after the disaster, no differences were found between exposed and nonexposed grade 2 children at the schools close to the affected area with respect to concerns by parents or the school doctor (LSPPK data). Only parents of exposed children reported significantly more worries and fears for their children (adjusted OR: 3.92; 95% CI: 1.01–15.3). Also compared with normative data, parents of exposed children mentioned these concerns far more often (35.0% vs 2.5% in a national reference population). However, no significant effect of disaster exposure was found for the school doctor's perception of these children's worries/fears. According to the school doctor's opinion, these worries/fears were related to other life events than the firework disaster.
When all of the grade 2 children at the AS are compared with the CS, school doctors mention significantly more often concerns for children at the schools close to the affected area (adjusted OR: 4.35; 95% CI: 1.11–17.1). The school doctor reported
1 concern in 34.8% of exposed children and 11.4% of the control subjects (Table 4, LSPPK). Normative data show a prevalence of 21.1%.16 Any concern mentioned by the school doctor is considered to indicate a serious problem. The school doctor especially indicated significantly more often "demanding attention in an annoying way" for children at the schools close to the affected area (OR: 9.55; 95% CI: 1.04–87.7). Further analysis revealed that there was a significant difference between the exposed children at the AS and CS (and not between those nonexposed at the AS and CS).
|
| DISCUSSION |
|---|
|
|
|---|
For social-emotional behavior, the results suggest that 2 to 3 years after the disaster, parents, teachers, and school doctors had more concerns about exposed children than the nonexposed children. At the time that the disaster occurred, these children were 1 to 9 years of age. The effect of the disaster on children's behavior found by us is generally comparable with earlier studies. Exposed boys seemed to show mainly externalizing symptoms. Teachers reported problematic social behavior of exposed boys, for example, aggressiveness and assertiveness. This finding is similar to earlier studies.19 Previous studies generally report more postdisaster symptoms in school-aged girls than school-aged boys.20,21 In this study, teachers as well as parents indicated more problems for girls at the school near the disaster area. Teachers had concerns about a wide range of behavior problems in these girls (playing and working, as well as social behavior), especially playing behavior. This impaired playing behavior might be in accordance with the parents' opinion indicating disturbances in peer relationships. Very remarkable is the finding that 2 to 3 years after the disaster, the school doctor had concerns about more than one third (34.8%) of the 5- to 6-year-old exposed children. These children, just 1 to 4 years at the time of the disaster, probably developed specific behavior caused by impaired parental functioning.21 The finding of more social-emotional behavior problems 2 to 3 years after the disaster at the schools near the affected area confirms the long-term impact of disaster. It also may suggest that, in the long run, the school-based interventions were not entirely effective in preventing social-emotional problems. However, they might have prevented more serious postdisaster symptoms, because no significant effects on clinical SDQ scales were found. For behavior, more significant differences were found when comparing all of the children at the schools close to the affected area with control subjects than within AS (exposed versus nonexposed). Possibly, the nonexposed children at the AS were influenced by experiences of their exposed classmates. Other than small group activities especially held for exposed children, there also were interventions for the complete school population. In general, at the schools in the direct neighborhood of the affected area, there was a considerable amount of attention paid for the firework disaster and its effects. This may have resulted in smaller differences for social-emotional behavior between the exposed and the nonexposed children at these schools. However, in comparison with a control group at a school with very limited disaster involvement, impaired behavior was more prevalent among the AS population as a whole. It should be noted that differences between exposed and nonexposed children/control subjects may have been caused by changes in the group of nonexposed children/control subjects. Significant effects were not always caused by a changing performance among children in the exposed group.
This study was hampered by some methodologic limitations. Starting from a population of children attending the schools in 2002–2003, at the time that the disaster occurred (May 2000) only part of this population already attended school. Furthermore, youth health care practitioners examined the school children in a limited number of grades. It is possible that not finding significant group differences may be attributed to the relatively small sample size. On the other hand, we might have found group differences to be statistically significant where such significance was the result of chance alone, because we conducted so many tests. However, the significant differences found (10) clearly outnumber the differences expected on the base of chance alone (3, at an
level of .05). In this retrospective study, information about exposure status was set by the availability of data. We were able to collect individual exposure data by using disaster-related information from the school files. In the week after the disaster, only 1 of the schools had distributed a questionnaire to systematically record the children's experiences during the firework storage explosions and to record the disaster-related family consequences. The other schools had written down notes about exposure status in the general school files based on their knowledge of the children's living situation and what the parents told them. The data are considered to be complete and of good quality. Of each child, all of the known particularities were thoroughly written down in their school files, including disaster-related details. We believe that misclassification in our study is highly unlikely. The events covered in the exposure status definition are serious and of high relevance for all of the caregivers of young children and could without any exceptions be found in the school files. Moreover, for the schools, it was of importance to set down all of the disaster related aspects, because they had to report these (on a group level) to the local government. We used data that were mostly collected a short time after the disaster, except for children who did not visit school at that time. Therefore, we assume little risk of recall bias. The measures to study school performance and behavior also were set by the availability of instruments at the schools. For school performance, validated objective measures could be used, and data from a national reference population were at our disposal. Results of exposed children could be set into perspective to data of a control population in the same city, as well as to Dutch national norm data. For social-emotional functioning, however, only subjective instruments were available. Moreover, for the instruments used by the teachers, no normative data were available. By using data from the school doctor's health examinations of the same children, we could provide multi-informant data and put social-emotional behavior into perspective to normative data. This additional information from the school doctors and/or the parents supported the teacher's view of the children. Concerning the school-based data for social-emotional behavior, some information bias might have been possible. Teachers could be influenced by their knowledge of the children's exposure. However, bias in this outcome measure could have affected the results in 2 opposite ways. Teachers might have overestimated the disturbance in social-emotional behavior because they knew the child was exposed to the disaster. On the other hand, they also might have reduced the behavior disturbance. Taking into consideration that the child had been exposed to the disaster, his or her behavior could be considered as good. School control data came from a CS located in the city in which the disaster took place. This school was located in a different district. However, it is possible that children at the CS in a small way were exposed. They may have heard the explosions, and it is very likely they saw or read about the disaster in the media. However, both of these exposure aspects were not included in our criteria for exposure status. Inclusion in the exposed group of children who, for instance, saw the explosions or were exposed to the media coverage of the disaster might have affected our findings but would have led to an underestimation of effects. Moreover, media exposure certainly was not limited to children within the city of Enschede. The disaster media coverage was nationwide, comprehensive, and continued for days, weeks, and even years. Therefore, not only children from the city of Enschede could be influenced by the disaster. Two years after the Oklahoma City, OK, bombing, among 11-year-olds who lived 160 km distant from the disaster, who had neither any direct physical exposure nor personally knew anyone killed or injured in the explosion, media exposure was a significant predictor of PTSD symptomatology.22 In a country as small as the Netherlands, this range of 160 km from Enschede concerns a major part of the country.
Further research is needed to examine the impact of a disaster on young children, especially concerning their social-emotional functioning. However, this study is a valuable addition to the limited number of studies performed to analyze the effect of disaster on cognitive functioning. The objective measurement of school performance in primary school children before as well as after the disaster especially adds to the importance. Furthermore, the use of data of a control group and of a national reference population is valuable to be able to put performances at schools highly affected by a disaster into perspective. This study demonstrates a limited influence of disaster exposure on school performance in primary school children. Little is known about the role of school-based postdisaster intervention programs, and this should be investigated in the future. Further longitudinal studies are needed to address risk factors and factors protecting disaster-exposed children from developing behavior disturbances. This is essential to develop evidence-based preventive measures to be used in postdisaster intervention programs and in the training that needs to be given to teachers and pediatricians to help children cope. Other than confirming the potentially long-term social-emotional effects of disasters, this study also showed that teachers and youth health care practitioners should especially be aware of children starting school several years after a disaster. Although very young at the time of a disaster, they may experience disaster-related problems.
| FOOTNOTES |
|---|
Address correspondence to Dini Smilde-van den Doel, MSc, Pallas, Health Research and Consultancy, Patrice Lumumbastraat 5, 3065 EK Rotterdam, Netherlands. E-mail: smilde{at}pallas-healthresearch.com
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. M. Chemtob, Y. Nomura, and R. A. Abramovitz Impact of Conjoined Exposure to the World Trade Center Attacks and to Other Traumatic Events on the Behavioral Problems of Preschool Children Arch Pediatr Adolesc Med, February 1, 2008; 162(2): 126 - 133. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||