ARTICLE |
a Department of Research, American Academy of Pediatrics, Elk Grove Village, Illinois
b Center for Healthcare Studies, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
c Erikson Institute, Chicago, Illinois
d Cincinnati Pediatric Research Group, Division of General and Community Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| ABSTRACT |
|---|
|
|
|---|
METHODS. In separate interviews, parents and children completed 3 visits. Child questionnaires were interviewer administered. The primary instrument was the Children's Health Survey for AsthmaChild Version, used to compute 3 scales (physical health, activities, and emotional health). The following were assessed: reliability (internal consistency and test-retest reliability), validity (general health status, symptom burden, and lung function), and feasibility (completion time, missing data, and inconsistent responses).
RESULTS. A total of 414 parent-child pairs completed the study (mean child age: 11.5 years). Reliability estimates for the activities and emotional health scales were >.70 in all but 1 age category; 5 of 9 age groups had acceptable internal consistency ratings (
.70) for the physical health scale. Cronbach's
tended to increase with child age. In general, test-retest correlations between forms and intraclass correlation coefficients were strong for all ages but tended to increase with child age. Correlations between forms ranged from .57 (7-year-old subjects, physical health) to .96 (14-year-old subjects, activities). Intraclass correlation coefficients ranged from .76 (13-year-old subjects, emotional health) to .94 (1516-year-old subjects, physical health). Children with less symptom burden reported higher mean Children's Health Survey for AsthmaChild Version scores (indicating better health status) for each scale, at significant levels for nearly all age groups. Children's Health Survey for AsthmaChild Version completion times decreased from 12.9 minutes at age 7 to 6.9 minutes at age 13.
CONCLUSIONS. This research indicates that children with asthma as young as 7 may be dependable and valuable reporters of their health. Data quality tends to improve with age.
Key Words: child pediatric asthma health status Children's Health Survey for Asthma
Abbreviations: CHSAChildren's Health Survey for Asthma CHSA-CChildren's Health Survey for AsthmaChild Version ASD-14Asthma Symptom Day-14 FEV1forced expiratory volume in 1 second LSDleast-significant difference PPVT-IIIPeabody Picture Vocabulary Test Third Edition
Whether to collect patient-reported data (such as health status or health-related quality of life) from parents or children is an important question in both pediatric research and clinical practice. For children who are too young or too ill to respond, parents are often the logical informants to report on their child's activities and well-being. Given the challenges involved in gaining information from children, such as comprehensibility, response biases, and time constraints, many pediatric health status measures have relied on parent report as a proxy for child report.14 However, parents and children may have different views on the impact of disease, and some attributes of health, such as emotional distress and intensity of pain, are difficult for parents to observe. Parent assessments may also be incomplete because most school-aged and older children are away from their parents for many hours each day. Mothers and fathers might differ in their ability to report on their child's health. Although obtaining the perspective of parents is important, parents can provide only an indirect account of child experience.
Beyond clinical utility, there is a pressing need to understand more fully children's ability to act as research respondents. Current National Institutes of Health policies encourage federally funded researchers to include children in clinical studies, and the goal of the Best Pharmaceuticals for Children Act is to increase significantly the number of pediatric studies.5,6 In many instances, children may be capable of providing information about internal or subjective dimensions of health that parents are unable to offer,7,8 but critical questions remain. What age is "old enough?" At what age can children provide dependable information about their health status?
Several generic health status measures for child self-report are now available, and there is growing evidence that children can be reliable and valid reporters.816 Because asthma is one of the most common conditions in childhood,17 several specific measures for this condition are available.1824 However, information on the age-specific capacity of children to complete patient report measures is limited. Child report data are provided frequently according to age group or for the total group, rather than being delineated by age. Furthermore, a discussion of feasibility issues, such as the time and techniques required to obtain data from children, is often omitted or given cursory attention.
A child's chronologic age and developmental capabilities shape his or her comprehension of abstract concepts related to health and perceptions of health status.2527 As yet, these are understudied aspects of pediatric health status measurement. With standard questionnaire methods, at what age do children become dependable reporters of their own health status? The purpose of this study was to examine the reliability, validity, and feasibility of child report data for children 7 to 16 years of age, by using a measure of asthma-related health status.
| METHODS |
|---|
|
|
|---|
Our analysis focused on 3 areas for assessment of children's capacity to report, namely, reliability (measured as internal consistency reliability and test-retest reliability), validity (measured by comparing scale scores with general health status, asthma symptom burden, and lung function test results), and feasibility (measured as the length of time to complete the CHSA, missing data, and inconsistent responses). The study protocol was approved by the institutional review boards of the American Academy of Pediatrics, Northwestern University, and Cincinnati Children's Hospital.
Subjects
We recruited families in the cities and surrounding suburbs of Chicago, Illinois, and Cincinnati, Ohio. Recruitment was conducted through on-site contact in asthma clinics; flyers distributed through physicians' offices or clinics and through community sites such as schools, day care centers, and churches; and volunteer physicians, who mailed letters about the project to eligible families in their practices. To maximize convenience for participants, interviews were conducted in local schools, libraries, community centers, and clinics.
Recruitment was structured to provide equivalent numbers of subjects among children 7 to 16 years of age. Screening procedures excluded children with substantial comorbidities and those currently participating in another asthma study. The oldest children (15 and 16 years of age) were combined in 1 age group.
Data Collected
Three study visits were scheduled over
16 days (Table 1). Visit 1 included study protocol training (eg, use of an electronic peak flow meter) and administration of a parent-completed background questionnaire. For their participation, parents received $15 cash and children received a $10 gift certificate at the completion of visits 2 and 3. Twenty-three families dropped out after visit 1 and were excluded from subsequent analyses.
|
CHSA-C
The primary outcome was performance on the CHSA-C. The CHSA-C includes 21 demographic and asthma history questions and 25 core items used to compute 3 scales, namely, physical health, activities, and emotional health. The physical health scale (7 items) includes questions about asthma symptoms, such as wheezing, cough, and difficulty breathing. Child activities (6 items) address limitations in school and other activities attributable to asthma. Questions from the emotional health scale (12 items) examine issues such as frustration with asthma and lack of understanding from others. Children are asked to think about the past 2 weeks; all scale item responses use a 5-point Likert format (eg, "During the past 2 weeks, how much of the time did you have shortness of breath because of your asthma?" none/little/some/most/all of the time). Scale scores were created with computation of mean item responses and were then transformed, giving each scale a possible range from 0 to 100. Higher scale scores indicate more-positive perceived health status. Additional information about scale computation is available from the authors.
Comparative Measures of Asthma and Health Status
General Health Status
Parents provided a rating of overall child health; 5 fixed-choice responses ranged from excellent to poor and were dichotomized for analyses into 2 categories (excellent to very good and good to poor).
Symptom Burden
A separate summary measure of asthma symptom burden was gathered from children by using an adaptation of the existing parent report Asthma Symptom Day-14 (ASD-14).33 Although there are no extensively validated measures that provide a count of symptom burden for children, the instrument we chose has been used in several national and international studies.31,34,35 Children were asked a short series of questions to elicit the total number of days during the past 2 weeks in which they experienced asthma daytime or nighttime symptoms or limitations in play/daily activities. Two-week recall of asthma symptoms tends to have a bathtub distribution, with frequent responses at both ends of the scale. As in a previous study, activity was categorized as low (02 days), moderate (310 days), or high (
11 days).28 Because of small subgroup size in the high category (n = 18), the moderate and high groups were combined for analyses.
Child Lung Function
We obtained lung function data from the children over a 2-week period by using a Vitalograph electronic peak expiratory flow/forced expiratory volume in 1 second (FEV1) diary (Vitalograph, Lenexa, KS). Similar to a peak flow meter, the Vitalograph unit is a hand-held device that can be used to collect and store lung function data from both adults and children. Children were instructed in the use of the Vitalograph at visit 1 and were given an opportunity to practice their technique until the interviewer was satisfied that the child could use the equipment successfully and the family felt comfortable with the Vitalograph instructions. Take-home instructions were provided, as well as a contact telephone number for use if problems arose. Children were asked to use the Vitalograph twice daily, once in the morning, before eating or using any medication, and once in the evening, immediately before going to bed.
Families were asked to return the Vitalograph devices at visit 2; at visit 3, they were provided with a report of lung function that included peak flow, peak expiratory flow, and FEV1 and a letter explaining the project and the results. Each family was encouraged to share the Vitalograph report with the child's physician.
A summary score of lung function using Vitalograph data was created by calculating an average morning FEV1 percent predicted value. Percent predicted values were categorized into 2 groups (
79% and
80%).
Developmental Verbal Ability
Each child's verbal ability was measured by using the Peabody Picture Vocabulary Test, Third Edition (PPVT-III).36 The PPVT-III is a developmental measure of receptive vocabulary, standardized with a mean of 100 and a SD of 15 across ages.
Child Characteristics
Parents completed a 26-item background questionnaire with questions on basic child and parent demographic features and child asthma indicators. Parents were asked to rate their child's asthma in the past year as mild, moderate, or severe and as intermittent or persistent. Parents also identified the types of asthma medications (both rescue and controller) used by the child and the frequency of use.
Analytic Plan
Descriptive Analyses
Descriptive statistics, including mean, SD, and range, were examined for individual items and scales. Analysis of variance and least-significant difference (LSD) posthoc tests (significance level of .05) were used to assess differences in CHSA-C scale scores according to child age.
Reliability Testing
We assessed internal consistency of CHSA-C responses at visit 2 for each age group by examining Cronbach's
for each scale. Reliability estimates reaching
70 were considered acceptable, in keeping with conventions for group-level analyses.37 Test-retest analyses were conducted for the 287 children whose asthma remained stable between visit 2 and visit 3 (
48-hour interval). Stability was determined by asking the parent and child directly, on arrival at visit 3, whether either had noticed any asthma-related problems since visit 2. If the answer was yes (n = 64), then the child's asthma was not considered stable between visit 2 and visit 3 and the data were excluded from test-retest analyses. An additional 36 families, for whom stability data were not obtained early in the data collection process, were also excluded from test-retest assessments. We examined test-retest reliability by calculating the intraclass correlation coefficient (a measure of average similarity of visit 2 and visit 3 CHSA-C scores), as well as correlation between forms.
Validity Testing
To assess whether the CHSA-C could distinguish severity, independent-sample t tests and analysis of variance with LSD posthoc tests (significance level of .05) were used. For each age group, we examined CHSA-C scale scores at visit 2 according to 3 indicators of disease severity, namely, general health status, symptom burden (ASD-14), and lung function test scores (Vitalograph).
Feasibility Assessments
Feasibility of child completion across age groups was measured by calculating the length of time required for CHSA-C administration, the amount and type of missing CHSA-C data (includes not providing an answer or selecting "don't know" as a response), and the mean number of inconsistent answers (eg, CHSA-C and ASD-14 responses were compared and counted as inconsistent if they disagreed, such as responses of "0" for the number of times wheezed in the past 2 weeks on one question and "some of the time" for a similar question about wheezing). Analysis of variance and LSD posthoc tests (significance level of .05) were used to identify differences in administration times, mean missing data, and mean inconsistent response counts across child ages.
| RESULTS |
|---|
|
|
|---|
|
5 days and 20% used bronchodilator medicine for
5 days in the past 2 weeks. Less than 10% (7.7%) used corticosteroids for
2 months in the previous year. Sixty percent of parents rated the child's overall health as excellent to very good, whereas 40% described the child's overall health as good to poor.
For the sample overall, the distribution of PPVT-III standard scores was approximately equivalent to established population means (48% with a standard score of
100). As shown in Table 3, PPVT-III standard scores were generally equivalent across age groups (ranging from an average of 95.82 to 104.85), which indicates similar developmental capacity (compared with same-age peers) across age groups.
|
Reliability Testing
Table 4 presents internal consistency reliability for each CHSA-C scale according to age group. Reliability estimates overall were strong, and the majority reached the acceptable range (
.70). The lowest value for Cronbach's
was observed for 8-year-old subjects on the physical health scale (.61). The highest value was noted for 14-year-old subjects on the emotional health scale (.93). With a few exceptions, Cronbach's
values tended to increase with child age.
|
|
|
Table 7 provides age-specific CHSA-C scale scores according to average FEV1 percent predicted values (based on morning readings). Useable Vitalograph data (data provided on
6 days) were provided by 369 (89%) of the 414 children. The mean number of morning reports provided by each child was 11.86 (SD: 3.34 reports). No consistent relationship was observed between CHSA-C scale scores and FEV1 percent predicted categories for any age group.
|
Mean missing data counts for the CHSA-C were low across all age groups; the lowest level was found for 14-year-old subjects (mean: 0.53) and the highest for 7-year-old subjects (mean: 2.11). Analysis of variance showed a statistically significant difference among the groups (F8,405 = 6.66; P < .001), and posthoc testing revealed considerably more missing data for 7- and 8-year-old subjects. The youngest children had more difficulty providing responses to open-ended questions (eg, date of birth and age when asthma-related problems began).
Mean inconsistent response counts were low for all ages (mean: 1.0); the highest mean was found for 7-year-old subjects (mean: 1.4) and the lowest for 15- to 16-year-old subjects (mean: 0.69). No differences emerged for the group overall, but inconsistent responses tended to decline with child age.
| DISCUSSION |
|---|
|
|
|---|
Previous studies relied primarily on grouping children of several ages together, and the ability to look at statistical properties of questionnaire performance for individual age groups is a unique aspect of this study. We found some anomalies according to age, depending on the domain of questions asked. Regardless of age, children were typically more reliable reporters about activity limitations and asthma-related emotional health than about physical symptoms. Measures of internal consistency on the physical health scale were variable, with 8-, 9-, 11-, and 14-year-old subjects performing less well than those in the other age categories. These anomalies, especially regarding the stronger performance of the 7-year-old subjects, are difficult to explain and may be related to unmeasured sample characteristics. It may also be that activity limitations and aspects of asthma-related emotional health are less changeable and thus easier, in general, for children to report than the sometimes-intermittent symptoms common to asthma. These findings suggest that additional research on age-specific differences in reporting is warranted.
Although we observed relationships in the expected direction for general health and symptom burden, we failed to find a relationship at any age between children's report of asthma health status and lung function test results, as measured over 2 weeks with the Vitalograph. Our findings are consistent with several other studies that found no relationship between measures of lung function and other measures of asthma status, including reported symptoms, health care utilization, and functional health status.32,38,39 This underscores the importance of including patient reports in assessing asthma status, because lung function measures may not equate closely with symptom experience.
Patient-reported instruments are being used increasingly in pediatric research, both as tools to study populations and for clinical interventions.8,4045 Other research demonstrated the validity and reliability of child report instruments.10,12 The research presented here provides new, age-specific information on the quality of reports that can be obtained from children and adds to a growing body of evidence that we can and should ask children themselves about their health and perceptions of well-being.
Although researchers in other fields (eg, forensics and child psychology) have elicited psychometrically sound data from children as young as toddlers, this information often comes at a high cost, with methods involving highly trained researchers and/or time-consuming and expensive data collection techniques.4649 For many investigators, such methods may be impractical or impossible, given limited funding and staffing.
There are several caveats to the conclusion that children can report for themselves. First, this project examined children's responses to a condition-specific instrument. Therefore, we cannot comment on children's ability to report on health overall or their performance on other asthma-specific instruments. Children's capacity to conceptualize other aspects of health, wellness, or illness requires additional exploration. The CHSA-C underwent substantial pretesting and revision (before this data collection effort), to maximize its potential as a child-friendly instrument. The interviewers also spent several minutes at the start of each session reviewing the concept of 2-week recall. Using a calendar, they encouraged children to think about and to note interesting/important events that occurred, to focus their attention on that time period. Not all projects may have the resources to support similar activities.
In the study, we assessed only 1 dimension of developmental ability, that of receptive language. Future work might measure other aspects of development that are important to health reporting, such as expressive language, memory, numeracy, and nonverbal reasoning skills. Additional study of individual age performance is also appropriate, to encourage more-precise determination of age-specific capabilities related to psychometric quality.
There is unlikely to be a single answer to the question of when children become appropriate reporters of their own health. The answers will depend on the known performance characteristics of the measure and will vary according to practical considerations. For example, although young children seemed capable of providing an assessment of their own asthma status in this study, the busy nature of a clinical practice may limit the ability of a physician to spend enough time to obtain such a history. However, this research indicates that, whenever possible, children as young as 7 may be dependable valuable reporters of their own health, at least for asthma.
| ACKNOWLEDGMENTS |
|---|
The project was a collaborative effort that benefited from the involvement of Evalyn Grant, MD, Dorothy Elfring, MPH, and Jeralyn Bernier, MD, MPH, as well as the research assistants at Northwestern University Feinberg School of Medicine and Cincinnati Children's Hospital Medical Center. We are also most grateful to the dedicated children and parents who so willingly shared their thoughts and feelings.
| FOOTNOTES |
|---|
Address correspondence to Lynn M. Olson, PhD, Department of Research, American Academy of Pediatrics, 141 Northwest Point Blvd, Elk Grove Village, IL 60007. E-mail: lolson{at}aap.org
The authors have indicated they have no financial relationships relevant to this article to disclose.
The opinions expressed in this article are solely those of the authors and do not reflect the views of the organizations with which they are affiliated.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
T. Islam, R. McConnell, W. J. Gauderman, E. Avol, J. M. Peters, and F. D. Gilliland Ozone, Oxidant Defense Genes, and Risk of Asthma during Adolescence Am. J. Respir. Crit. Care Med., February 15, 2008; 177(4): 388 - 395. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Islam, W J. Gauderman, K. Berhane, R. McConnell, E. Avol, J. M Peters, and F. D Gilliland Relationship between air pollution, lung function and asthma in adolescents Thorax, November 1, 2007; 62(11): 957 - 963. [Abstract] [Full Text] [PDF] |
||||
![]() |
AAP Department of Research Children may be reliable reporters of asthma health status AAP News, February 1, 2007; 28(2): 15 - 15. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||