ELECTRONIC ARTICLE |



,



* Department of Medicine
Veterans Affairs Medical Center
¶ Children Nutrition Research Center
# Department of Pediatrics

Division of Molecular Virology, Baylor College of Medicine, Houston, Texas
Pearson Educational Measurement, Austin, Texas
|| Department of Pediatrics, School of Medicine, University of South Florida, Tampa, Florida
** Houston Independent School District, Houston, Texas

Sunnybrook and Women's College Health Sciences Center, University of Toronto, Toronto, Ontario, Canada
| ABSTRACT |
|---|
|
|
|---|
Methods. We conducted 3 cross-sectional studies. Two studies were clinic-based studies that enrolled children with RAP from 1 pediatric gastroenterology clinic and 6 primary care clinics. The third study was a community-based study in which children from 1 elementary and 2 middle schools were screened for frequent episodes of abdominal pain. The 3 studies were conducted in Houston, Texas. Inclusion criteria for the clinic-based studies were (1) age of 4 to 18 years; (2) abdominal pain that had persisted for 3 or more months; (3) abdominal pain that was moderate to severe and interfered with some or all regular activities; (4) abdominal pain that may or may not be accompanied by upper-gastrointestinal symptoms; and (5) children were accompanied by a parent or guardian who was capable of giving informed consent, and children over the age of 10 years were capable of giving informed assent. The community-based study used standardized questionnaires that were offered to 1080 children/parents from the 3 participating schools; 700 completed and returned the questionnaires (65% response rate). The questionnaire was designed to elicit data concerning the history of abdominal pain or discomfort. A total of 160 children met Apley's criteria and were classified as having RAP. Inclusion criteria were identical to those criteria for the clinic-based studies. Participating children in the 3 studies received a standardized questionnaire that asked about socioeconomic variables, abdominal pain (intensity; frequency; duration; nature of abdominal pain, if present, and possible relationships with school activities; and other upper gastrointestinal symptoms). We used 4 scales for the MM-RAP: pain intensity scale (3 items), nonpain symptoms scale (12 items), disability scale (3 items), and satisfaction scale (2 items). Age 7 was used as a cutoff point for the analysis as the 7-year-olds have been shown to exhibit more sophisticated knowledge of illness than younger children.
Results. A total of 295 children who were aged 4 to 18 years participated in the study: 155 children from the pediatric gastroenterology clinics, 82 from the primary care clinics, and 58 from the schools. The interitem consistency (Cronbach's coefficient
) for the pain intensity items, nonpain symptoms items, disability items, and satisfaction items were 0.75, 0.81, 0.80, and 0.78, respectively, demonstrating good reliability of the measure. The internal consistencies of the 4 scales did not significantly differ between younger (
7 years) and older (>7 years) children. There was also no significant variation in the coefficient
of each of the 4 scales in relation to gender or the level of the parent's education. Reliability was identical for the pain-intensity items (0.74) among children who sought medical attention from primary care or pediatric gastroenterology clinics. The intercorrelations of factor scores among the 4 scales showed a strong relationship among the factors but not high enough that correlations would be expected to be measuring the same items. The results of the factor analysis identified 5 components instead of 4 components representing the 4 scales. The 12 items of the nonpain symptoms scale were classified into 2 components; 1 component included heartburn, burping, passing gas, bloating, problem with ingestion of milk, bad breath, and sour taste (nonpain symptoms I), and the other included nausea/vomiting, diarrhea, and constipation (nonpain symptoms II). The program ordered the 5 components on the basis of the percentage of the total variance explained by each component and consequently by the strength of each components in the following order: nonpain symptoms I, pain intensity, pain disability, satisfaction, and nonpain symptoms II. Of the 20 items that composed the MM-RAP, 17 met the inclusion criteria of having a correlation of
0.40 on the primary factor analyses. The 3 items that assessed pain intensity met the inclusion criteria as well as the 2 items that assessed satisfaction. Two of the 3 items that assessed disability met the inclusion criteria; however, the missed school item did not. The sleep problem and the loss of appetite items in the nonpain items also did not meet the inclusion criteria in both components of the nonpain symptoms scale. However, the loss of appetite item met the inclusion criteria in the disability scale with a correlation of 0.6. The 2 items that did not meet the inclusion criteria (missed school days and sour taste) will be eliminated in the revised measure for RAP.
Conclusion. The MM-RAP demonstrated good reliability evidence in population samples. Children who have RAP and are seen at pediatric gastroenterology or primary care pediatric clinics have similar responses, showing that the measure performed well across several populations. Age did not affect the reliability of responses. The MM-RAP included 4 dimensions, each with several items that may identify disease-specific dimensions. In addition, dividing the nonpain symptoms scale into 2 components instead of 1 component could assist in creating a disease-specific measure. The present study focused exclusively on developing the multidimensional measure for RAP in children that could assist physicians in evaluating the efficacy of RAP treatment independent of psychological evaluations. In addition, the measure was designed for use in clinical trials that evaluate the efficacy of RAP treatment and to allow comparison between intervention studies. In conclusion, we were able to identify 4 dimensions of RAP in children (pain intensity, nonpain symptoms, pain disability, and satisfaction with health). We demonstrated that these dimensions can be measured in a reliable manner that is applicable to children who experience RAP in various settings.
Key Words: recurrent abdominal pain children scale outcome measure
Abbreviations: RAP, recurrent abdominal pain MM-RAP, multidimensional measure for RAP
Recurrent abdominal pain (RAP) is 1 of the most common gastrointestinal disorders in children, with estimates of prevalence ranging between 10% and 15% of children.13 RAP is an especially noteworthy disorder because it often interferes with the child's school attendance and performance; peer relationships; and participation in organizations, sporting events, and family activities.16 Recent studies have shown that children who experience RAP also exhibit anxiety, depression, withdrawal, and low self-esteem.69 Community- and school-based studies reported that abdominal pain occurred in 7% to 25% of school-aged children2,5,1013 and was severe enough to affect activities in 21%.5 Children with RAP are also frequent users of medical services.5,14
Over the past 3 decades, a number of symptoms-based criteria have been proposed to help clinicians and researchers diagnose and identify children with RAP. The original Aply's criteria were designed to identify RAP in community samples without medical assessment.1 Von Baeyer et al15 modified Aply's criteria and reported that the primary outcome should measure both amount of pain and the level of disability. The ROME I and ROME II diagnostic criteria1618 recommended that evaluation of RAP be based on medical assessment, the patient's report of pain, and psychological measures done at baseline. However, it was reported recently that the interrater reliability of the ROME II criteria was low among pediatric gastroenterologists and the development of improved criteria was recommended.19 Despite improved diagnostic criteria and potentially more effective treatment, the treatment of pediatric patients with RAP continues to challenge physicians.7 A major obstacle to progress in research on RAP has been the lack of a biological marker for RAP and the lack of a reliable and valid clinical measure for RAP.
We aimed to develop and evaluate the reliability of an instrument for measuring RAP in children to serve as a primary outcome measure for clinical trials. In the current research, we describe the development of a multidimensional measure for RAP (MM-RAP) and report the results of the reliability testing of the measure. Furthermore, we examined the reliabilities of the measure subscales in relation to the demographic variables of the study.
| METHODS |
|---|
|
|
|---|
1. The Pain Intensity Scale is derived from 3 items; first is the Wong-Baker Face scale,26,27 which is used to rate the pain now (0 = very happy face; 5 = tearful face/hurts as much as you can imagine); second is rating the Worst Pain over the previous 3 months measured on scales from 0 to 10 (0 = no pain; 10 = pain as bad as it could be), and third is Average Pain over a period of 3 months measured on scales from 0 to 10 (0 = no pain; 10 = pain as bad as it could be); all 3 then are summed to give a final pain intensity score.
2. The Nonpain Symptoms Scale is derived from 12 items that consist of the range of RAP-related symptoms (nausea/vomiting, heartburn, diarrhea, constipation/hard stool, passing gas, loss of appetite, burning/belching, bloating/abdominal distention, sour taste, bad breath, sleep problem, and problem with ingestion of milk). Each symptom is rated from 1 to 5 (1 = no problem; 5 = very severe problem).
3. The Disability Scale is derived from 3 items. The first item rates how the child's abdominal pain interfered with her or his school attendance during the previous 3 months measured on a 10-point scale (0 = never missed a school day; 10 = missed 10 or more days); the second and third items rate how the child's abdominal pain interfered with daily and weekly activities, respectively, during the previous 3 months measured on scales from 0 to 10 (0 = never; 10 = always).
4. The Satisfaction Scale consisted of 2 items that evaluated the overall RAP condition. The 3 items were how pleased and satisfied the child/parent is in regard to the level of abdominal pain. Both items included responses to questions measured on 1- to 5-points scales (1 = definitely true that I feel pleased [first item] or satisfied [second item] with my health with regard to my/my child's RAP; 5 = definitely false).
Study Population
Cross-sectional studies were conducted on 3 populations: children who attend the Harris County Pediatric Health Clinics, children who are patients at the pediatric gastroenterology clinic at Texas Children's Hospital, and children who attend Houston Independent School District. These groups represent 2 clinic-based (Harris County Pediatric Health Clinics and Texas Children's Hospital) studies and 1 community-based (Houston Independent School District) study.
The 2 clinic-based studies were conducted at 6 primary care pediatric clinics and 1 pediatric gastroenterology clinic in Houston, Texas. Children who were identified by their assigned physicians as having RAP were screened by the study coordinator for eligibility for the study. The inclusion criteria were (1) age of 4 to 18 years; (2) abdominal pain that had persisted for 3 or more months; (3) abdominal pain that was moderate to severe and interfered with some or all regular activities; (4) abdominal pain that may or may not be accompanied by upper-gastrointestinal symptoms; and (5) children were accompanied by a parent or guardian who was capable of giving informed consent, and children who were over the age of 10 years were capable of giving informed assent.
After the assigned physician referred the patient, it was the study coordinator's responsibility to ensure that the child met the inclusion criteria. On agreement to participate in the study, a self-administered questionnaire was given to the parent/child to obtain data regarding sociodemographic characteristics and general information regarding the abdominal pain symptoms that led to the doctor's visit. The second part of the questionnaire was designed to obtain a detailed description of the child's history of abdominal pain and to obtain responses to all items related to the MM-RAP for children. That part of the questionnaire was completed by the study coordinator, and responses from both parent and child were obtained at the same time.
The third study was a community based-study that was conducted on 2 middle schools and 1 elementary school in Houston, Texas. The study aimed to measure the prevalence of RAP among children in the community and describe the clinical constellation of RAP. Standardized questionnaires were offered to 1080 parents/children from the 3 participating schools; 700 completed and returned the questionnaires (65% response rate). The questionnaire was designed to elicit data concerning socioeconomic parameters and the history of abdominal pain or discomfort (intensity; frequency; duration; nature of abdominal pain, if present; and possible relationships with school activities, eating pattern, and other upper-gastrointestinal symptoms). A total of 160 children met Apley's criteria for RAP and were classified as having RAP; 100 of their parents were contacted by telephone. When verbal approval was obtained, an interview with the child and parents was scheduled to complete the MM-RAP. Inclusion criteria were identical to criteria for the clinic-based studies.
Written consent/assent from all participating children from the 3 settings was obtained from each parent/child before enrollment in the study. Baylor College of Medicine's Committee for the Protection of Human Subjects approved the protocol for the 3 studies.
Analyses
Reliability
The goal of our current work was to test the reliability of the MM-RAP in children. The measure was intended to measure the severity of abdominal pain in children, all of whom had abdominal pain. Our focus in these analyses was to evaluate the reliability of the 4 scales: pain intensity, nonpain symptoms, disability, and satisfaction.24 We evaluated the reliability of each scale by calculating interitem consistency among the items using Cronbach's coefficient
.25 We calculated the median values for standardized Cronbach's
when the scales were administered (ie, at enrollment). An accepted method for estimating the reliability of a measure that is based on a single administration is to calculate the internal consistency of the scale.
Factor Analyses
Factor analysis was applied to examine the different components of the current MM-RAP and to distinguish the important items for these dimensions. We initially anticipated 4 components because our multidimensional measure consisted of 4 scales (pain intensity, nonpain symptoms, disability, and satisfaction with RAP). The 4 dimensions were revised on the basis of the results of the factor analysis, which required that items have a correlation of 0.40 or greater with the primary factor. Such criteria were used to ensure that the scales consisted of items with strong associations with the primary factor being measured.
The extraction method (principal component analyses) with all 20 items of the 4 scales was applied to identify the total variance between items and help reconstruct the components of the RAP scales identified through factor analyses. Then the rotation method (Varimax with Kaiser Normalization) was used to identify these components.25 The data were analyzed by using the SPSS program (SPSS Inc, Chicago, IL).
| RESULTS |
|---|
|
|
|---|
|
for these values. The interitem consistency (Cronbach's coefficient
) for the pain intensity items, nonpain symptoms items, disability items, and satisfaction items were 0.75, 0.81, 0.80, and 0.78, respectively, demonstrating good reliability of the measure. Age is a critical factor for children's responses; we therefore tested the reliability of the 4 scales of our measure in relation to age and used the cutoff point of 7 years.28 The internal consistencies of the 4 scales did not differ significantly between younger and older children. There was also no significant variation in the coefficient
of each of the 4 scales in relation to gender or the level of the parent's education (Table 2).
|
for the pain intensity and the disability scales dropped slightly below 0.7 among school children. This likely is attributable to the smaller sample size in that group or to the heterogeneity of the studied population. The Cronbach's
was identical for the pain intensity scale (0.74) among children who sought medical attention from general primary care clinics or pediatric gastroenterology clinics.
Intercorrelations and Descriptive Statistics of MM-RAP Scales
The intercorrelations of factor scores among the 4 scales are presented in Table 3. These correlations showed a strong relationship among the factors but not high enough that correlations would be expected to be measuring the same thing.
|
|
for the 2 components of the nonpain symptoms items. The interitem consistency (Cronbach's coefficient
) did not change: 0.80 and 0.81 for the first and the second components, respectively.
|
| DISCUSSION |
|---|
|
|
|---|
This is the first study to report on the development of an MM-RAP in children. We confirmed the existence of at least 4 dimensions for measuring RAP (pain intensity, nonpain symptoms, pain disability, and satisfaction with health). We were able to identify items that are necessary to distinguish these dimensions and showed that each dimension can be assessed in a reliable manner. The major finding of the study was that the 4 dimensions of the MM-RAP showed acceptable internal consistency for each scale to be measured in a reliable manner. Nunnally et al24 recommended a reliability standard of 0.70 for group level, which was achieved by most of our scales. It is interesting that the pain intensity scale achieved a reliability of 0.75, the nonpain symptoms scale achieved a reliability of 0.81, and disability scale achieved a reliability of 0.80. Because classification of RAP severity depends on the dimension that is assessed, not all measures will prove equally responsive or sensitive in detecting treatment effects. For example, if therapy is intended to relieve pain, then one would expect that a pain intensity measure would be of greatest value as the primary outcome measure for detecting treatment effect rather than a measure that includes other dimensions. Understanding the multidimensional nature for RAP in children is relevant in the light of our current efforts to evaluate new treatment strategies. Thus, researchers should carefully select a measure to evaluate the severity of RAP in children.
Our study also found no difference between the pain intensity and the nonpain symptoms scales reported in pediatric gastroenterologic clinics and from those who seek medical attention in primary care clinics. This observation was similar with a previous study that found no difference in the level of pain between children who were referred by pediatric gastroenterologists and those who were referred by community general pediatricians.30
Several issues that need to be addressed arise from our work. First, our study reports on the development and the reliability of a new measure for RAP in children. Before standardizing the measure for clinical use, the sensitivity and the validity must be examined in follow-up visits, comparing the responses before and after intervention. We are currently in the process of validating the measure. Second, additional efforts should investigate the importance of additional dimensions such as the duration of the pain. Third, our measure did not include the psychological aspects of RAP. The present study focused exclusively on developing a measure that could assist physicians in evaluating the efficacy of RAP treatment in children independent of psychological evaluation. In addition, our outcome measure was designed for use in clinical trials that evaluate the efficacy of RAP treatment and to allow comparison between intervention studies. Finally, we did not evaluate whether our measure is disease specific (ie, it does not distinguish between children who have irritable bowel syndrome or gastroesophageal reflux disease, functional dyspepsia, or other organic conditions that could be the underlining cause of RAP). However, our measure included 4 dimensions, each with several items that may identify disease-specific dimensions. In addition, dividing the nonpain symptoms scale into 2 components instead of 1 component could assist in creating a disease-specific measure. Work toward achieving this goal is in progress.
In conclusion, we were able to identify 4 dimensions of recurrent abdominal pain in children (pain intensity, nonpain symptoms, pain disability, and satisfaction with health). We demonstrated that these dimensions can be measured in a reliable manner and are applicable to children who experience RAP in various settings.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Reprint requests to (H.M.M.) Veterans Affairs Medical Center (111D), 2002 Holcombe Blvd, Houston, TX 77030. E-mail: hmalaty{at}bcm.tmc.edu
No conflict of interest declared.
Dr Holliers current affiliation is: Stephen F. Austin State University, Nacogdoches, Texas.
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||