SPECIAL ARTICLE |
a Departments of General Pediatrics
b Child and Adolescent Psychiatry, Rudolf Magnus Institute of Neuroscience, University Medical Center Utrecht, Utrecht, Netherlands
c Department of Psychiatry and Academic Center for Child and Adolescent Psychiatry, Nijmegen, Netherlands
d Department of Clinical Epidemiology, Julius Center for Health Sciences and Primary Care, Utrecht, Netherlands
| ABSTRACT |
|---|
|
|
|---|
OBJECTIVE. We sought to assess in children with UCP if clinical characteristics held important by general pediatricians help to accurately diagnose psychiatric morbidity and, alternatively, if the same can be achieved using dedicated questionnaires.
METHODS. We used a cross-sectional diagnostic study in a pediatric outpatient clinic of a university hospital. Our participants were 134 patients, aged 8 to 18 years, who were referred for UCP. Performed were (1) diagnostic test reflecting the pediatricians choice of clinical characteristics and (2) selected questionnaires. Classification was performed according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, by a child psychiatrist using the Diagnostic Interview Schedule for Children-Parent Version IV and the Semi-structured Clinical Interview for Children and Adolescents. Results were analyzed by logistic regression.
RESULTS. Psychiatric morbidity was present in 80 of the children. A minority had a medical explanation for the pain (15% definite, 17% probable). The clinical diagnostic model included age, social-problem indicators, family structure, parental somatization, and school problems. In the quintile of children in whom this model predicted the highest risk, 93% indeed had psychiatric morbidity at reference testing. In the quintile with the lowest predicted risk, indeed only 27% had psychiatric morbidity. The Dutch Personality Inventory for Youth and the Child Behavior Checklist matched the pediatricians' choice of clinical characteristics. In the quintile of children with the highest predicted risk based on these questionnaires, 89% had psychiatric morbidity. In the quintile with the lowest predicted risk, only 15% had psychiatric morbidity.
CONCLUSIONS. A pediatrician-chosen set of clinical characteristics of children with UCP proves useful in diagnosing psychiatric morbidity. Using selected questionnaire screening yields similar results.
Key Words: chronic pain psychiatry predictive testing diagnostic procedures children adolescents
Abbreviations: UCPunexplained chronic pain PUCChronic Pain of Unknown Origin in Children CHQ-CFChild Health Questionnaire Child Form CSIChildren's Somatization Inventory DPIYDutch Personality Inventory for Youth CBCLChild Behavior Checklist CFPChecklist for Family Problems DISC-PDiagnostic Interview Schedule for Children-Parent Version IV SCICASemi-structured Clinical Interview for Children and Adolescents DSM-IV Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition AUCarea under the curve ORodds ratio dfdegrees of freedom CIconfidence interval
General pediatricians frequently encounter children who are referred with medically unexplained chronic pain (UCP). If at initial evaluation no explanatory etiology can be identified, the chances of finding a clear somatic cause for the pain are known to be low.13 For medically UCP in children, a few studies from different settings have shown associations with psychosocial factors.46 There has been some research into indicators of psychiatric morbidity in children who are referred to pediatric primary care and in somatizing children.710 However, there is very little general evidence to support the clinical management of chronic pain in children in general, let alone specific evidence from diagnostic studies.11
Our Chronic Pain of Unknown Origin in Children (PUC) study is focused primarily on improving insight into the diagnostic process as a critical first step toward more evidence-based treatment of children with medically UCP. Clearly, an array of disorders may underlie medically UCP. A strictly dualistic approach toward somatic and psychiatric disorders is an underestimation of the complexity of the problem. However, for clinical purposes, it may prove useful to try to distinguish the extremes of the distribution of underlying disorders without any disregard for their interrelatedness. Given pediatricians' central role in the care for these children, they have to be able to detect both somatic and psychiatric disorders that accompany the pain as a prerequisite for proper diagnostic workup and subsequent treatment.8,9 Therefore, it is important that they have accurate and practical diagnostic tools at their disposal. However, various diagnostic routes may have substantially different implications for clinical practice. Therefore, we chose to evaluate 2 diagnostic approaches that may be considered mutual alternatives in practical care. In the first approach we aimed to evaluate the accuracy of pediatricians diagnosing psychiatric morbidity; in the second approach we aimed to evaluate the accuracy of using screening instruments that reflect pediatricians' ways of diagnosing psychiatric morbidity.
With regard to the pediatricians' diagnosis, one approach would be to scrutinize all regular intake information for diagnostic value, but this would involve an unmanageably large set of possible diagnostic markers. As a more logical and practical approach we questioned whether pediatricians' prior selections of clinical markers at intake that they deem relevant are sufficiently accurate to detect psychiatric disorders.
With regard to the screening approach, we questioned whether screening of all children with medically UCP using instruments that best reflect the pediatricians' selections is sufficiently accurate to detect psychiatric disorders.
| METHODS |
|---|
|
|
|---|
50% of the general pediatric outpatient population and
15% of the other pediatric departments consist of children who are evaluated only by a general practitioner before referral. Children were recruited mainly from the department of general pediatrics but also from the pediatric departments of neurology, orthopedics, immunology and rheumatology, gastroenterology, and urology. Every child was evaluated according to standard practice. After informed consent was given, additional research data were gathered through standardized interviews and a variety of questionnaires (see below). Reference testing for psychiatric morbidity was assessed through standardized psychiatric assessment. The institutional review board of our hospital approved the study.
Diagnostic Index Tests: Identifying the General Pediatricians' Choices of Suspected Predictors of Psychiatric Morbidity
From a database of the Pediatric Association of the Netherlands we invited 25 consecutive pediatricians to be members of a panel. Of these, 17 agreed and 8 refused for having a lack of time. The construction of a panel of pediatricians for the PUC study served 2 purposes. Because this procedure is relevant to the reproducibility of the study, a detailed description is provided here. First, panel members were asked to evaluate the medical charts and additional study measures of all children to define the optimal diagnostic approach and primary cause of the pain symptoms in each child. Results from this procedure are published elsewhere.12 Second, the 17 pediatricians were asked to fill out and return a mailed questionnaire that was aimed at identifying intake characteristics of patients with UCP that were deemed diagnostically important for psychiatric morbidity. The questionnaire was mailed, on average, 7 months (range: 69 months) after finishing the evaluation of the patient charts. One pediatrician did not return the questionnaire because of a traffic accident. Questionnaires were returned by 16 pediatricians, of whom 14 worked in regional pediatric hospitals, 1 in a rehabilitation center, and 1 in a university children's hospital. The questions that focused on possible predictors of psychiatry were phrased as follows: (1) What do you consider to be alarming symptoms for relevant psychological and/or psychiatric morbidity in a child presenting with UCP? (2) What do you consider to be alarming symptoms for relevant psychosocial or family problems in a child presenting with UCP? (3) What do you consider to be alarming symptoms for relevant somatic morbidity in a child presenting with UCP?
Subsequently, 3 researchers (A.Y.K., C.S.P.M.U., and E.R.d.G.-M.) independently screened the pediatricians' answers and identified 8 major domains of information that the pediatricians deemed relevant for diagnosing psychiatric morbidity (Table 1, column 1).
|
For diagnostic modeling, the following basic characteristics were additionally scrutinized for diagnostic value: age, gender, and primary complaint.
Diagnostic Index Tests: Screening Questionnaires
Several questionnaires for the child and his or her parent(s) were filled out at home and returned before the results of additional diagnostic investigations from routine care were known and before the psychiatric assessment was conducted.
The Child Health Questionnaire Child Form (CHQ-CF) is a validated self-report health-status measure13 covering both physical and psychosocial domains. We used the scales on physical functioning, role/social limitations caused by physical problems, and general health perceptions. Scores range from 100 (no impairment) to 0 (severe impairment).
The Children's Somatization Inventory (CSI) is a reliable 35-item self-report inventory for somatic symptoms14 that measures the extent of bothering by a symptom in the past 2 weeks on a 5-point scale (0 ["not al all"] to 4 ["a whole lot"]). We considered a symptom to be present at a score of
1.
The Dutch Personality Inventory for Youth (DPIY) is a 105-item validated self-report personality questionnaire.15 Total scores can be calculated for inadequacy, social inadequacy, tenacity, recalcitrance, and dominance. Statements are rated on a 3-point scale: 0 ("No, that is not me"), 1 ("I'm not sure"), and 2 ("Yes, that is me").
The Child Behavior Checklist (CBCL) is an extensively validated parent-report questionnaire that evaluates behavioral and emotional problems in children.16 It consists of competence (20 items) and problem (120 items) sections, each yielding total scores and normalized T values for several domains. In this study, only the section's total scores were used.
The Checklist for Family Problems (CFP) is a Dutch family-problem inventory for which the theoretical frame was formed by the Family Assessment Measure.17 In our study, the screening part (29 items) of this questionnaire was used. Each question is rated from 0 ("not applicable to our situation") to 2 ("evidently/often applicable to our situation"). Total scores are calculated for men and women separately.
Questionnaire data were selected according to the domains identified by pediatricians (Table 1, column 3).
Diagnostic Reference Test: Psychiatric Assessment
The Diagnostic Interview Schedule for Children-Parent Version IV (DISC-P) is a highly structured respondent-based interview for children that was conducted by trained lay-interviewers.18 The Semi-structured Clinical Interview for Children and Adolescents (SCICA) mimics clinical interviewing by child psychiatrists in everyday clinical practice to assess a child's psychiatric functioning and Diagnostic and Statistical Manual of Mental Disorders (DSM) classification.19 An experienced child psychiatrist (J.v.d.H.), who received extensive training in using this method, conducted the interview.
Child and parent interviews were conducted simultaneously in separate rooms shortly after intake and before completion of the standard diagnostic workup. The child psychiatrist integrated the results from both the SCICA and the DISC-P into a final psychiatric classification according to DSM-IV diagnostic rules. If the DISC-P yielded a psychiatric outcome (ie, when DISC-P algorithm thresholds were reached), it was taken as a DSM-IV axis I diagnosis. In addition, the SCICA interview in itself could provide sufficient information to set a DSM-IV axis I diagnosis. Thus, a final psychiatric diagnosis was made by an experienced clinician based on child data, parent data, and/or a combination of both. Presence of the DSM-IV classification was used to classify children into the groups with psychiatric morbidity present and absent. The latter was used as the diagnostic reference test.
Medical Diagnosis According to Routine Medical Care
To assess the medical diagnosis from routine medical care, patient charts were analyzed 1 year after the first visit. A 1-year time span was chosen to assure a full medical workup. The medical diagnosis was coded by the primary researcher (A.Y.K.) according to the system used by Reid et al20,21 and Nimnuan et al.21 A second researcher (E.R.d.G.-M.) was consulted in case of uncertainty. Briefly, symptoms were coded as medically explained, probably medically unexplained, or definitely medically unexplained. Symptoms were considered medically unexplained when there was evidence of a comprehensive diagnostic workup, with the results of all investigations negative, and either psychosocial reasons were suggested or a diagnosis was made that implied a medically unexplained syndrome (eg, fibromyalgia, irritable bowel syndrome, chronic fatigue syndrome, etc). This method has shown good interrater reliability.20
Data Analysis
Univariate logistic regression was used to assess associations between each predictor variable and the reference test. Variables with P values of
.15 were selected for additional analysis. Subsequently, multivariate logistic-regression models were used to identify independent predictors by stepwise backward-selection methods (maximized likelihood; P value for inclusion: .05; P value for exclusion: .10), for the clinical data set and the screening data set separately. Thus, a final clinical and a final screening model were created. The model fit was estimated by using the Hosmer-Lemeshow test.22 For each of the final models, receiver operating characteristic curves were constructed, and the areas under the curves (AUCs) were estimated. The AUC represents the discriminative power of a test ranging from 0.5 (no discrimination) to 1.0 (perfect discrimination).23 As a means of internal validation (ie, to correct for overoptimism), a 100-sample bootstrapping procedure was performed on each model to calculate a shrinkage or correction factor to be applied to all regression coefficients.29 Thus, shrunken odds ratios (ORs) and AUCs were obtained.
Finally, a predicted probability for psychiatric morbidity was calculated for each patient by using the shrunken regression coefficients of each of the 2 models. As a check on the predictive capacity of the 2 models, a table was made to show risk categories predicted by the index-test model and the actually observed outcome of reference testing, analogous to the recommended flow diagram on diagnostic accuracy in the Standards for Reporting Diagnostic Accuracy (STARD) initiative.24 To prevent introducing bias and loss of statistical precision, we imputed missing values. Data were only imputed in case of <10% missing values. Single regression imputation was used: a regression equation was fitted with use of all available variables to estimate as precisely as possible those values that were missing.25 Thus, per missing value an estimate was calculated on the basis of the other data available from that particular patient. For statistical analysis, the SPSS 11.5 (SPSS Inc, Chicago, IL) and S-plus 2000 (MathSoft, Seattle, WA) were used.
| RESULTS |
|---|
|
|
|---|
2 = 4.5, degrees of freedom [df] = 1; P = .04). The general characteristics (age, gender, pain type) and mean questionnaire scores (CBCL, Dutch Personality Questionnaire for the Young, CSI, CHQ, CFP) of the 19 children who eventually were excluded were comparable to those of the children who were included.
|
2 = 8.2, df = 1; P = .007).
|
|
|
|
| DISCUSSION |
|---|
|
|
|---|
Before discussing our results, some methodologic aspects of our study need to be addressed. Only a minor group stated psychiatric assessment as a reason for refusal to participate. This group did not differ materially from other nonparticipants. Therefore, we do not think that nonresponse biased our results. Although we aimed to avoid too much deviation from routine practice, we added some semistructured interviewing to complete the clinical data. This may have rendered our intake data slightly more complete than one would find in regular practice. A stronghold of our study is that we used extensive gold-standard reference testing for psychiatric morbidity in all children who participated.
Ideally, pediatricians involved in the care of children with UCP have proper tools for early recognition of both somatic and psychiatric disorders that underlie the complaints. In regular practice, pediatricians do cope with the problem, but there is very little formal evidence to support their actions. We verified whether clinical patient characteristics deemed important by pediatricians do actually predict the presence or absence of psychiatric disorder in children with UCP. In previous reports, a number of patient characteristics such as parental illness, educational problems, an increased number of health concerns, and problematic social competence were shown to be associated with specific somatization in children.10,26 Although UCP is not synonymous to somatization, a similar set of characteristics was predictive in our study for the diagnosis of psychiatric disorders.
All clinical predictors were associated with psychiatric disorder in the expected direction, except perhaps for age. Age was an important independent predictor, but the younger the child was, the higher the chances of finding psychiatric morbidity were. One explanation might be the tendency for younger children to present psychiatric morbidity with a predominantly somatic vocabulary, contrary to older children.27 An explanation that we cannot formally exclude is that adolescents with UCP had dissimulated psychiatric symptoms at reference testing. However, because an experienced child psychiatrist performed this testing by using various sources, we consider the latter to be an unlikely explanation. As expected, abridged parental somatization, impaired social contacts, problems at school, and nontypical family structure were each positive predictors of psychiatric disorders in the children.
We know of no formal guidelines or protocols for diagnosis or treatment in children with UCP, indicating that care is at least not highly structured. Furthermore, there may be large differences in the organization of care for children with UCP. Therefore, we also explored the possibility of questionnaire screening for psychiatric problems as a diagnostic option. The combined information of the CBCL and the Dutch Personality Questionnaire for the Young was similarly accurate as routine history taking in diagnosing psychiatric morbidity among children with UCP.
We consider our diagnostic evidence important for a number of reasons. Our gold-standard test, elaborate psychiatric assessment, is not available in every pediatric facility, nor is such assessment of every child with UCP desirable or feasible. It is important to note that early detection of psychiatric morbidity by simple and available methods will be much to a child's benefit, because it facilitates timely, appropriate, and targeted action in that direction.8 It is clear that labeling of the complaints in a direction of "medically unexplained" or "psychological or psychiatric" may hamper relations between physicians and patients.28 However, at the same time, is has to be acknowledged that psychiatric morbidity is highly prevalent in children with UCP. Unfortunately, there still is insufficient understanding of the relation between psychiatric disorders and medically unexplained complaints, particularly in children.
To our knowledge, our study is the first formal diagnostic approach to the problem of children with UCP. This implies some caution toward implementation of the results. We obtained our prediction models from our derivation set only. Although we did use bootstrapping techniques as an accepted means of internal validation, clinical application will require additional external validation.29,30 However, we feel that our results are sufficiently promising to warrant additional research in this area.
Distinct markers for somatic pathology were not identified in our sample. In itself this is not surprising, given the fact that children were referred by pediatricians or general practitioners who were not able to fully explain the symptoms. However, proper pediatric assessment, of course, is still mandatory in a child who presents with UCP. Although the proportion is small, some children do have a (comorbid) somatic explanation for their pain. We do feel that more attention to psychiatry as a putative explanation of UCP should be given, but this should not lead to a relative neglect for somatic assessment.31
| CONCLUSIONS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
The members of the Pain of Unknown Origin in Children (PUC) Study Group members are (in alphabetical order): Pieter J. van Dijken, MD, PhD, MBA, St Elisabeth Hospital, Tilburg, Netherlands; Regina H.M. Dijkman-Neerincx, MD, Rijnstate Hospital, Arnhem, Netherlands; Alphons H.P.M. Essink, MD, Hieronymus Bosch Hospital, 's-Hertogenbosch, Netherlands; Boudien C.T. Flapper, MD, Beatrixoord, Haren, Netherlands; Ellen A. Fliers, MD, Department for Youth, RIAGG Rijnmond Zuid, Rotterdam, Netherlands; Jeanette K. ten Haaf, MD, MESOS Medical Center, Utrecht, Netherlands; Marchinus Hofkamp, MD, Gelre Hospitals, Apeldoorn, Netherlands; Syb B. van der Meer, MD, PhD, Atrium Medical Center, Heerlen, Netherlands; Marijn Moens, MD, Hospital Diakonessenhuis, Zeist, Netherlands; Rolf A.A. Pelleboer, MD, Catharina Hospital, Eindhoven, Netherlands; Aart van Rhijn, MD, Hospital Eemland, Amersfoort, Netherlands; Ingrid M.B. Russel, MD, University Medical Center Utrecht, Utrecht, Netherlands; Bernadien T.M.J. Thunnissen, MD, Center for Astma Heideheuvel, Hilversum, Netherlands; Arine M. Vlieger, MD, Antonius Hospital, Nieuwegein, Netherlands; Johanna M.B. Wennink, MD, PhD, St Lucas Andreas Hospital, Amsterdam, Netherlands; Hester van Wieringen, MD, MESOS Medical Center, Utrecht, Netherlands; and Pieter Zwart, MD, Isala Clinics, de Weezenlanden, Zwolle, Netherlands
| FOOTNOTES |
|---|
Address correspondence to Cuno S.P.M. Uiterwaal, MD, PhD, Department of Clinical Epidemiology, Julius Center for Health Sciences and Primary Care, D01.33.5, PO Box 85090, 3508 AB Utrecht, Netherlands. E-mail: c.s.p.m.uiterwaal{at}umcutrecht.nl
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. M. Dufton, M. J. Dunn, and B. E. Compas Anxiety and Somatic Complaints in Children with Recurrent Abdominal Pain and Anxiety Disorders J. Pediatr. Psychol., June 24, 2008; (2008) jsn064v1. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||