Published online February 29, 2008
PEDIATRICS Vol. 121 No. 3 March 2008, pp. e581-e589 (doi:10.1542/peds.2007-1771)
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via CrossRef
Google Scholar
Right arrow Articles by Ertem, I. O.
Right arrow Articles by Cicchetti, D. V.
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ertem, I. O.
Right arrow Articles by Cicchetti, D. V.
Related Collections
Right arrow Developmental/Behavior

ARTICLE

A Guide for Monitoring Child Development in Low- and Middle-Income Countries

Ilgi O. Ertem, MDa, Derya G. Dogan, MDa, Canan G. Gok, MSca, Sevim U. Kizilates, MDa, Ayliz Caliskan, MDa, Gulsum Atay, MDb, Nilgun Vatandas, MDb, Tugba Karaaslan, MSca, Sevgi G. Baskan, MDa and Domenic V. Cicchetti, PhDc

a Developmental-Behavioral Pediatrics Unit, Department of Pediatrics, Ankara University School of Medicine, Ankara, Turkey
b Department of Pediatrics, Baskent University School of Medicine, Ankara, Turkey
c Child Study Center and Departments of Psychiatry, Epidemiology, and Public Health in Biometry, Yale University School of Medicine, New Haven, Connecticut


    ABSTRACT
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 
OBJECTIVE. In low- and middle-income countries, methods for clinicians to address difficulties in language, social-emotional, cognitive, behavioral, or neuromotor development during early childhood are lacking. To fill this gap, we designed, in Turkey, the Guide for Monitoring Child Development, which aims to aid clinicians in monitoring and supporting child development and the early detection and management of developmental difficulties. The Guide for Monitoring Child Development monitoring component is a practical, open-ended interview that catalyzes communication between clinicians and caregivers and obtains a portrayal of the child's development. We report on the development and psychometric properties of the Guide for Monitoring Child Development monitoring component for children aged 0 to 24 months.

METHODS. We examined the ages of attainment of Guide for Monitoring Child Development milestones and internal consistency in a cross-sectional study of healthy children receiving well-child care (study 1). In 2 clinical samples, we studied the interrater reliability between medical students and a child development specialist administering the guide (study 2), as well as the concurrent validity of the guide administered during a health visit and a comprehensive developmental assessment (study 3).

RESULTS. In study 1 (N = 510), item-total scale correlations ranged from 0.28 to 0.91. An age-dependent attainment pattern was seen in all of the milestones. In study 2 (N = 92), interrater reliability between medical-student pairs and between the child development specialist and students was high (kappa scores were 0.83–0.88). In study 3 (N = 79), the sensitivity, specificity, and positive and negative predictive values were 0.88, 0.93, 0.84, and 0.94, respectively.

CONCLUSIONS. The Guide for Monitoring Child Development is an innovative method for monitoring child development that is designed specifically for use by health care providers in low- and middle-income countries. Studies in Turkey provide preliminary evidence for its reliability and validity.


Key Words: child development • developing countries • surveillance and monitoring • developmental screening • screening tools

Abbreviations: LAMI—low and middle income • GMCD—Guide for Monitoring Child Development • WHO—World Health Organization • UNICEF—United Nations International Children's Education Fund

In low- and middle-income (LAMI) countries,1 as childhood mortality has decreased, developmental difficulties, including disabilities, disorders, or delays in cognitive, language, social-emotional, behavioral, or neuromotor development that begin during early childhood are increasingly recognized as important contributors to morbidity across the life span.26 In high-income countries, an important strategy for the early detection and management of developmental difficulties has been the integration of developmental monitoring of children (ie, standardized screening and surveillance) into health care.712 In LAMI countries, health services are often the only professional services available to young children and offer, particularly during the first 2 years of life, important opportunities to address child development.3,4,13 Interventions to enhance the development of young children are increasingly becoming available in developing countries and include low-cost strategies, such as addressing malnutrition and iron deficiency, improving caregiver-child relationships, increasing psychosocial stimulation, and establishing community-based rehabilitation.1317 To date, however, methods designed specifically for developmental monitoring of young children by health care providers in LAMI countries are lacking.26,13,14,18

Research in Western countries has shown that children and their caregivers benefit from developmental monitoring during health visits in a number of ways: (1) if the child is developing typically, clinicians can provide reassurance, support parenting competence, and provide anticipatory guidance; (2) if the child is at developmental risk or has an established or emerging delay or difficulty, this can be detected early and addressed; and (3) in both situations, caregivers can be supported and informed about how to enhance their child's development.712 At a population level, developmental monitoring can inform policy about rates of developmental difficulties so that existing interventions can be appropriately allocated, their effect can be monitored, and the need for further interventions can be determined.2,56,13,17

In the United States, the implementation of developmental monitoring and the early detection of developmental difficulties have made only limited progress without the use of standardized instruments and protocols; therefore, the American Academy of Pediatrics currently recommends that standardized instruments be used.7,19,20 Such instruments have evolved in 2 areas in the past 40 years.2124 First, language, social-emotional, cognitive, and behavioral development, as well as functional capacity, have become essential constructs that are incorporated into instruments. Second, the importance of caregiver-clinician communication and partnership has been reflected in the methods used for developmental monitoring. Based on the family centered care initiative in pediatrics and advances in early intervention, models in which a parent watches while a clinician "tests" the child have evolved to models in which a caregiver and clinician use instruments to "talk" about the child's development. Many instruments that ask caregivers about their concerns regarding their child's development and/or whether their child has achieved certain developmental milestones have been shown to have appropriate psychometric properties as screening tools and are now recommended and widely used in Western countries.2224

Studies from LAMI countries suggest that caregivers2527 and health care providers2830 may not be well equipped with knowledge about early childhood development, and, therefore, the need for instruments in the monitoring process may be even more important than in high-income countries. Ideally, in both high-income and LAMI countries, methods used for developmental monitoring in health systems should (1) be based on well-supported current theories and conceptualizations of child development, (2) be reliable and valid, (3) be linked directly to frameworks for supporting development and managing developmental problems when they are detected, (4) be brief, easy to learn, and easy to administer, and (5) require minimal cost, equipment, and paperwork.

Several differences between high-income and LAMI countries need to be addressed, however, when adapting or developing instruments that can be used in LAMI countries. First, low caregiver literacy limits the use of written questionnaires and checklists. Second, in populations where developmental difficulties are prevalent, caregivers may not have an appropriate reference as to how children should typically develop. Although identifying caregivers’ concerns is of key importance in developmental monitoring, reliance on this method alone for early identification of developmental difficulties in LAMI countries requires further examination.27,31 Third, the use of structured questions or checklists about milestones may also be problematic. Caregivers may not readily admit that their child has not reached a milestone and may provide socially desirable answers, particularly if they do not receive health care from the same trusted clinician at each visit, do not believe that interventions exist, or are concerned about stigma related to developmental difficulties. Fourth, the alternative reliance on "child testing" methods is neither practical nor desirable. Caregivers do know their children best, and even more so than in Western countries, they are the key resource to support children's development. Therefore, family centered methods for monitoring child development that have evolved in the West should be the methods of choice for developing countries as well. Testing of the child most often leaves the caregiver "watching" rather than participating in the evaluation, and, therefore, this approach does not capitalize on the partnership of clinicians with caregivers. Furthermore, it is difficult to elicit the optimal developmental functioning of young children during health care visits. When objects are needed to elicit children's skills, the cleanliness and maintenance of such objects may be a concern in LAMI countries. Fifth, instruments that are to be used across LAMI countries need to include universal and not culture-specific concepts in child development. Sixth, monitoring child development is a new concept for health care providers in LAMI countries, and methods that are to facilitate monitoring should build on existing protocols (such as growth monitoring and immunizations) and clinicians’ skills (such as clinician-patient communication).

A number of instruments that were designed to involve caregivers in the monitoring process and were developed in Western countries3236 have the potential to be adapted for use in developing countries. None of these instruments, however, has been designed specifically to address concerns in developing countries. Therefore, the Guide for Monitoring Child Development (GMCD) was developed for use by health care providers in LAMI countries to monitor the development of children 0.0–3.5 years of age. The GMCD has 3 components: (1) the monitoring development component, which is reported here; (2) the supporting development component, which is an expanded version of the World Health Organization (WHO)/United Nations International Children's Education Fund (UNICEF) Care for Development Intervention15,37 and has been incorporated by the WHO into the newly launched International Growth Standards training package38; and (3) the managing developmental difficulties component, which has been adopted by the Turkish Ministry of Health and UNICEF-Turkey to be used in a nationwide training program on child development for primary health care providers. We report here a description of the GMCD monitoring development component, referred to as the GMCD, and the results of research in Turkey on its development, interrater reliability, and validity for children aged 0 to 24 months.


    METHODS
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 
Description of the GMCD
The GMCD aims to provide a method for developmental monitoring and early detection of developmental difficulties in LAMI countries and is rooted in the ecological and transactional conceptualizations of child development,39,40 family centered care,41 and relationship- and strengths-based developmental assessment.21 To develop the GMCD, a comprehensive search of the literature was conducted, and consultations were held with experts on child development in both Western and developing countries. Core ideas were adapted from 3 seminal models: New Visions for Developmental Assessment of Young Children,21 Bright Future Guidelines,42 and the WHO International Classification of Functioning,43 as well as 2 well-known and widely used instruments, the Parents’ Evaluation of Developmental Status32 and the Vineland Scales of Adaptive Behavior.33 The open-ended interview technique was chosen as the administration method for the GMCD. This technique is based on the fundamental and universal principles of human communication and recall of information,44 builds on patient-centered communication techniques,45,46 avoids assumptions about what the child should be doing, lessens the possibility that caregivers will provide socially desirable answers, and is designed to be culturally neutral.

The GMCD is a brief, open-ended, precoded interview with the primary caregiver. The interview is administered in the following standard way. Caregivers are first provided with an explanation of the reason for the interview, and caregiver interest and cooperation are elicited. Table 1 shows examples of the questions of the GMCD and the way it is structured. The first question is adapted from the Parents’ Evaluation of Developmental Status32 and relates to identifying parental concerns. If the caregiver expresses concerns, these are explored further before the interview is continued. Next, the clinician explains the importance of obtaining a portrayal of the child's typical functioning and asks the 6 open-ended questions shown in Table 1. The questions (2–7) relate to the following developmental domains: (question 2) expressive language and communication, (question 3) receptive language, (question 4) gross and fine motor, (question 5) relationship (social-emotional), (question 6) play, and (question 7) self-help skills (for children older than 12 months). For each of the 6 questions, there are specific precoded milestones. Caregiver's spontaneous responses to the open-ended questions are applied to the milestones whenever possible. Additional questions are used when necessary to prompt responses to specific milestones. The GMCD does not include questions for the cognitive domain, because for young children it is difficult for a caregiver to narrate aspects of cognitive development separately from language, relating, and play skills. Cognitive development is addressed in the domains and in the first question, specifically asking if the caregiver is concerned about the child's cognitive development, using explanations such as "thinking," "using his mind," and "intelligence."


View this table:
[in this window]
[in a new window]

 
TABLE 1 GMCD Questions and Examples of Milestones

 
The GMCD form, which is used to ascertain whether a child is developing typically and to document the monitoring, is composed of 2 tables provided on each side of a single sheet. The questions are placed in rows, the 8 age ranges (1–3, 4–5, 6–7, 8–10, 11–13, 14–16, 17–19, and 20–24 months) are placed in columns, and the precoded developmental milestones are in the cells. The age ranges were selected based on the schedules for monitoring growth and providing immunizations recommended by the WHO. The milestones were constructed by the following method. We pooled all of the developmental milestones from 5 previously standardized and validated developmental screening or assessment instruments: Denver II,47 Vineland,33 Brigance Screening Test,48 Ages and Stages Questionnaire,34 and Bayley Scales of Infant Development Second Edition (Bayley II).49 Three experts in child development selected milestones that could be easily observed and reported by caregivers in response to the GMCD questions and that were thought to be universal (eg, interactive play such as peek-a-boo) and not culture specific (eg, playing with a mirror). A pilot study was conducted to assess the appropriateness and comprehension of the questions and milestones. This pilot study included 150 caregivers of children referred to Ankara University from many regions of Turkey. Some of the GMCD milestones were subsequently revised based on caregivers’ narrations of their child's development.

Three studies were conducted in Turkey on the construction and psychometric properties of the GMCD, for children aged 0–24 months. Study 1 aimed to determine the ages of attainment of the GMCD milestones, study 2 sought to examine ease of administration and interrater reliability, and study 3 served to examine concurrent validity of the GMCD with a comprehensive developmental assessment.

Study 1: Ages of Attainment of the GMCD Milestones
Participants
We used the WHO recommendations to select the study sample. The WHO recommends that, in populations with a high prevalence of conditions that are hazardous to child health and development (such as malnutrition, low birth weight, chronic infections including HIV/AIDS, parasitic infestations, iron deficiency anemia, and perinatal complications), references for monitoring growth and development should be based on what the WHO refers to as a "prescriptive sample" of healthy, thriving children without these risks rather than geographic, whole-population-based references.50,51 The participants were children who, from birth onward, had received preventive health care at 2 university-affiliated community well-child care clinics in Ankara (Ankara and Baskent Universities). The intended sample size was 30 children of each gender in 8 age ranges under 25 months, resulting in a total of 480 children. All of the eligible children were enrolled and participated in the study. The pediatricians in the clinics who conducted the well-child visit examination completed the health record. At the end of the visit, a developmental-behavioral pediatrician reviewed the health records and applied the following inclusion criteria to identify the final sample that was used in the analyses. Children were included in the sample if they were born as healthy singletons with birth weight ≥2500 g and gestational age ≥37 weeks; their growth had been between fifth to 95th percentiles since birth; they had received and complied with the free iron prophylaxis available to children in Turkey after 6 months of age or their hemoglobin screens had been normal within 1 month of the study; and the pediatric evaluation and chart review concluded that they were healthy, growing normally, and had not had any health-related problems since birth apart from acute minor illnesses.

Procedures
Four researchers were trained in the administration of the GMCD and reached 95% interrater agreement on 25 consecutive administrations. At both sites, eligible caregivers were invited to participate in the study while they were waiting for their health visit or after the visit. Caregivers were informed that this was a study to obtain normative information about child development. The standard open-ended method of administration was used; 1 modification was made for the study. To avoid asking caregivers about milestones normally occurring much earlier or later than the age of the child, milestones were temporarily placed in age rows based on the following process. The 5 instruments33,34,4749 used to construct the GMCD were examined, and the milestone was placed in the age column in which ≥90% of children in ≥1 of the instruments achieved this milestone. After the caregivers’ spontaneous responses were recorded, they were told that there may be other things that the child may or may not be doing. Milestones 1 below and 1 above the child's age range were read to the caregiver who was then asked whether the child had attained these milestones.

Data Analysis
Internal consistency of the GMCD was examined by computing item-total score correlation for each milestone and Cronbach's {alpha} for each domain and the total instrument. Item-total scale correlations of >.25 and Cronbach's {alpha} of >.70 were considered appropriate.52 The presence of an age-dependent developmental pattern was examined using Pearson correlation coefficients for each domain score and age. The {chi}2 test was used to examine whether significant differences existed between girls and boys in the ages of attainment of developmental milestones. We computed the age at which >90% of the study sample performed each milestone, which was then placed in the corresponding age column.

Study 2: Ease of Administration and Interrater Reliability
In study 2, 1118 fifth-year medical students at Ankara University School of Medicine were trained in the use of the GMCD; the training involved a 1.0-hour seminar and a 1.5-hour practicum. Of these, 184 randomly selected fifth-year students were paired as partners. The paired students administered the GMCD to caregivers of 92 children aged 0–24 months who received health care at Ankara University School of Medicine Department of Pediatrics. While 1 student administered the GMCD, the other observed, and both completed the GMCD independently; administration time was recorded. A child development specialist with extensive experience on the GMCD administered the GMCD to the same caregivers within 48 hours of the medical students. The students completed a questionnaire related to ease of administration, and the child development specialist asked caregivers questions about the ease of responding to the GMCD. Percentage of agreement and {kappa} were used to examine interrater reliability for the overall GMCD result. We used as our criterion for interrater reliability a {kappa} value of ≥0.60, defining a level of "good" chance-corrected interrater agreement.52

Study 3: Concurrent Validity
Preliminary criteria for interpreting the GMCD were developed to examine concurrent validity. If the child was reported to exhibit all of the milestones at age level, the GMCD interpretation was classified as "appropriate for age." If the child did not demonstrate ≥1 of the age-appropriate milestones, the GMCD interpretation was classified as "requires follow-up evaluation with or without intervention." In a cross-sectional study, we examined the concurrent validity of the GMCD. Infants aged 1–24 months who had been born with birth weight ≤1500 g, treated in the NICU at Ankara University, and who came for health visits to the follow-up clinic were enrolled consecutively over a 6-month period. A pediatrician with no specific training in child development but trained in the use of the GMCD administered the GMCD at the time of a clinic visit. An experienced developmental-behavioral pediatrician, "blinded" to the GMCD results, conducted a comprehensive developmental assessment within 48 hours. This evaluation included a developmental history, play observations, neurologic examination, and the Bayley II.49 The comprehensive evaluation was considered positive if the clinician decided that the child needed developmental interventions or the Bayley Mental Index or Psychomotor Development Index was 2 SDs below the mean of the US reference (score < 70). {kappa}, sensitivity, and specificity were used to examine concurrent validity.53

For all 3 of the studies, data were analyzed using SPSS 11.0 (SPSS Inc, Chicago, IL).54 Written, informed consent from caregivers was obtained for all 3 of the studies, which were approved by Ankara University School of Medicine Ethics Committee.


    RESULTS
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 
Study 1: Ages of Attainment of the GMCD Milestones
Of the 546 families invited to participate in the study, 18 were excluded because of iron deficiency anemia (n = 12), chronic illness (n = 2), or history of perinatal asphyxia (n = 4). Of the 528 families who met study inclusion criteria, 18 declined, resulting in a 97% response rate. The sociodemographic characteristics of the remaining sample of 510 children are shown in Table 2. The sample was 51% male, and 59% were ≤12 months of age. Most mothers had at least a secondary school education (97.6%) and worked (69.4%). Most were nuclear families (86.7%), and in 58.1%, the mother was the child's full-time caretaker.


View this table:
[in this window]
[in a new window]

 
TABLE 2 Sociodemographic Characteristics of participants in Studies 1, 2, and 3

 
Item-total scale correlations ranged from 0.29 to 0.91; 84% of the 89 milestones had item-total correlations ≥0.40. Internal consistency measured by the Cronbach's {alpha} was high,50 ranging from .80 to .96 for each of the 6 domains and was .95 for the total GMCD. An age-dependent developmental pattern was seen in all of the milestones, as reflected by Pearson correlation coefficients for each domain score and age in months ranging from 0.88 to 0.96 (P < .001). No statistically significant differences were found between the mean ages of attainment for girls and boys on any of the milestones or domains. Therefore, 1 reference table was constructed for both genders. Table 3 shows an example of the developmental progression of the ages of attainment of 3 selected milestones. A similar age-dependent developmental pattern was seen in all of the milestones. The milestones were placed in the age ranges based on the 90% cutoff; the final GMCD had between 9 and 15 milestones, respectively, for each of the 8 age ranges from 0 to 24 months.


View this table:
[in this window]
[in a new window]

 
TABLE 3 Examples of Age-Dependent Attainment of Selected Milestones

 
Study 2: Ease of Administration and Interrater Reliability
The sociodemographic characteristics of the sample in study 2 are shown in Table 2. Most caregivers in this sample had <5 years of education (64%), and 78% were unemployed mothers. After the standard training, 96% of medical students stated that the GMCD was easy to administer and that within the brief encounter they achieved good communication with caregivers. The mean administration time by the students was 7 ± 2.3 minutes. Almost all of the caregivers (98%) stated that the questions of the GMCD were easy to understand and answer. For the total sample, interrater reliability between the student pairs (agreement: 93.4%; {kappa} = 0.84; P < .001) and between the child development specialist and the students (student 1: agreement: 94.5%; {kappa}= 0.88; P < .001; student 2: agreement: 92.3%; {kappa} = 0.83; P < .001) were high.52 Between student pairs, {kappa} was 0.79 (P < .001) for caregivers with a primary school education or less and 0.93 (P < .001) for caregivers with at least a secondary school education.

Study 3: Concurrent Validity
The sociodemographic characteristics of the sample in study 3 are shown in Table 2. Most caregivers had a high school education or less (57%) and were unemployed (57%) mothers. The development of the former very low birth weight children was found to be "appropriate for age" in 68.4% with the GMCD and in 69.6% with the comprehensive evaluation. The average agreement on positive (developmental delay) and negative (no delay) cases was 21 (87.5%) of 24 and 51 (92.7%) of 55. The weighted sum of these 2 indices of average agreement produced the overall agreement of 72 (91.1%) of 79 and a {kappa} of 0.79 (P < .001). The sensitivity and specificity rates were 21 of 24 (0.88; 95% confidence interval: 0.69–0.96) and 51 of 55 (0.93; 95% confidence interval: 0.83–0.97), respectively, which represent "good" and "excellent" levels of diagnostic accuracy.53 Based on this clinic sample, we obtained a predicted positive accuracy value of 0.84 and a predicted negative accuracy value of 0.94.


    DISCUSSION
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 
The GMCD is a novel method with the ultimate goal of facilitating developmental monitoring and the early detection of developmental difficulties of children in LAMI countries. The theoretical conceptualization of the GMCD is anchored in family centered, relationship, and strengths-based developmental assessment theory,21,24,3941 and the techniques used are adapted from currently used strategies in screening and surveillance.32,33,42 The GMCD advances the field conceptually by introducing a new and practical method of using an open-ended interviewing technique to obtain comprehensive information about the child's developmental functioning. Brevity of the training, administration, and scoring and the 1-sheet instrument offer a practical approach to developmental monitoring. The 3 studies in Turkey have provided promising results on the psychometric properties of the GMCD. Internal consistency was high, as measured by item-total score correlations and Cronbach's {alpha} for the domains and total score. The sample size of ~64 children in each of the 8 age ranges was adequate to demonstrate a stable, age-dependent attainment of the milestones. The 90th percentile cutoff point was used for placing milestones in age ranges; the percentile method has been used previously in other instruments, such as the Denver II.47 Medical students with no previous background on child development were able to learn the GMCD after a brief training and administer it reliably. Sensitivity and specificity were in the range that is considered good to excellent for the diagnostic accuracy of developmental screening tests.53

In high-income countries, different instruments have been standardized and validated for developmental monitoring and the early detection of developmental difficulties.7,22,23 In LAMI countries, research on child development is extremely limited.2,5,6,13,14 Instruments such as the Ten Questions Questionnaire,5557 Access Portfolio,58 and Disability Screening Schedule59 have been developed but are designed to question caregivers about whether a child has a severe disability and do not provide a framework for monitoring the development of young children. The Denver test47 has been used in many countries, but decades after large standardization and restandardization studies in many different LAMI countries, research on the use of the Denver test in promoting developmental monitoring and child development is lacking. The Denver test relies on "child testing" and "structured questions," both of which are not ideal in LAMI countries. The training does not stress the importance of developing partnerships with caregivers or of promoting child development and does not have a component that can be used for planning interventions. Furthermore, the Denver II test is less commonly used in the West than it was previously because of research demonstrating its inadequate screening accuracy.60

Each of the 3 studies has limitations in sampling and methodology. The study on the ages of attainment of GMCD milestones (study 1) is only generalizable to healthy children receiving well-child care in Ankara. In Turkey, 4 risk factors that are associated with developmental difficulties in young children are prevalent: malnutrition, iron deficiency anemia, low birth weight, and chronic illness.61 In study 1, therefore, we used the "prescriptive sample" approach recommended by the WHO.50,51 In the United States, most instruments on cognitive development have standards based on general populations where no attempts are made to exclude children with health conditions that pose risks to development. However, because children in developing countries have much higher rates of such health-related problems that increase the likelihood of developmental problems, the WHO recommends using "prescriptive samples" to construct standards. This approach was applied by the WHO in the construction of the newly launched WHO International Growth Standards and the WHO Motor Development Study.50,51 These studies have shown that, when child health is homogeneous and optimal, child growth and motor development are similar across diverse countries. The "prescriptive sample" approach enables LAMI countries to have standards for child development that are independent of major health-related risk factors for child development, more comparable between countries, and similar to those of Western children. This approach is now being applied in developing countries as exemplified by the population-based standardization study for developmental milestones in Argentina.62 As suggested by our study and that from Argentina, when healthy subjects are recruited, the sample may be skewed toward children whose caregivers have higher educational levels than national averages. Population-based studies are needed to examine the diagnostic accuracy of instruments, such as the GMCD, that have used healthy samples to construct standard references. Particular attention should be directed to whether this approach leads to high false-positive rates or whether it enables the identification of children who have delayed development but would be considered to be developing normally if population-based standard references were used.

The findings of the reliability study (study 2) were limited to medical students in a research setting. This study has provided evidence that medical students who have minimal clinical experience can be rapidly trained to administer and score the GMCD. Future studies must address whether the reliable administration of the GMCD can be sustained in real-life clinical practice. In this study, the sociodemographic characteristics of the sample were similar to national census data: 64% of the caregivers had <5 years of education, and 12% were illiterate. Those caregivers with low education could communicate their child's development in the GMCD process and provide information for the GMCD. {kappa} was lower but still within the excellent range for caregivers with primary school education or less.52 Future population-based studies in real-life settings are needed to determine the reliability and validity of the GMCD for caregivers with different levels of education.

The study on validity (study 3) did not use a population-based sample, and, therefore, the information on positive predictive accuracy and negative predictive accuracy only pertains to the clinical sample on which it is based. Future research is required to test whether similar results will be obtained for a population-based sample. The sample size was not adequate to determine whether validity was appropriate for all of the age ranges; the sample size for the 0- to 6-month range was particularly small. Until further evidence is available on the validity of the scoring criteria in large, population-based samples and different cultures, the GMCD should be used to guide clinicians in monitoring and supporting child development and should not be used as a cross-sectional screening test. Furthermore, in study 3, the validity of the GMCD was examined using a cutoff point for the Bayley II of –2 SD and a 90% cutoff point for the milestones. In future studies, so as to avoid missing children with mild delays, it will be important to determine which cutoff points for the milestones are accurate in comparison with a 1.5-SD cutoff point for the gold standard assessment.

The GMCD training program developed by the authors consists of written materials, slides, and demonstration videos and has been adopted by the Turkish Ministry of Health and UNICEF-Turkey to be used in a nationwide training program on child development for primary health care providers. The training involves 1 day for each of the 3 GMCD components. The training includes interpreting the result of the GMCD together with all of the other existing clinical information, giving feedback starting with the child's specific strengths and using the following components to develop a plan with the caregiver to support the child's development and to manage developmental difficulties if they are detected. In future research it will be important to: examine psychometric properties in population-based samples in diverse countries and to examine the efficacy and effectiveness of the GMCD training program in the early detection and management of developmental difficulties within health care systems.

This study also raises an important question related to international research on measures for monitoring child development in LAMI countries: if, as suggested by the WHO, healthy "prescriptive" samples are used to develop standard references for instruments such as the GMCD, are the ages of attainment of key developmental milestones of healthy children similar across countries? Comparisons of our data with other studies62,63 suggest that, during the early ages, children from different populations may attain developmental milestones at similar ages. If milestones with similar ages of attainment across populations can be included in instruments for developmental monitoring, such as the GMCD, this may have important implications for eliminating the need to standardize and validate instruments in each country.


    CONCLUSIONS
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 
As an effective strategy to enhance child development, many developed countries have redefined health care and have incorporated efforts to monitor and support the development of young children. As childhood mortality continues to fall in LAMI countries, there is an emerging interest in introducing models to optimize child development and to reduce the burden of developmental difficulties beginning in early childhood. The GMCD developed specifically to address some of the challenges in LAMI countries offers a practical new method for developmental monitoring and the early detection of developmental difficulties within health systems in such countries.


    ACKNOWLEDGMENTS
 
This study was supported by a grant from the National Institutes of Health and Fogarty International Center titled "Brain Disorders Across the Lifespan" (NIH R21 TW006678-01; CFDA No. 93.9899 "Promoting Child Development: Yale-Ankara Collaboration").

We deeply appreciate the contribution of Drs John M. Leventhal and Brian Forsyth for mentoring on the studies and preparation of the article; Drs Frances Page Glascoe, Sirel Karakas, and Sedat Isikli for suggestions on the data analysis; Drs Meena Cabral, Mercedes de Onis, and Jose Martines of the World Health Organization for suggestions and support; William Storandt for editing; and Nermin Sezer for data entry.


    FOOTNOTES
 
Accepted Jul 31, 2007.

Address correspondence to Ilgi O. Ertem, MD, Developmental-Behavioral Pediatrics Unit, Department of Pediatrics, Ankara University School of Medicine, Cebeci, Ankara, 06100 Turkey. E-mail: ertemilgi{at}yahoo.com

The authors have indicated they have no financial relationships relevant to this article to disclose.


    REFERENCES
 TOP
 ABSTRACT
 METHODS
 RESULTS
 DISCUSSION
 CONCLUSIONS
 REFERENCES
 

  1. The World Bank. Data country classification. Available at: http://web.worldbank.org/WBSITE/EXTERNAL/DATASTATISTICS/0,contentMDK:20421402~pagePK:64133150~piPK:64133175~theSitePK:239419,00.html. AccessedJuly 21,2007
  2. Grantham-McGregor S, Cheung YB, Cueto S, et al. Developmental potential in the first 5 years for children in developing countries. Lancet.2007; 369 (9555):60 –70[CrossRef][ISI][Medline]
  3. Durkin MS, Schneider H, Pathania VS, et al. Learning and developmental disabilities. In: Jamison DT, Breman JG, Measham AR, et al, eds. Disease Control Priorities in Developing Countries. 2nd ed. New York, NY: Oxford University Press;2006 :933 –951
  4. Committee on Nervous System Disorders in Developing Countries, Board on Global Health. Neurological, Psychiatric, and Developmental Disorders: Meeting the Challenge in the Developing World. Washington, DC: Institute of Medicine, National Academy Press;2001
  5. Maulik PK, Darmstadt GL. Childhood disability in low- and middle-income countries: overview of screening, prevention, services, legislation, and epidemiology. Pediatrics.2007; 120 (suppl 1):S1 –S55[CrossRef][Medline]
  6. Msall ME, Hogan DP. Counting children with disability in low-income countries: enhancing prevention, promoting child development, and investing in economic well-being. Pediatrics.2007; 120 (1):182 –185[Free Full Text]
  7. Council on Children With Disabilities, Section on Developmental Behavioral Pediatrics, Bright Futures Steering Committee, and Medical Home Initiatives for Children With Special Needs Project Advisory Committee. Identifying infants and young children with developmental disorders in the medical home: an algorithm for developmental surveillance and screening. Pediatrics.2006; 118 (1):405 –420[Abstract/Free Full Text]
  8. Kuo AA, Inkelas M, Lotstein DS, Samson KM, Schor EL, Halfon N. Rethinking well-child care in the United States: an international comparison. Pediatrics.2006; 118 (4):1692 –1702[Abstract/Free Full Text]
  9. Blair M, Hall D. From health surveillance to health promotion: the changing focus in preventive children's services. Arch Dis Child.2006; 91 (9):730 –735[Free Full Text]
  10. Regalado M, Halfon N. Primary care services promoting optimal child development from birth to age 3 years: review of the literature. Arch Pediatr Adolesc Med.2001; 155 (12):1311 –1322[Abstract/Free Full Text]
  11. Davis H, Tsiantis J. Promoting children's mental health: the European Early Promotion Project (EEPP). Int J Mental Health Promot.2005; 7 :4 –16
  12. Dworkin PH. British and American recommendations for developmental monitoring: the role of surveillance. Pediatrics.1989; 84 (6):1000 –1010[Abstract/Free Full Text]
  13. Engle PL, Black MM, Behrman JR, et al. International Child Development Steering Group. Strategies to avoid the loss of developmental potential in more than 200 million children in the developing world. Lancet.2007; 369 (9557):229 –242[CrossRef][ISI][Medline]
  14. Walker SP, Wachs TD, Gardner JM, et al. International Child Development Steering Group. Child development: risk factors for adverse outcomes in developing countries. Lancet.2007; 369 (9556):145 –157[CrossRef][ISI][Medline]
  15. Ertem IO, Atay G, Bingoler BE, Dogan DG, Bayhan A, Sarica D. Promoting child development at sick-child visits: a controlled trial. Pediatrics.2006; 118 (1). Available at: www.pediatrics.org/cgi/content/full/118/1/e124
  16. Mitchell R. Community-based rehabilitation: the generalized model. Disabil Rehabil.1999; 21 (10–11):522 –528[CrossRef][Medline]
  17. Walker SP, Chang SM, Powell CA, Grantham-McGregor SM. Effects of early childhood psychosocial stimulation and nutritional supplementation on cognition and education in growth-stunted Jamaican children: prospective cohort study. Lancet.2005; 366 (9499):1804 –1807[CrossRef][ISI][Medline]
  18. Mung'ala-Odera V, Newton CR. Identifying children with neurological impairment and disability in resource-poor countries. Child Care Health Dev.2007; 33 (3):249 –256[CrossRef][Medline]
  19. Sand N, Silverstein M, Glascoe FP, Gupta VB, Tonniges TP, O'Connor KG. Pediatricians’ reported practices regarding developmental screening: do guidelines work? Do they help? Pediatrics.2005; 116 (6):174 –179[Abstract/Free Full Text]
  20. Bethell C, Reuland CH, Halfon N, Schor EL. Measuring the quality of preventive and developmental services for young children: national estimates and patterns of clinicians’ performance. Pediatrics.2004; 113 (suppl 6):S1973 –S1983
  21. Meisels SJ, Fenichel ES, eds. New Visions for the Developmental Assessment of Infants and Young Children. Washington, DC: Zero to Three/National Center for Infants, Toddlers, and Families Publications;1996
  22. Gilliam WS, Meisels SJ, Mayes LC. Screening and surveillance in early intervention systems. In: Guralnick MJ, ed. The Developmental Systems Approach to Early Intervention. Baltimore, MD: Paul H. Brookes;2005 :73 –98
  23. Glascoe FP. Screening for developmental and behavioral problems. Ment Retard Dev Disabil Res Rev.2005; 11 (3):173 –179[CrossRef][ISI][Medline]
  24. Msall ME. Measuring functional skills in preschool children at risk for neurodevelopmental disabilities. Ment Retard Dev Disabil Res Rev.2005; 11 (3):263 –273[CrossRef][ISI][Medline]
  25. Ertem IO, Atay G, Dogan DG, et al. Mothers’ knowledge of young child development in a developing country. Child Care Health Dev.2007; 33 :728 –737[CrossRef][Medline]
  26. Li Y, Liu J, Liu F, Guo G, Anme T, Ushijima H. Maternal child-rearing behaviors and correlates in rural minority areas of Yunnan, China. J Dev Behav Pediatr.2000; 21 (2):114 –122[ISI][Medline]
  27. de Lourdes Drachler M, de Castro Aerts DG, de Souza RM, de Carvalho Leite JC, Giugliani EJ, Marshall T. Social inequalities in maternal opinion of child development in southern Brazil. Acta Paediatr.2005; 94 (8):1006 –1008[CrossRef][Medline]
  28. Kalra V, Seth R, Sapra S. Autism-experiences in a tertiary care hospital. Indian J Pediatr.2005; 72 (3):227 –230[Medline]
  29. Lian WB, Ho SK, Yeo CL, Ho LY. General practitioners’ knowledge on childhood developmental and behavioural disorders. Singapore Med J.2003; 44 (8):397 –403[Medline]
  30. Figueiras AC, Puccini RF, da Silva EM, Pedromonico MR. Evaluation of practices and knowledge among primary health care professionals in relation to child development surveillance [in Portuguese]. Cad Saude Publica.2003; 19 (6):1691 –1699[Medline]
  31. Theeranate K, Chuengchitraks S. Parent's Evaluation of Developmental Status (PEDS) detects developmental problems compared to Denver II. J Med Assoc Thai.2005; 88 (suppl 3):S188 –S192.
  32. Glascoe FP. Collaborating With Parents: Using Parents’ Evaluation of Developmental Status (PEDS) to Detect and Address Developmental and Behavioral Problems. Nashville, TN: Ellsworth & Vandermeer Press LLC;2002
  33. Sparrow SS, Balla DA, Cicchetti DV. Vineland Adaptive Behavior Scales. Circle Pines, MN: American Guidance Service;1984
  34. Bricker D, Squires J, Mounts L, Potter L, Nickel R, Farrell J. Ages & Stages Questionnaires (ASQ):A Parent-Completed, Child-Monitoring System. 2nd ed. Baltimore, MD: Paul H. Brookes;1995
  35. Ireton H, Glascoe FP. Assessing children's development using parents’ reports. The Child Development Inventory. Clin Pediatr (Phila).1995; 34 :248 –255[Abstract/Free Full Text]
  36. Ireton H. The child development review: monitoring children's development using parents’ and pediatricians’ observations. Infants Young Child.1996; 9 :42 –52[ISI]
  37. World Health Organization. Integrated Management of Childhood Illness. Counsel the Mother on Feeding, Care for Development, When to Return and the Mother's Health. Geneva, Switzerland: World Health Organization, Department of Child and Adolescent Health;2001
  38. World Health Organization. Training Course on Child Growth Assessment. Version 1, November 2006. Geneva, Switzerland: World Health Organization;2006 :60 –66
  39. Bronfenbrenner U, Ceci SJ. Nature-nurture reconceptualized in developmental perspective: a bioecological model. Psychol Rev.1994; 101 (4):568 –586[CrossRef][ISI][Medline]
  40. Sameroff AJ, Fiese BH. Transactional regulation: the developmental ecology of early intervention. In: Shonkoff JP, Meisels SJ, eds. Handbook of Early Childhood Intervention. New York, NY: Cambridge University Press;2000 :135 –160
  41. Committee on Hospital Care. American Academy of Pediatrics. Family-centered care and the pediatrician's role. Pediatrics.2003; 112 (3 Pt 1):691 –697[Abstract/Free Full Text]
  42. Green M, Palfrey J, eds. Bright Futures: Guidelines for the Health Supervision of Infants, Children, Adolescents. 2nd ed. Arlington, VA: National Center for Education in Maternal and Child Health;2000
  43. International Classification of Functioning, Disability and Health, World Health Organization. International Classification of Impairments, Disabilities, and Handicaps. Geneva, Switzerland: World Health Organization;1980
  44. Fisher RP, McCauley ML. Information retrieval: interviewing witnesses. In: Brewer N, Wilson C, eds. Psychology and Policing. Hillsdale, NJ: Erlbaum;1995 :81 –99
  45. Boyle D, Dwinnell B, Platt F. Invite, listen, and summarize: a patient-centered communication technique. Acad Med.2005; 80 (1):29 –32[CrossRef][Medline]
  46. Teutsch C. Patient-doctor communication. Med Clin North Am.2003; 87 (5):1115 –1145[CrossRef][ISI][Medline]
  47. Frankenburg WK, Dodds J, Archer P, Shapiro H, Bresnick B. The Denver II: a major revision and restandardization of the Denver Developmental Screening Test. Pediatrics.1992; 89 (1):91 –97[Abstract/Free Full Text]
  48. Glascoe FP. Technical Manual for the Brigance Screening Tests. North Billerica, MA: Curriculum Associates, Inc;1996
  49. Bayley, N. Bayley Scales of Infant Development. 2nd ed. San Antonio, TX: Psychological Corporation;1993
  50. de Onis M, Onyango AW, Borghi E, Garza C, Yang H. World Health Organization Multicentre Growth Reference Study Group. Comparison of the World Health Organization (WHO) Child Growth Standards and the National Center for Health Statistics/WHO international growth reference: implications for child health programmes. Public Health Nutr.2006; 9 (7):942 –947[CrossRef][ISI][Medline]
  51. Wijnhoven TM, de Onis M, Onyango AW, et al. Assessment of gross motor development in the WHO Multicentre Growth Reference Study. Food Nutr Bull.2004; 25 (suppl 1):S37 –S45[Medline]
  52. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess.1994; 6 :284 –290[CrossRef]
  53. Cicchetti DV. The precision of reliability and validity estimates re-visited: distinguishing between clinical and statistical signification of sample size requirements. J Clin Exp Neuropsychol.2001; 23 (5):695 –700[Medline]
  54. SPSS for Windows [computer program]. Version 11.0. 1. Chicago, IL: SPSS, Inc;2001
  55. Thorburn M, Desai P, Paul TJ, Malcolm L, Durkin M, Davidson L. Identification of childhood disability in Jamaica: the ten questions screen. Int J Rehabil Res.1992; 15 (2):115 –127[Medline]
  56. Durkin MS, Hasan ZM, Hasan KZ. The ten questions screen for childhood disabilities: its uses and limitations in Pakistan. J Epidemiol Community Health.1995; 49 (4):431 –436[Abstract]
  57. Mung'ala-Odera V, Meehan R, Njuguna P, et al. Validity and reliability of the ‘Ten Questions’ questionnaire for detecting moderate to severe neurological impairment in children aged 6–9 years in rural Kenya. Neuroepidemiology.2004; 23 (1–2):67 –72[CrossRef][ISI][Medline]
  58. Wirz S, Edwards K, Flower J, Yousafzai A. Field testing of the ACCESS materials: a portfolio of materials to assist health workers to identify children with disabilities and offer simple advice to mothers. Int J Rehabil Res.2005; 28 (4):293 –302[CrossRef][Medline]
  59. Chopra G, Verma IC, Seetharaman P. Development and assessment of a screening test for detecting childhood disabilities. Indian J Pediatr.1999; 66 (3):331 –335[Medline]
  60. Glascoe FP, Byrne KE, Ashford LG, Johnson KL, Chang B, Strickland B. Accuracy of the Denver-II in developmental screening. Pediatrics.1992; 89 (6 pt 2):1221 –1225[Abstract/Free Full Text]
  61. United Nations Children's Fund. State of the World's Children. New York, NY: UNICEF Publications;2007
  62. Lejarraga H, Pascucci MC, Krupitzky S, et al. Psychomotor development in Argentinean children aged 0–5 years. Paediatr Perinat Epidemiol.2002; 16 (1):47 –60[CrossRef][Medline]
  63. Lansdown RG, Goldstein H, Shah PM, et al. Culturally appropriate measures for monitoring child development at family and community level: a WHO collaborative study. Bull World Health Organ.1996; 74 (3):283 –290[Medline]

PEDIATRICS (ISSN 1098-4275). ©2008 by the American Academy of Pediatrics




This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow P3Rs: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when P3Rs are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via CrossRef
Google Scholar
Right arrow Articles by Ertem, I. O.
Right arrow Articles by Cicchetti, D. V.
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ertem, I. O.
Right arrow Articles by Cicchetti, D. V.
Related Collections
Right arrow Developmental/Behavior