pediatrics
January 2014, VOLUME133 /ISSUE 1

Association Between Pediatric Clinical Trials and Global Burden of Disease

  1. Florence T. Bourgeois, MD, MPHa,b,
  2. Karen L. Olson, PhDa,b,c,
  3. John P.A. Ioannidis, MD, DScd,e, and
  4. Kenneth D. Mandl, MD, MPHa,b,c,f
  1. aDivision of Emergency Medicine and
  2. cChildren’s Hospital Informatics Program at the Harvard-MIT Division of Health Sciences and Technology, Boston Children's Hospital, Boston, Massachusetts;
  3. bDepartment of Pediatrics and
  4. fCenter for Biomedical Informatics, Harvard Medical School, Boston, Massachusetts; and
  5. dStanford Prevention Research Center, Department of Medicine, and
  6. eDepartment of Health Research and Policy, Stanford University School of Medicine, Stanford, California

Abstract

BACKGROUND: The allocation of research resources should favor conditions responsible for the greatest disease burden. This is particularly important in pediatric populations, which have been underrepresented in clinical research. Our aim was to measure the association between the focus of pediatric clinical trials and burden of disease and to identify neglected clinical domains.

METHODS: We performed a cross-sectional study of clinical trials by using trial records in ClinicalTrials.gov. All trials started in 2006 or after and studying patient-level interventions in pediatric populations were included. Age-specific measures of disease burden were obtained for 21 separate conditions for high-, middle-, and low-income countries. We measured the correlation between number of pediatric clinical trials and disease burden for each condition.

RESULTS: Neuropsychiatric conditions and infectious diseases were the most studied conditions globally in terms of number of trials (874 and 847 trials, respectively), while intentional injuries (5 trials) and maternal conditions (4 trials) were the least studied. Clinical trials were only moderately correlated with global disease burden (r = 0.58, P = .006). Correlations were also moderate within each of the country income levels, but lowest in low-income countries (r = .47, P = .03). Globally, the conditions most understudied relative to disease burden were injuries (–260 trials for unintentional injuries and –160 trials for intentional injuries), nutritional deficiencies (–175 trials), and respiratory infections (–171 trials).

CONCLUSIONS: Pediatric clinical trial activity is only moderately associated with pediatric burden of disease, and least associated in low-income countries. The mismatch between clinical trials and disease burden identifies key clinical areas for focus and investment.

  • clinical trials
  • burden of disease
  • pediatric research
  • Abbreviations:
    DALY
    disability-adjusted life-year
    RCT
    randomized controlled trial
    WHO
    World Health Organization
  • What’s Known on This Subject:

    Fewer clinical trials are performed in children compared with other patient populations. It is unknown how well existing pediatric clinical trials are aligned with the needs of children, both in high-income countries and globally.

    What This Study Adds:

    There is only moderate correlation between clinical trial activity and pediatric burden of disease, with certain conditions substantially underrepresented in the current research portfolio. Our findings provide a benchmark for prioritizing conditions for study, analyzing gaps, and identifying funding priorities.

    Children are underrepresented as participants in clinical research.13 The inequity is manifest in the overall number of clinical trials performed in children as well as the number of randomized trials, drug trials, and publications that focus on pediatric populations.1,4,5 In reducing these disparities, research organizations and policy makers have the opportunity to prioritize investment in trials to address areas of greatest clinical burden. Previous work has shown that funding from the National Institutes of Health for all patient populations in the United States is only modestly correlated with the burden of disease.6,7 However, it is unknown how well existing pediatric clinical trials are aligned with the needs of children, both in high-income countries and globally. Clinical trials have been previously used as a proxy of clinical research activity in comparisons of research and disease burden.1,8,9 We sought to conduct the first study measuring the correspondence between pediatric clinical research and disease burden. Because of the variable impact of diseases across economic conditions, we examine the association between pediatric research and disease burden separately for more and less developed nations.

    Methods

    Study Design

    We performed a cross-sectional study of the relationship between the number of pediatric clinical trials and the burden of disease among children. The conditions examined were the 21 primary conditions in the World Health Organization (WHO) global burden of disease taxonomy with additional analyses focusing on the 15 subcategories of infectious and parasitic diseases.10

    Pediatric Clinical Trial Activity

    Pediatric clinical research activity was measured by using the National Library of Medicine’s trials registry ClinicalTrials.gov. The ClinicalTrials.gov registry is the largest of the available trial registries, containing as many as 86% of all registrations.11,12 Since the International Committee of Medical Journal Editors instituted a policy in 2005 requiring prospective registration of all trials as a prerequisite for publication, registration of clinical trials has become standard practice.13,14 We identified all interventional trials with a start date on or after January 1, 2006, and registered by May 2, 2012. Pediatric trials were defined as those enrolling only or primarily participants <18 years of age (midpoint of the age range for enrolled participants was <18 years).1 Trials that were terminated or withdrawn were excluded (n = 279). Trials that focused on interventions targeting improvements in health care delivery at the provider or health care facility level were excluded (eg, interventions to enhance the use of computerized order entry by clinicians; n = 32).

    All trials were individually reviewed to identify the medical condition under study, which was then mapped to 1 of the 21 WHO conditions. Trials studying conditions not represented in the WHO taxonomy (eg, food allergies) or interventions pertaining to multiple conditions (eg, antibiotic prophylaxis for immunocompromised patients) were classified separately.

    Because some trials may have been registered in national or regional registries and not included in the ClincialTrials.gov registry, we also queried the International Trial Research Platform to assess the completeness of the data collected using the ClinicalTrials.gov registry.15 This platform combines data from 14 primary registries in addition to ClinicalTrials.gov. We selected discreet diseases among conditions with the highest global pediatric disease burden that could readily be identified with a text word search and identified all trials pertaining to these diseases in the registry platform. The diseases examined were malaria, prematurity, unipolar depression, iron-deficiency anemia, and congenital heart disease, representing 528 (10%) of all trials in our study sample (63% from high-income, 13% from middle-income, and 24% from low-income countries). We identified 89 pediatric trials not included in ClinicalTrials.gov and not analyzed in this study (61% from high-income, 12% from middle-income, and 27% from low-income countries), which suggests that overall, ∼83% of pediatric trials are recorded in ClinicalTrials.gov (84% of high-income, 84% of middle-income, and 81% of low-income trials).

    Pediatric Global Burden of Disease

    Data on global disease burden were obtained from the most recent Global Burden of Disease study conducted by the WHO.10 This study quantifies the health effects of diseases and injuries by age, gender, and country using national data and information collected through global health programs. Estimates include disability-adjusted life-years (DALYs), which is a composite measure that accounts for both years of life lost due to premature death and years lived in states of less than full health as a result of a disease or injury.16 Disease burden data are available for each of the 21 WHO disease and injury categories comprising the global burden of disease taxonomy. Estimates are also presented by country income level, with countries grouped as high-, middle-, or low-income based on their gross national product in 2004.

    Data on burden of disease estimates are presented in predefined age categories and we combined DALYs for persons aged 0 to 4 years, 5 to 14 years, and three-fifths of 15 to 19 years to approximate DALYs for persons 0 to 17 years.

    Trial Data Extraction and Classifications

    For every trial, we extracted whether the trial was randomized, the unit of randomization (participant or cluster), number of participants enrolled (or estimated number for ongoing trials), type of intervention (eg, drug, behavioral, or procedural), names of countries with study sites, and number of participating countries and study sites.

    Trials were classified as conducted primarily in high-, middle-, or low-income countries based on the income level of the countries representing the largest proportion of study sites. Countries were assigned to income levels according to the WHO categorization, which is based on a country’s gross national income per capita.10 The high-income level includes a total of 53 countries (income per capita of US$10 066 or more), the middle-income level 93 countries (income per capita of US$826 to $10 065), and the low-income level 59 countries (income per capita of US$825 or less). If a trial had equal proportions of sites in ≥2 income groups, the trial was assigned to the higher-income level (n = 21).

    Data Analysis

    Descriptive analyses characterized distribution of clinical research activity and global burden of disease across the 3 country income groups. Research activity was assessed in terms of the number of clinical trials and the number of participants represented in each of the 21 WHO conditions. Clinical trials were examined in terms of total number of trials, randomized controlled trials (RCTs), and randomized drug trials. All results and analyses pertaining to the number of participants were based on randomized trials that did not use cluster randomization. For low-income countries, where infectious diseases account for half the total disease burden, we analyzed separately the association between clinical trials and the burden attributable to the 16 specific diseases comprising this group. Student’s t test was used to compare mean number of study sites and participants across income groups.

    Correlations between clinical trials and burden of disease were evaluated at a global level and for each of the income categories using Spearman’s rho test. To estimate the expected number of trials, we performed generalized γ regression analysis with a log link from a log transformation of disease burden. SAS software, version 9.3 (SAS Institute, Inc, Cary, NC) was used for all statistical analyses.

    Results

    Trial Characteristics

    We identified 5373 pediatric clinical trials studying a medical condition. Of these, 3771 were RCTs and 1526 of the RCTs studied a drug intervention. A total of 1 466 689 children were studied in noncluster RCTs. Most trials were conducted in countries exclusively within 1 of the 3 income categories. Only 366 trials included study sites from multiple income levels, with 296 trials (5.5%) recruiting in high- and middle-income countries, 49 trials (0.9%) conducted in high- and low-income countries, and 65 trials (1.2%) in middle- and low-income countries. Trials conducted primarily in high-income countries tended to include a higher mean number of study sites (8 in high-income countries vs 4 in middle- and 2 in low-income countries, P < .001 for both comparisons) but trials recruiting primarily in low-income countries recruited on average a higher number of participants (1138 in low-income countries vs 315 in high- and 466 in middle-income countries, P < .001 for both comparisons).

    Pediatric Clinical Trial Activity and Disease Burden

    The distribution of clinical trial activity and burden of disease across countries in the 3 income levels is presented in Table 1. High-income countries are the primary sites of participant recruitment for 79% of all pediatric-focused clinical trials with low-income countries represented primarily in 7% of trials. By contrast, only a fraction of the total disease burden is borne by high-income countries (2%) with low-income countries sustaining the majority of disease burden (73%). This discrepancy between research activity and disease burden is similar when examining clinical trials limited to RCTs, drug RCTs, and participants.

    TABLE 1

    Number of Pediatric Trials and Participants and Pediatric Burden of Disease by Country Income Level

    Correlation Between Clinical Trials and Disease Burden

    Clinical trials and disease burden according to condition are shown in Table 2. Neuropsychiatric conditions represent the condition that is most studied globally in terms of number of trials (874 trials and 103 134 randomized participants) and nonrespiratory infections and parasitic diseases are the most common condition in terms of numbers of participants (847 trials and 636 471 randomized participants), followed by conditions arising in the perinatal period (523 trials and 179 933 randomized participants). Maternal conditions (4 trials and 324 randomized participants), intentional injuries (5 trials and 5479 randomized participants), and nonmalignant neoplasms (9 trials and 42 randomized participants) are the least studied conditions. The 4 trials studying maternal conditions were conducted in the United States on management of adolescent postpartum depression, pregnancy prevention among adolescents, and the integration of a program to reduce sexually transmitted diseases with prenatal care among adolescents.

    TABLE 2

    Number of Pediatric Trials and Participants and Pediatric Global Burden of Disease According to Condition

    Clinical trials were only moderately correlated with global disease burden overall (r = 0.58, P = .006; Table 3). RCTs in particular were slightly more correlated (r = 0.64, P = .002) as were total number of randomized participants (r = 0.66, P = .001), whereas randomized drug trials were slightly less correlated (r = 0.47, P = .03). Correlations were also moderate within each of the 3 country income levels. Low-income countries had the lowest correlation overall (r = 0.47, P = .03) as well as based on RCTs (r = 0.47, P = .03) and randomized participants (r = 0.46, P = .04), with slightly higher values when considering randomized drug trials (r = 0.58, P = .006).

    TABLE 3

    Correlation Between Number of Trials and Participants and Disease Burden Across Conditions

    Infectious and parasitic diseases in particular were examined in greater detail in low-income countries and demonstrated good correlation between clinical research activity and disease burden. Correlations were high for clinical trials overall (r = 0.92, P < .001) as well as for RCTs (r = 0.94, P < .001), drug RCTs (r = 0.82, P < .001), and randomized participants (0.92, P < .001).

    Expected Number of Trials

    To further assess the proportionality between clinical trials and disease burden, we examined the actual and predicted number of trials as a function of burden of disease in DALYs (Figs 1 and 2 A–C, Supplemental Fig 3 A–D). The differences between expected and actual number of trials demonstrate that a number of conditions were substantially under- or overrepresented in clinical trials in countries in each of the income levels. Globally, the conditions most understudied relative to disease burden were injuries (–260 trials for unintentional injuries and –160 trials for intentional injuries), nutritional deficiencies (–175 trials), and respiratory infections (–171 trials). Conversely, neuropsychiatric conditions (+524 trials), malignant neoplasms (+340 trials), and nonrespiratory infections (+262 trials) represented the most overstudied conditions. For each of the country income levels, we identified a different set of conditions that was neglected or overstudied in relation to burden of disease.

    FIGURE 1

    Differences between actual and expected pediatric clinical trials based on global burden of disease. For each condition, we show the difference between actual and expected number of trials based on the disease burden, with negative numbers indicating a deficit in trials and positive numbers excess trials. Generalized γ regression was used to calculate expected values.

    FIGURE 2

    A, Differences between actual and expected pediatric clinical trials based on burden of disease in high-income countries. B, Differences between actual and expected pediatric clinical trials based on burden of disease in middle-income countries. C, Differences between actual and expected pediatric clinical trials based on burden of disease in low-income countries.

    Discussion

    There is substantial room for improvement in the match between allocation of clinical research resources and the worldwide impact of conditions. The correlation between pediatric clinical research activity and disease burden across conditions is only moderate among countries in all income levels, and least associated in low-income countries, where clinical research is sparse in general. High burden conditions are substantially understudied in countries in each of the income groups, including injuries, congenital anomalies, nutritional deficiencies, and respiratory infections. Clinical research in pediatric populations is unevenly distributed among countries at different income levels, with the majority of research conducted in high-income countries despite low-income countries accounting for the bulk of the global disease burden.

    Previous studies have shown that the correlation between disease burden and research evidence as expressed by randomized trials or systematic reviews is low in sub-Saharan Africa and globally, respectively, whereas there is a better correlation with disease burden in countries with established market economies.8,17 Research agendas may be driven primarily by the needs of and diseases afflicting wealthy nations. However, in the United States, a mismatch between National Institutes of Health funding and burden of disease has persisted despite 1998 Institute of Medicine recommendations to improve funding priorities.6,7

    Many of the diseases in less developed countries have a substantial prevalence in more developed countries where they are well studied, raising the question of whether the best strategy would be to apply evidence derived from trials conducted in more developed nations to populations in less developed countries and vice versa.18 The determinants of disease as well as the contexts for prevention and treatment are sometimes similar, but other times they can be vastly different in low- and middle-income countries, limiting the adoption of recommendations developed in high-income settings.19,20 As an example, the ministry of health in Ghana recently considered adding several pediatric medications to its national drug program based on recommendations from the WHO Essential Medicines Program.21 In the process, they reviewed the evidence supporting their use and found that even when there was high-quality evidence on the benefits of the drugs, few trials had been conducted in Africa, and little of the existing evidence could be extended to Ghana due to differences in practice standards, issues of feasibility, and resource implications. Organophosphate and other pesticide exposures provide another example of the imperative to consider local context for therapeutic options. These poisonings occur at particularly high rates in low-income nations, and their treatment is fraught with challenges around access to health care not encountered in high-income countries, necessitating entirely different treatment approaches.22

    Noncommunicable diseases such as asthma, diabetes, depression, and cancers, are now the greatest contributors to death and disability worldwide and yet have been particularly neglected compared with infectious diseases in low- and middle-income countries.10,19,23 Our results highlight this disparity, showing much higher correlation between clinical trials and disease burden for infectious diseases than other conditions. Increasing clinical research activity around infectious conditions in less developed nations may not only benefit local populations but also shed light on prevention and treatment strategies in more developed countries where many important infectious diseases are rare.19,24 This would require building a strong, unbiased research agenda in less developed nations because there is currently evidence that in some cases, trials performed in these countries are subject to several biases, including selective reporting bias, because it is even more difficult to publish a negative result when the trial comes from a less developed country.18

    For countries in each of the income groups, we identified a different set of conditions that require greater focus based on the distribution of pediatric disease burden. Other factors, such as the absolute number of trials addressing a condition, may also be relevant. Only 4 trials addressed pregnancy prevention and management among adolescents even though birth control, psychosocial needs, and the prevention of sexually transmitted diseases are entirely different in this patient population than in older women. Similarly, intentional injuries, which include self-inflicted injuries and child maltreatment, are studied in only 5 trials despite the unique circumstances that must be considered in the prevention and management of these injuries. Additional factors may also be important in evaluating research investments and funding decisions, including indirect benefits of certain types of research, political and social priorities, research quality, and potential for knowledge implementation.25

    A better understanding of which conditions are insufficiently addressed in the current research portfolio may provide guidance to organizations on how to allocate and prioritize available resources. Certain conditions, such as unintentional and intentional injuries, may be difficult to address in trials. These injuries result from road traffic accidents, drowning, poisoning, and fires. However, trials can address the prevention of these events as well as the medical management of the resulting injuries. Furthermore, heightened awareness of the limitations of medical research in certain areas may foster greater emphasis on other approaches, including national and global policies on road traffic safety interventions and legislation mandating universal child-resistant medication packaging.26

    There are several limitations to our study. Some trials are not registered in ClinicalTrials.gov, and other registries may be used differentially according to country income group. However, our query of trials in the International Trial Research Platform revealed that ∼83% of pediatric trials are registered in ClinicalTrials.gov, and the proportion of trials missing in each income group mirrors the distribution among the trials studied. It is also possible that our system for classifying trials into country income categories underestimated the amount of research being conducted in low-income countries. To explore this possibility, we conducted an additional analysis in which trials were assigned to the low-income country group if any study site was in the low-income category. This contributed an additional 53 trials to the low-income group but did not substantially change the correlations between clinical trials and disease burden (r = 0.51 for correlation with all trials and with RCTs, and r = 0.56 for correlation with drug RCTs). We used DALYs as the measure of disease burden, which have been previously used to assess associations between research activity and disease burden, but it is possible that other approaches may have highlighted different conditions as over- or understudied.6,7,17 Finally, limitations inherent to the use of the trial registry include missing data and that we were unable to verify the completeness and accuracy of the information provided by investigators.

    Conclusions

    A greater number of children could derive benefit from clinical trials if the pediatric research agenda were more closely aligned with the disease burden in children, beginning with a greater focus on conditions that appear to be underrepresented in current clinical trials. Noncommunicable diseases and injuries in low-income countries, in particular, require additional prioritization. The use of ongoing and consistent accounting of the association between pediatric clinical research activity and disease burden could help optimize the rationale and efficient allocation of resources for pediatric clinical trials.

    Acknowledgment

    We thank Jeong Kim for her help with queries and data extraction from the International Trial Research Platform.

    Footnotes

      • Accepted October 19, 2013.
    • Address correspondence to Florence T. Bourgeois, MD, MPH, Division of Emergency Medicine, Boston Children’s Hospital, 300 Longwood Ave, Boston, MA 02115. E-mail: florence.bourgeois{at}childrens.harvard.edu
    • Dr Bourgeois contributed to study conception and design, data acquisition, analysis and interpretation of data, and revision of the article; Dr Olson contributed to analysis and interpretation of data and revision of the article; Drs Ioannidis and Mandl contributed to study conception and design, interpretation of data, and revision of the article; and all authors gave final approval.

    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: Supported by a grant from the National Institute of Child Health and Human Development (1R21HD072382), National Institutes of Health. Funded by the National Institutes of Health (NIH).

    • POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

    References