Skip to main content

Advertising Disclaimer »

Main menu

  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers
  • Other Publications
    • American Academy of Pediatrics

User menu

  • Log in
  • My Cart

Search

  • Advanced search
American Academy of Pediatrics

AAP Gateway

Advanced Search

AAP Logo

  • Log in
  • My Cart
  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers

Discover Pediatric Collections on COVID-19 and Racism and Its Effects on Pediatric Health

American Academy of Pediatrics
Article

Pharmacologic Treatment of Repetitive Behaviors in Autism Spectrum Disorders: Evidence of Publication Bias

Melisa Carrasco, Fred R. Volkmar and Michael H. Bloch
Pediatrics May 2012, 129 (5) e1301-e1310; DOI: https://doi.org/10.1542/peds.2011-3285
Melisa Carrasco
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fred R. Volkmar
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael H. Bloch
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • Comments
Loading
Download PDF

Abstract

OBJECTIVE: The goal of this study was to examine the efficacy of serotonin receptor inhibitors (SRIs) for the treatment of repetitive behaviors in autism spectrum disorders (ASD).

METHODS: Two reviewers searched PubMed and Clinicaltrials.gov for randomized, double-blind, placebo-controlled trials evaluating the efficacy of SRIs for repetitive behaviors in ASD. Our primary outcome was mean improvement in ratings scales of repetitive behavior. Publication bias was assessed by using a funnel plot, the Egger’s test, and a meta-regression of sample size and effect size.

RESULTS: Our search identified 5 published and 5 unpublished but completed trials eligible for meta-analysis. Meta-analysis of 5 published and 1 unpublished trial (which provided data) demonstrated a small but significant effect of SRI for the treatment of repetitive behaviors in ASD (standardized mean difference: 0.22 [95% confidence interval: 0.07–0.37], z score = 2.87, P < .005). There was significant evidence of publication bias in all analyses. When Duval and Tweedie's trim and fill method was used to adjust for the effect of publication bias, there was no longer a significant benefit of SRI for the treatment of repetitive behaviors in ASD (standardized mean difference: 0.12 [95% confidence interval: –0.02 to 0.27]). Secondary analyses demonstrated no significant effect of type of medication, patient age, method of analysis, trial design, or trial duration on reported SRI efficacy.

CONCLUSIONS: Meta-analysis of the published literature suggests a small but significant effect of SRI in the treatment of repetitive behaviors in ASD. This effect may be attributable to selective publication of trial results. Without timely, transparent, and complete disclosure of trial results, it remains difficult to determine the efficacy of available medications.

KEY WORDS
  • antidepressive agents
  • autism
  • meta-analysis
  • pervasive child development disorders
  • publication bias
  • Abbreviations:
    ASD —
    autism spectrum disorders
    CI —
    confidence interval
    OCD —
    obsessive-compulsive disorder
    RRB —
    restricted and repetitive behavior
    SMD —
    standardized mean difference
    SRI —
    serotonin receptor inhibitor
    SSRI —
    selective serotonin reuptake inhibitor
  • What's Known on This Subject:

    Although several randomized trials have examined the efficacy of serotonin receptor inhibitors in the treatment of repetitive behaviors, there still remains clinical uncertainty as to whether these agents are effective in treating such behaviors in children and adults with autism spectrum disorders.

    What This Study Adds:

    The goal of this meta-analysis was to examine randomized trials of serotonin receptor inhibitors for treating repetitive behaviors in autism spectrum disorders. Although a small but significant effect of these agents was observed, this effect is likely due to the selective publication of trial results.

    As many as 1 in 100 children are diagnosed with an autism spectrum disorder (ASD),1 and recent epidemiologic findings suggest that autism is 3 times more prevalent than previously thought.2–4 Autism is characterized by disturbances in social function and communication, and the presence of repetitive behaviors.5 Restricted and repetitive behaviors (RRBs) include stereotyped motor mannerisms, restricted patterns of interest, atypical sensory interests, and the insistence for things to remain exactly the same.6 Repetitive sensorimotor behaviors tend to be present over the years and rarely disappear altogether; meanwhile, behaviors associated with the “insistence on sameness” seem to worsen with age.7 Repetitive behaviors can cause significant difficulties for the individual with autism at school, and they may interfere with the ability to learn and partake in daily activities.8 In addition, these symptoms produce stress among caregivers.9

    Repetitive behaviors in autism share some overlap with characteristic symptoms of obsessive-compulsive disorder (OCD).10 When compared on a series of repetitive behaviors, children with ASD engage in similar levels of “sameness” behaviors and repetitive movements as children with OCD, as reported by their parents.11 Patients with ASD and OCD share, to varying degrees, a number of features, including compulsive behavior that is often focused around routines and rituals. In ASD, there is a higher prevalence of “compulsive-like behaviors,” including hoarding, touching, tapping or rubbing rituals, and self-damaging or self-mutilating behaviors.12–14 Interestingly, relatives of individuals with autism are more likely to have OCD, or to display obsessive-compulsive behaviors, compared with the rest of the population, thus suggesting familiality in both disorders.15,16 Current evidence suggests an overlap in affected neural and monoamine systems that may bring about repetitive behavior in both OCD and ASD, including an affected SLC6A/serotonin system and the presence of cortico-striatal-thalamic circuitry dysfunction in both disorders.17 Given the similarities between some of the repetitive behaviors of ASD and OCD,18 many have speculated whether overlapping symptoms will respond to the same medications, including selective serotonin reuptake inhibitor (SSRIs).19

    SSRIs displayed greater efficacy in the treatment of OCD compared with placebos in 17 separate placebo-controlled trials.20 Meta-analysis demonstrated that patients with OCD were nearly twice as likely to respond to treatment with serotonin receptor inhibitor (SRI) pharmacotherapy than to placebo. For SSRIs, the number needed to treat (ie, the required number of patients who must be treated with an SSRI for 1 to respond who would not have responded with placebo21) was estimated at 5 (95% confidence interval [CI]: 4–8).20 Furthermore, meta-analysis results suggest that higher doses of SSRIs are more effective than low doses in treating adults with OCD, perhaps signifying that many of these trials may have underestimated treatment effects.22 Meta-analysis also suggests that SSRIs may be equally effective in treating children with OCD as adults.23

    Several randomized trials have examined the efficacy of SRIs in the treatment of repetitive behaviors in children with ASD. However, clinical uncertainty remains as to whether SRIs are effective in treating repetitive behavior in children and adults with ASD.24 Several large-scale studies have reported the use of SRIs among a substantial minority of children with ASD.25–27 The goal of this meta-analysis was to examine the randomized, placebo-controlled trials of SRIs in ASD to determine the efficacy of these medications in treating repetitive behaviors. We examined possible moderators of SRI efficacy in the ASD population by means of stratified analyses and meta-regression. We sought to examine whether dose or type of SRI medication, age of ASD population, or measure of repetitive behaviors affected measures of SRI efficacy. Finally, we explored a number of indicators of publication bias as part of our standard procedure for pursuing a meta-analysis.

    Methods

    Search Strategy for Identification of Studies

    Two reviewers searched PubMed for all relevant clinical trials. The PubMed search was conducted by using the search strategy (“Serotonin Uptake Inhibitors”[MeSH] OR “Antidepressive Agents”[MeSH]) AND “Child Development Disorders, Pervasive”[MeSH]). PubMed filters were activated to further limit the search to meta-analyses or randomized controlled trials. In addition, ClinicalTrials.gov was searched for completed, unpublished trials of relevance to this analysis. The ClincialTrials.gov search was conducted by using a targeted search of the term “autism” and limited to completed trials. There were no language limitations on these searches.

    Study Selection

    Two reviewers evaluated all articles obtained by using this search strategy to determine if the articles were potentially eligible for inclusion in this meta-analysis. Studies were included if they met the following inclusion criteria: (1) randomized, double-blind, placebo-controlled trials comparing an SRI medication (fluoxetine, citalopram, fluvoxamine, sertraline, escitalopram, paroxetine, or clomipramine) with placebo; (2) duration of medication use lasted at least 4 weeks; (3) the trial measured the effect of medication on repetitive behaviors and obsession and compulsion severity; and (4) participants had a diagnosis of a pervasive developmental disorder (autism, Asperger’s syndrome, pervasive developmental disorder not otherwise specified, or Rett syndrome). Trials were considered randomized when investigators explicitly stated them to be so in the methods section of their publication. Trials in which other psychoactive substances were required to be taken in parallel with the targeted medication were also excluded.

    Outcome Measures

    Our primary outcome measures were mean improvement in repetitive behavior (including obsessions and compulsions), as captured by using rating scales. Acceptable clinical measures, in order of preference, included the Children's Yale-Brown Obsessive-Compulsive Scale modified for pervasive developmental disorders,28 the Yale-Brown Obsessive-Compulsive Scale29 or the Children’s Yale-Brown Obsessive-Compulsive Scale30 (based on subject age), and additional measures assessing repetitive behaviors, including the Aberrant Behavior Checklist (stereotypic behavior dimension).31 A hierarchy of selected RRB and/or obsessive-compulsive rating scales for testing outcome measures was determined a priori to avoid any treatment effect inflation (which would have otherwise occurred by selecting studies for inclusion in the meta-analysis whose measures provided evidence for the greatest treatment effect).

    Meta-Analytic Procedure

    Excel spreadsheets were used to extract data from included articles. Data extracted included type of medication, average and maximum dose of medication, duration of trial, age range and average age in trials, method of analysis (intention-to-treat versus completers), sample size, and adverse effect frequency. In addition, ratings of trial quality were determined by using the scale developed by Jadad et al32 (a measure on the appropriateness of each study’s randomization and double-blinding procedure, and also the degree to which patient withdrawals and dropouts were reported in the study). Missing information was requested from study investigators. Information from completed, unpublished trials of relevance was also requested from the study investigators, as listed in ClinicalTrials.gov.

    We examined the difference between treatment and placebo for the desired outcome by calculating the standardized mean difference by using Comprehensive Meta-Analysis, a comprehensive software program for the analysis and display of meta-analytic data (http://www.meta-analysis.com/). The use of the standardized mean difference as a measure was favored over weighted mean difference because rating scales differed between the included studies.

    Publication bias was first explored by plotting the effect size against SE for each trial (funnel plot). Larger studies with greater sample sizes are more precise; they therefore tend to be plotted toward the top of the funnel plot (ie, they have a lower SE) and cluster near the mean effect size. Meanwhile, smaller studies (with higher SEs) appear toward the bottom of the graph and do not cluster around the mean effect size, given that that their results are more widely variable. In the presence of publication bias, missing unfavorable or nonsignificant trials with smaller effects will contribute to the asymmetry of the funnel plot by failing to evenly distribute about the mean effect size, thus producing an asymmetric plot; meanwhile, in the absence of publication bias, studies included in the meta-analysis will be symmetrically scattered about the mean effect size, given the randomness of the sampling error.33 A fixed (as opposed to random) effects model was used for the meta-analysis because there was considerable evidence of publication bias in the literature.

    In addition, publication bias was statistically tested by using the Egger test (a linear regression method that specifies the level of asymmetry evidenced in a funnel plot)34 and by determining the association between adjusted sample size and effect size in meta-regression. Adjusted sample size was calculated by adding together the sample size from parallel-group trials and the sample size (multiplied by 2) from crossover trials (given that, in crossover trials, the same subjects received both the placebo and the SRI under study in sequence, and thus were included in the calculation of the adjusted sample size twice). For the analyses of publication bias, the one unpublished trial with data we were able to obtain was excluded.35

    Heterogeneity of treatment response was determined by means of 2 separate statistical estimates using Comprehensive Meta-Analysis. First, a Q statistic was used to provide a test of statistical significance indicating whether the differences in effect sizes are due to subject-level sampling error alone or other sources. In addition, we estimated heterogeneity by using the I2 statistic, which estimates the proportion of between-studies variance.

    For secondary analyses, several subgroup analyses and meta-regression were performed. Stratified subgroup analysis in Comprehensive Meta-Analysis was used to assess the effects of the following: (1) the SRI agent used; (2) the type of trial (crossover versus parallel group); and (3) the method of analysis (completers versus intention-to-treat). We used the test for subgroup differences in Comprehensive Meta-Analysis to determine whether subgroups reduced overall heterogeneity.36 We initially intended to also examine the effects of age group (child versus adult) and rating scale used on measured SRI efficacy. However, there were not enough trials in several of the subgroups to conduct these analyses.

    Meta-regression was performed in Comprehensive Meta-Analysis. To examine the association between SRI efficacy and continuous variables such as dose of SRI (in clomipramine equivalents), trial duration, trial methodologic quality (as measured by using the Jadad scale), and adjusted sample size, we used a meta-regression technique. For meta-regression, the standardized mean difference (SMD) in repetitive behaviors improvement with SRI treatment was the dependent variable, and our variable of interest was the independent variable. Studies were weighted by using the generic inverse variance method, a meta-analytic procedure that makes use of treatment outcome estimates and their SE for the purpose of calculating an overall estimate of effect (eg, whether SRIs are effective for the treatment of RRBs in ASD). Our P value of significance threshold was selected to be <.05 for the primary analysis, as well as for all subgroup analyses and meta-regression. Any significant findings should be regarded as exploratory because we did not adjust for inflation of false-positive error from our 6 secondary analyses.

    Results

    Included Studies

    Our initial PubMed and Clinicaltrials.gov search identified 15 studies that were potentially eligible for inclusion in this meta-analysis. Four of the studies found by means of this original search were excluded, including 1 meta-analysis, 2 nonrandomized controlled trials, and 1 randomized controlled trial of fluvoxamine for autism that was a duplicate of a similar study published in Japanese.37–40 An additional study initially considered to be eligible for meta-analysis was also dropped given that it did not provide quantitative information on baseline and outcome measures of repetitive behavior, thus making it impossible to assess improvement within this behavioral domain.41 The Clinicaltrials.gov search also identified 5 completed and unpublished studies that were potentially eligible for inclusion in this meta-analysis.35,42–45 We sent requests to the principal investigators by e-mail for data associated with each of these trials. We received trial data in response to our requests for only 1 trial.35 The available information for these unavailable, unpublished trials is presented along with the demographic characteristics for included trials in Table 1. Figure 1 depicts our selection strategy for inclusion of trials.

    View this table:
    • View inline
    • View popup
    TABLE 1

    Characteristics of Included Studies

    FIGURE 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 1

    Flowchart depicting study selection. Two reviewers evaluated all articles obtained by using this search strategy to determine if they were potentially eligible for inclusion in this meta-analysis. Studies were included in this review if they met the following inclusion criteria: (1) randomized, double-blind, placebo-controlled trials comparing an SRI medication (fluoxetine, citalopram, fluvoxamine, sertraline, escitalopram, paroxetine, or clomipramine) with placebo; (2) duration of medication use lasted at least 4 weeks; (3) the trial measured the effect of medication on repetitive behaviors and obsession and compulsion severity; and (4) participants had a diagnosis of a pervasive developmental disorder (autism, Asperger’s syndrome, pervasive developmental disorder not otherwise specified, or Rett syndrome).

    Six eligible trials were identified for inclusion in this meta-analysis. Table 1 presents the characteristics of the 5 published trials46–50 and the 1 unpublished trial included in this meta-analysis.35 Three of these 5 published trials reported a statistically significant benefit of SRI treatment in ASD.46–47,49 Two published trials and the 1 available unpublished trial reported some or no benefit of antidepressant treatment.35,48,50

    Efficacy of SRI Treatment of Autism

    Overall, meta-analysis of 6 trials involving 365 participants demonstrated a small effect of SRIs for the treatment of repetitive behaviors, including obsessions and compulsions, in autism (SMD: 0.22 [95% CI: 0.07–0.37], z score = 2.87, P < .005). Figure 2 provides a Forest plot depicting the benefit of SRI use in the treatment of autism. There was evidence of significant heterogeneity (heterogeneity Q value: 15.95; df = 5 [P = .007], I2 = 69%). When the 1 unpublished trial was excluded from the meta-analysis, these results did not change appreciably (SMD: 0.22 [95% CI: 0.07–0.37], z score = 2.84, P = .005; heterogeneity Q value: 15.93, df = 4 [P = .003], I2 = 75%). A random effects model showed a greater effect of SRI treatment than the fixed effects model (SMD: 0.37 [95% CI: 0.06–0.68], z score = 2.37, P = .018).

    FIGURE 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 2

    Forest plot depicting the benefit of SRI use in the treatment of autism. A meta-analysis involving 6 trials and 365 participants showed that SRIs have a small effect in reducing repetitive behaviors in autism (SMD: 0.22 [95% CI: 0.07–0.37], z score = 2.87, P = .005). In this figure, solid squares represent each of the studies included in the meta-analysis; increasing square size reflected the increasing weight that a given study was assigned to when computing the summary effect (the latter which was represented by a diamond at the bottom of the graph).

    Our literature search first alerted us to the presence of 5 completed studies that were possibly eligible for inclusion in this meta-analysis but remained unpublished at the time the manuscript was put together, thus suggesting the presence of publication bias in the field. Both the Egger regression test (intercept = 4.5 [95% CI: 2.3–6.7], t = 6.6, P = .007) and a regression of adjusted sample size versus trial effect size demonstrated significant evidence of publication bias (β = –.005 [95% CI: –0.008 to –0.001], z score = –2.8, P = .004). Figure 3 depicts a funnel plot of the 5 published trials demonstrating significant evidence of publication bias in the literature. Duval and Tweedie's trim and fill method was used to provide an adjusted estimate of the effect of SRI treatment in ASD by taking into account the role of unpublished studies within the field.33,51 This nonparametric method revealed that there was no longer a significant benefit of SRI for the treatment of repetitive behaviors in ASD when taking into account publication bias (SMD: 0.12 [95% CI: –0.02 to 0.27]).

    FIGURE 3
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 3

    Funnel plot analysis as an exploratory tool for assessing publication bias in autism SRI clinical trials. For each trial included in the meta-analysis (represented here by the open circles), the effect size was plotted against the SE. The summary effect size was calculated by using a meta-analysis and is represented by the open diamond at the bottom of the plot; the solid diamond represents the adjusted estimate of the effect of SRI treatment in ASD by taking into account the role of unpublished studies. Additional adjustments were made to make this plot symmetrical. In the absence of publication bias, studies included in the meta-analysis will be symmetrically scattered about the mean effect size, given the randomness of the sampling error. In the presence of publication bias, missing unfavorable or nonsignificant trials with smaller effects will contribute to the asymmetry of the plot by failing to evenly distribute about the underlying true mean effect size. Findings here provided qualitative evidence of publication bias in autism SRI trials.

    Type of SRI Medication

    Subgroup analysis demonstrated no significant effect of type of medication (test for subgroup difference Q value = 0.25, df = 1, P = .62). The 4 trials using SSRIs (SMD: 0.20 [95% CI: 0.02–0.37], t = 2.23, P = .03) and 2 trials using clomipramine (SMD: 0.29 [95% CI: –0.01 to 0.58], t = 1.87, P = .06) showed similar results when testing the effects on repetitive behavior symptoms.

    For the sake of completeness, a meta-analysis of the individual SRI medications is presented. The 2 trials using citalopram (SMD: 0.04 [95% CI: –0.18 to 0.26]), t = 0.37, P = .72), and the 1 trial using fluoxetine (SMD: 0.32 [95% CI: –0.00 to 0.64], t = 1.94, P = .05) showed modest effects on repetitive behaviors, whereas the 1 trial using fluvoxamine (SMD: 1.04 [5% CI: 0.41–1.67], t = 3.25, P = .00) reported a greater effect.

    Dosing of SRI Medication

    Meta-regression demonstrated a significant effect of SRI dose on medication efficacy for repetitive behaviors in ASD. Increased dose was significantly associated with greater efficacy in treating repetitive behaviors in ASD (β = .0038 [95% CI: 0.0012–0.0064], t = 2.84, P < .005).

    Patient Age

    Meta-regression did not demonstrate a significant effect of SRI treatment with age (β = .03 [95% CI: –0.0008 to 0.0530], t = 1.90, P = .05761). However, at trend levels, increased average patient age in trials was associated with a greater treatment effect.

    Trial Characteristics

    We found a significant effect of trial methodologic quality (as measured by using the Jadad scale) on the measured efficacy of SRI medications (β = –.22 [95% CI: –0.40 to –0.03], t = –2.30, P = .02). Lower-quality trials reported a greater efficacy of SRI treatment.

    Effects of method of analysis (intention-to-treat versus completers) were also assessed. Whereas intention-to-treat analyses include all randomized participants in a trial (regardless of whether they completed the randomized controlled trial), completers’ analyses only assess the effect of a given medication in participants that actually completed the randomized controlled trial.53 Method of analysis did not significantly affect SRI efficacy in trials (test for subgroup difference Q value = 3.21, df = 1, P = .07). However, the 2 trials that relied on completers’ analysis (SMD: 0.45 [95% CI: 0.16–0.74], t = 3.00, P = .003) showed greater SRI efficacy than the 3 trials that used intention-to-treat analysis (SMD: 0.14 [95% CI: –0.04–0.31], t = 1.50, P = .134) at trend levels.

    Stratified subgroup analysis demonstrated no significant difference in SRI efficacy based on trial design (test for subgroup difference Q value = 1.0, df = 1, P = .32). Parallel-group (SMD: 0.15 [95% CI: –0.06 to 0.35], t = 1.41, P = .16) and crossover (SMD: 0.30 [95% CI: 0.08–0.52], t = 2.69, P = .007) trials reported similar measures of SRI efficacy. Finally, meta-regression demonstrated no significant effect of trial duration on reported SRI efficacy (β = –.042 [95% CI: –0.103 to 0.020], t = –1.33, P = .18).

    Discussion

    RRBs constitute a core feature of ASD. In the past decade, a flurry of research activity has allowed for the better understanding of RRB subtyping and the development of better tools for diagnosing and measuring RRBs. Unfortunately, a gap continues to exist in the literature with regard to the effective pharmacologic treatment of RRBs in children and adults diagnosed with this disorder.54 Addressing this question remains of utmost importance, given that RRBs continue to be a major barrier toward learning and social adaptation in both children and adults with ASD.

    Initial results showed a small effect of SRIs for the treatment of repetitive behaviors in autism, including obsessions and compulsions. However, a closer look at the trials included in this meta-analysis demonstrated significant evidence of heterogeneity and publication bias. It is noteworthy that, after adjusting for publication bias in the literature, the effect of SRI medications in ASD was no longer significant.

    As part of this meta-analysis, we also evaluated a number of indicators of publication bias, including funnel plots, adjusted effect sizes after publication had been taken into account using Duval and Tweedie's procedure, and tests for the symmetry of the funnel plots by using Egger’s linear regression method. This research made it clear that the effects of SRI treatment in ASD are considerably overrated because of publication bias. In addition, our search strategy uncovered as many completed SRI trials in ASD with unpublished results as have been published, further supporting the influence of potential publication bias on effect estimates.

    Publication bias has been demonstrated previously to influence the estimates of many other interventions in child psychiatry and medicine. The potential efficacy of antidepressant agents has been particularly influenced by this phenomenon. For example, previous research found that only 51% of the antidepressant trials registered with the US Food and Drug Administration reported positive results. By contrast, as many as 94% of trials published in the peer-reviewed literature evaluating antidepressant agents reported positive results.55

    A particularly influential meta-analysis published in 2004 suggested that published trials of antidepressant agents in children demonstrated greater evidence of efficacy and a more benign risk/benefit profile than those trials that were not published but submitted to regulatory agencies.56 A time-lag bias in the pediatric antidepressant literature whereby negative trials have a longer time to publication than positive trials has also been demonstrated.57 Regardless of whether frank publication bias or time-lag bias is the cause of the large unpublished available literature in SRI trials for the treatment of repetitive behaviors in autism, there is a strong possibility that publication has distorted the perception (and evidence) of how effective these medications likely are.

    Our meta-analysis is not without limitations. Our analyses were limited by the reduced number of published, randomized, placebo-controlled trials of SRIs in ASD that are currently available and were bound to whichever rating scales the authors used to study RRB outcomes. Unfortunately, in most studies included in this meta-analysis, changes in RRBs were quantified by using a number of scales that were originally written for quantifying obsessions and compulsions in OCD (eg, Children’s Yale-Brown Obsessive-Compulsive Scale). The overall lack of specific assessments to better quantify RRBs in autism clinical trials is an ongoing issue in the field and one that complicates meta-analysis research.

    When making a decision regarding whether to initiate a medication, it is important to weigh the potential benefits against potential risks. All articles included in this meta-analysis provided data on the adverse events associated with the use of SRIs versus placebo in patients with ASD.46–50 In general, the adverse event profile of medications was very similar to that observed in the general population. Clomipramine, a tricyclic antidepressant, was poorly tolerated by subjects, with a substantially increased number of dropouts due to adverse effects in the treatment compared with placebo groups. Increased rates of sedation, insomnia, and cardiovascular adverse events were observed with clomipramine compared with placebo. Although SRIs were better tolerated than clomipramine, increased rates of gastrointestinal adverse events were observed compared with placebo. Finally, although perhaps not effective in the treatment of RRBs, there is some evidence to suggest that SRIs may be helpful for the proper management of comorbid anxiety in ASD, and therefore its therapeutic use in ASD should not be completely dismissed.58

    Conclusions

    RRBs are an important barrier to learning and social functioning in children with ASD and have been speculated by clinicians and researchers to be closely related to OCD symptoms. This hypothesis has led to widespread clinical use and to several randomized, placebo-controlled trials evaluating the efficacy of SRIs in the treatment of repetitive behaviors in ASD. Unfortunately, a large number of these trials have not been published. Meta-analysis of trials with available data demonstrated a small but significant effect of SRIs for the treatment of RRBs in ASD. The effect was no longer significant when publication bias was adjusted for. Further research is needed to find effective treatments for children with ASDs. Identifying effective treatments for these patients will be difficult if partial and selective publication of clinical trials persists, an issue that experts indicate is widespread across all fields of medicine, is not specific to industry or academia (but plagues both), and that may be best addressed with greater enforcement of the registration and reporting of all clinical trials and their results.59

    Acknowledgment

    The authors acknowledge Mr Yasuhiro Kyono for his invaluable efforts in translating a manuscript that was included in our meta-analysis from its original in Japanese.

    Footnotes

      • Accepted February 29, 2012.
    • Address correspondence to Melisa Carrasco, MS, Neuroscience Graduate Program, 4137 Undergraduate Science Building (USB), 204 Washtenaw Ave, Ann Arbor, MI 48109-2215. E-mail: melcarr{at}umich.edu
    • All authors made substantive intellectual contributions toward the manuscript and have approved the version being submitted here.

    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: The authors acknowledge the National Institute of Mental Health support of the Yale Child Study Center Research Training Program (Dr Bloch), the National Institutes of Health (1K23MH091240-01, Dr Bloch), the National Institutes of Health (5F31MH086273-03, Dr Carrasco), and UL1 RR024139 from the National Center for Research Resources, a component of the National Institutes of Health, and NIH Roadmap for Medical Research (Dr Bloch). Funded by the National Institutes of Health (NIH).

    • COMPANION PAPERS: Companions to this article can be found on pages e1291 and e1320, online at www.pediatrics.org/cgi/doi/10.1542/peds.2010-2847 and www.pediatrics.org/cgi/doi/10.1542/peds.2012-0621.

    References

    1. ↵
      1. Fombonne E
      . Epidemiology of pervasive developmental disorders. Pediatr Res. 2009;65(6):591–598pmid:19218885
      OpenUrlCrossRefPubMed
    2. ↵
      1. Lord C
      . Autism spectrum disorders. Society for Research in Child Development: Social Policy Report. 2010;24(2):1–27
      OpenUrl
      1. Kim YS,
      2. Leventhal BL,
      3. Koh YJ,
      4. et al
      . Prevalence of autism spectrum disorders in a total population sample. Am J Psychiatry. 2011;168(9):904–912pmid:21558103
      OpenUrlCrossRefPubMed
    3. ↵
      1. Lord C
      . Epidemiology: How common is autism? Nature. 2011;474(7350):166–168pmid:21654793
      OpenUrlCrossRefPubMed
    4. ↵
      1. Rapin I
      . The autistic-spectrum disorders. N Engl J Med. 2002;347(5):302–303pmid:12151466
      OpenUrlCrossRefPubMed
    5. ↵
      1. Richler J,
      2. Bishop SL,
      3. Kleinke JR,
      4. Lord C
      . Restricted and repetitive behaviors in young children with autism spectrum disorders. J Autism Dev Disord. 2007;37(1):73–85pmid:17195920
      OpenUrlCrossRefPubMed
    6. ↵
      1. Richler J,
      2. Huerta M,
      3. Bishop SL,
      4. Lord C
      . Developmental trajectories of restricted and repetitive behaviors and interests in children with autism spectrum disorders. Dev Psychopathol. 2010;22(1):55–69pmid:20102647
      OpenUrlCrossRefPubMed
    7. ↵
      1. Dunlap G,
      2. Dyer K,
      3. Koegel RL
      . Autistic self-stimulation and intertrial interval duration. Am J Ment Defic. 1983;88(2):194–202pmid:6638081
      OpenUrlPubMed
    8. ↵
      1. Gabriels RL,
      2. Cuccaro ML,
      3. Hill DE,
      4. Ivers BJ,
      5. Goldson E
      . Repetitive behaviors in autism: relationships with associated clinical features. Res Dev Disabil. 2005;26(2):169–181pmid:15590247
      OpenUrlCrossRefPubMed
    9. ↵
      1. Zandt F,
      2. Prior M,
      3. Kyrios M
      . Similarities and differences between children and adolescents with autism spectrum disorder and those with obsessive compulsive disorder: executive functioning and repetitive behaviour. Autism. 2009;13(1):43–57pmid:19176576
      OpenUrlAbstract/FREE Full Text
    10. ↵
      1. Zandt F,
      2. Prior M,
      3. Kyrios M
      . Repetitive behaviour in children with high functioning autism and obsessive compulsive disorder. J Autism Dev Disord. 2007;37(2):251–259pmid:16865546
      OpenUrlCrossRefPubMed
    11. ↵
      1. Bodfish JW,
      2. Symons FJ,
      3. Parker DE,
      4. Lewis MH
      . Varieties of repetitive behavior in autism: comparisons to mental retardation. J Autism Dev Disord. 2000;30(3):237–243pmid:11055459
      OpenUrlCrossRefPubMed
      1. McDougle CJ,
      2. Kresch LE,
      3. Goodman WK,
      4. et al
      . A case-controlled study of repetitive thoughts and behavior in adults with autistic disorder and obsessive-compulsive disorder. Am J Psychiatry. 1995;152(5):772–777pmid:7726318
      OpenUrlPubMed
    12. ↵
      1. Gross-Isseroff R,
      2. Hermesh H,
      3. Weizman A
      . Obsessive compulsive behaviour in autism—towards an autistic-obsessive compulsive syndrome? World J Biol Psychiatry. 2001;2(4):193–197pmid:12587149
      OpenUrlCrossRefPubMed
    13. ↵
      1. Hollander E,
      2. King A,
      3. Delaney K,
      4. Smith CJ,
      5. Silverman JM
      . Obsessive-compulsive behaviors in parents of multiplex autism families. Psychiatry Res. 2003;117(1):11–16pmid:12581816
      OpenUrlCrossRefPubMed
    14. ↵
      1. Micali N,
      2. Chakrabarti S,
      3. Fombonne E
      . The broad autism phenotype: findings from an epidemiological survey. Autism. 2004;8(1):21–37pmid:15070545
      OpenUrlAbstract/FREE Full Text
    15. ↵
      1. Hollander E,
      2. Kim S,
      3. Braun A,
      4. Simeon D,
      5. Zohar J
      . Cross-cutting issues and future directions for the OCD spectrum. Psychiatry Res. 2009;170(1):3–6pmid:19811839
      OpenUrlCrossRefPubMed
    16. ↵
      1. Jacob S,
      2. Landeros-Weisenberger A,
      3. Leckman JF
      . Autism spectrum and obsessive-compulsive disorders: OC behaviors, phenotypes and genetics. Autism Res. 2009;2(6):293–311pmid:20029829
      OpenUrlCrossRefPubMed
    17. ↵
      1. Lewis MH
      . Brief report: psychopharmacology of autism spectrum disorders. J Autism Dev Disord. 1996;26(2):231–235pmid:8744491
      OpenUrlCrossRefPubMed
    18. ↵
      1. Soomro GM,
      2. Altman D,
      3. Rajagopal S,
      4. Oakley-Browne M
      . Selective serotonin re-uptake inhibitors (SSRIs) versus placebo for obsessive compulsive disorder (OCD). Cochrane Database Syst Rev. 2008;(1):CD001765pmid:18253995
      OpenUrlPubMed
    19. ↵
      1. Laupacis A,
      2. Sackett DL,
      3. Roberts RS
      . An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988;318(26):1728–1733pmid:3374545
      OpenUrlCrossRefPubMed
    20. ↵
      1. Bloch MH,
      2. McGuire J,
      3. Landeros-Weisenberger A,
      4. Leckman JF,
      5. Pittenger C
      . Meta-analysis of the dose-response relationship of SSRI in obsessive-compulsive disorder. Mol Psychiatry. 2010;15(8):850–855pmid:19468281
      OpenUrlCrossRefPubMed
    21. ↵
      1. Ipser JC,
      2. Stein DJ,
      3. Hawkridge S,
      4. Hoppe L
      . Pharmacotherapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2009;(3):CD005170pmid:19588367
      OpenUrlPubMed
    22. ↵
      1. Williams K,
      2. Wheeler DM,
      3. Silove N,
      4. Hazell P
      . Selective serotonin reuptake inhibitors (SSRIs) for autism spectrum disorders (ASD). Cochrane Database Syst Rev. 2010;(8):CD004677pmid:20687077
      OpenUrlPubMed
    23. ↵
      1. Mandell DS,
      2. Morales KH,
      3. Marcus SC,
      4. Stahmer AC,
      5. Doshi J,
      6. Polsky DE
      . Psychotropic medication use among Medicaid-enrolled children with autism spectrum disorders. Pediatrics. 2008;121(3). Available at: www.pediatrics.org/cgi/content/full/121/3/e441pmid:18310165
      OpenUrlCrossRef
      1. Oswald DP,
      2. Sonenklar NA
      . Medication use among children with autism spectrum disorders. J Child Adolesc Psychopharmacol. 2007;17(3):348–355pmid:17630868
      OpenUrlCrossRefPubMed
    24. ↵
      1. Rosenberg RE,
      2. Mandell DS,
      3. Farmer JE,
      4. Law JK,
      5. Marvin AR,
      6. Law PA
      . Psychotropic medication use among children with autism spectrum disorders enrolled in a national registry, 2007-2008. J Autism Dev Disord. 2010;40(3):342–351pmid:19806445
      OpenUrlCrossRefPubMed
    25. ↵
      1. Scahill L,
      2. McDougle CJ,
      3. Williams SK,
      4. et al.,
      5. Research Units on Pediatric Psychopharmacology Autism Network
      . Children’s Yale-Brown Obsessive Compulsive Scale modified for pervasive developmental disorders. J Am Acad Child Adolesc Psychiatry. 2006;45(9):1114–1123pmid:16926619
      OpenUrlCrossRefPubMed
    26. ↵
      1. Goodman WK,
      2. Price LH,
      3. Rasmussen SA,
      4. et al
      . The Yale-Brown Obsessive Compulsive Scale. I. Development, use, and reliability. Arch Gen Psychiatry. 1989;46(11):1006–1011pmid:2684084
      OpenUrlCrossRefPubMed
    27. ↵
      1. Scahill L,
      2. Riddle MA,
      3. McSwiggin-Hardin M,
      4. et al
      . Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity. J Am Acad Child Adolesc Psychiatry. 1997;36(6):844–852pmid:9183141
      OpenUrlCrossRefPubMed
    28. ↵
      1. Aman MG,
      2. Singh NN,
      3. Stewart AW,
      4. Field CJ
      . The aberrant behavior checklist: a behavior rating scale for the assessment of treatment effects. Am J Ment Defic. 1985;89(5):485–491pmid:3993694
      OpenUrlPubMed
    29. ↵
      1. Moher D,
      2. Jadad AR,
      3. Nichol G,
      4. Penman M,
      5. Tugwell P,
      6. Walsh S
      . Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials. 1995;16(1):62–73pmid:7743790
      OpenUrlCrossRefPubMed
    30. ↵
      Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. Chichester, UK: John Wiley & Sons, Ltd; 2009
    31. ↵
      1. Egger M,
      2. Davey Smith G,
      3. Schneider M,
      4. Minder C
      . Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634pmid:9310563
      OpenUrlAbstract/FREE Full Text
    32. ↵
      Dichter G. Functional MRI evaluation of the effect of citalopram in autism spectrum disorders. Available at: http://clinicaltrials.gov/ct2/show/NCT00609531. Accessed April 23, 2011
    33. ↵
      1. Deeks J,
      2. Higgins J,
      3. Altman D
      . Cochrane Reviewers' Handbook 4.2.1. Chichester, UK: John Wiley & Sons, Ltd; 2003
    34. ↵
      1. Anagnostou E,
      2. Esposito K,
      3. Soorya L,
      4. Chaplin W,
      5. Wasserman S,
      6. Hollander E
      . Divalproex versus placebo for the prevention of irritability associated with fluoxetine treatment in autism spectrum disorder. J Clin Psychopharmacol. 2006;26(4):444–446pmid:16855475
      OpenUrlCrossRefPubMed
      1. Dinca O,
      2. Paul M,
      3. Spencer NJ
      . Systematic review of randomized controlled trials of atypical antipsychotics and selective serotonin reuptake inhibitors for behavioural problems associated with pervasive developmental disorders. J Psychopharmacol. 2005;19(5):521–532pmid:16166190
      OpenUrlAbstract/FREE Full Text
      1. Sugie Y,
      2. Sugie H,
      3. Fukuda T,
      4. et al
      . Clinical efficacy of fluvoxamine and functional polymorphism in a serotonin transporter gene on childhood autism. J Autism Dev Disord. 2005;35(3):377–385pmid:16119478
      OpenUrlCrossRefPubMed
    35. ↵
      1. Mathai J,
      2. Bourne A,
      3. Cranswick N
      . Lessons learnt in conducting a clinical drug trial in children with Asperger Syndrome. Australas Psychiatry. 2005;13(2):173–175pmid:15948916
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Fukuda T,
      2. Sugie H,
      3. Ito M,
      4. Sugie Y
      . Clinical evaluation of treatment with fluvoxamine, a selective serotonin reuptake inhibitor in children with autistic disorder [article in Japanese]. No To Hattatsu. 2001;33(4):314–318pmid:11494573
      OpenUrlPubMed
    37. ↵
      Neuropharm. Study of fluoxetine in autism (SOFIA). Available at: http://clinicaltrials.gov/ct2/show/NCT00515320. Accessed April 23, 2011
    38. FDA Office of Orphan Products Development. Study of fluoxetine in adults with autistic disorder. Available from: http://clinicaltrials.gov/ct2/show/NCT00027404. Accessed April 23, 2011
    39. The Hospital for Sick Children. Fluvoxamine and sertraline in childhood autism—does SSRI therapy improve behaviour and/or mood? Available at: http://clinicaltrials.gov/ct2/show/NCT00655174. Accessed April 23, 2011
    40. ↵
      National Institute of Mental Health (NIMH). Effectiveness of early intervention with fluoxetine in enhancing developmental processes in children with autism (STAART study 2). Available at: http://clinicaltrials.gov/ct2/show/NCT00183339. Accessed April 23, 2011
    41. ↵
      1. Gordon CT,
      2. State RC,
      3. Nelson JE,
      4. Hamburger SD,
      5. Rapoport JL
      . A double-blind comparison of clomipramine, desipramine, and placebo in the treatment of autistic disorder. Arch Gen Psychiatry. 1993;50(6):441–447pmid:8498878
      OpenUrlCrossRefPubMed
    42. ↵
      1. McDougle CJ,
      2. Naylor ST,
      3. Cohen DJ,
      4. Volkmar FR,
      5. Heninger GR,
      6. Price LH
      . A double-blind, placebo-controlled study of fluvoxamine in adults with autistic disorder. Arch Gen Psychiatry. 1996;53(11):1001–1008pmid:8911223
      OpenUrlCrossRefPubMed
    43. ↵
      1. Remington G,
      2. Sloman L,
      3. Konstantareas M,
      4. Parker K,
      5. Gow R
      . Clomipramine versus haloperidol in the treatment of autistic disorder: a double-blind, placebo-controlled, crossover study. J Clin Psychopharmacol. 2001;21(4):440–444pmid:11476129
      OpenUrlCrossRefPubMed
    44. ↵
      1. Hollander E,
      2. Phillips A,
      3. Chaplin W,
      4. et al
      . A placebo controlled crossover trial of liquid fluoxetine on repetitive behaviors in childhood and adolescent autism. Neuropsychopharmacology. 2005;30(3):582–589pmid:15602505
      OpenUrlCrossRefPubMed
    45. ↵
      1. King BH,
      2. Hollander E,
      3. Sikich L,
      4. et al.,
      5. STAART Psychopharmacology Network
      . Lack of efficacy of citalopram in children with autism spectrum disorders and high levels of repetitive behavior: citalopram ineffective in children with autism. Arch Gen Psychiatry. 2009;66(6):583–590pmid:19487623
      OpenUrlCrossRefPubMed
    46. ↵
      1. Duval S,
      2. Tweedie R
      . Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–463pmid:10877304
      OpenUrlCrossRefPubMed
      1. McDougle CJ,
      2. Kresch LE,
      3. Posey DJ
      . Repetitive thoughts and behavior in pervasive developmental disorders: treatment with serotonin reuptake inhibitors. J Autism Dev Disord. 2000;30(5):427–435pmid:11098879
      OpenUrlCrossRefPubMed
    47. ↵
      1. Hollis S,
      2. Campbell F
      . What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319(7211):670–674pmid:10480822
      OpenUrlAbstract/FREE Full Text
    48. ↵
      1. Leekam SR,
      2. Prior MR,
      3. Uljarevic M
      . Restricted and repetitive behaviors in autism spectrum disorders: a review of research in the last decade. Psychol Bull. 2011;137(4):562–593pmid:21574682
      OpenUrlCrossRefPubMed
    49. ↵
      1. Turner EH,
      2. Matthews AM,
      3. Linardatos E,
      4. Tell RA,
      5. Rosenthal R
      . Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358(3):252–260pmid:18199864
      OpenUrlCrossRefPubMed
    50. ↵
      Whittington CJ, Kendall T, Fonagy P, Cottrell D, Cotgrove A, Boddington E. Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet. 2004;363(9418):1341–1345
    51. ↵
      1. Reyes MM,
      2. Panza KE,
      3. Martin A,
      4. Bloch MH
      . Time-lag bias in trials of pediatric antidepressants: a systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry. 2011;50(1):63–72pmid:21156271
      OpenUrlCrossRefPubMed
    52. ↵
      1. Kolevzon A,
      2. Mathewson KA,
      3. Hollander E
      . Selective serotonin reuptake inhibitors in autism: a review of efficacy and tolerability. J Clin Psychiatry. 2006;67(3):407–414pmid:16649827
      OpenUrlCrossRefPubMed
    53. ↵
      1. Law MR,
      2. Kawasumi Y,
      3. Morgan SG
      . Despite law, fewer than one in eight completed studies of drugs and biologics are reported on time on ClinicalTrials.gov. Health Aff (Millwood). 2011;30(12):2338–2345pmid:22147862
      OpenUrlAbstract/FREE Full Text
    • Copyright © 2012 by the American Academy of Pediatrics
    PreviousNext
    Back to top

    Advertising Disclaimer »

    In this issue

    Pediatrics
    Vol. 129, Issue 5
    1 May 2012
    • Table of Contents
    • Index by author
    View this article with LENS
    PreviousNext
    Email Article

    Thank you for your interest in spreading the word on American Academy of Pediatrics.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    Pharmacologic Treatment of Repetitive Behaviors in Autism Spectrum Disorders: Evidence of Publication Bias
    (Your Name) has sent you a message from American Academy of Pediatrics
    (Your Name) thought you would like to see the American Academy of Pediatrics web site.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Request Permissions
    Article Alerts
    Log in
    You will be redirected to aap.org to login or to create your account.
    Or Sign In to Email Alerts with your Email Address
    Citation Tools
    Pharmacologic Treatment of Repetitive Behaviors in Autism Spectrum Disorders: Evidence of Publication Bias
    Melisa Carrasco, Fred R. Volkmar, Michael H. Bloch
    Pediatrics May 2012, 129 (5) e1301-e1310; DOI: 10.1542/peds.2011-3285

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    Pharmacologic Treatment of Repetitive Behaviors in Autism Spectrum Disorders: Evidence of Publication Bias
    Melisa Carrasco, Fred R. Volkmar, Michael H. Bloch
    Pediatrics May 2012, 129 (5) e1301-e1310; DOI: 10.1542/peds.2011-3285
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    Print
    Download PDF
    Insight Alerts
    • Table of Contents

    Jump to section

    • Article
      • Abstract
      • Methods
      • Results
      • Discussion
      • Conclusions
      • Acknowledgment
      • Footnotes
      • References
    • Figures & Data
    • Info & Metrics
    • Comments

    Related Articles

    • No related articles found.
    • PubMed
    • Google Scholar

    Cited By...

    • Behavioral training reverses global cortical network dysfunction induced by perinatal antidepressant exposure
    • Google Scholar

    More in this TOC Section

    • Uncertainty at the Limits of Viability: A Qualitative Study of Antenatal Consultations
    • Evaluation of an Emergency Department High-risk Bruising Screening Protocol
    • Time to First Onset of Chest Binding–Related Symptoms in Transgender Youth
    Show more Article

    Similar Articles

    Subjects

    • Developmental/Behavioral Pediatrics
      • Developmental/Behavioral Pediatrics
    • Journal Info
    • Editorial Board
    • Editorial Policies
    • Overview
    • Licensing Information
    • Authors/Reviewers
    • Author Guidelines
    • Submit My Manuscript
    • Open Access
    • Reviewer Guidelines
    • Librarians
    • Institutional Subscriptions
    • Usage Stats
    • Support
    • Contact Us
    • Subscribe
    • Resources
    • Media Kit
    • About
    • International Access
    • Terms of Use
    • Privacy Statement
    • FAQ
    • AAP.org
    • shopAAP
    • Follow American Academy of Pediatrics on Instagram
    • Visit American Academy of Pediatrics on Facebook
    • Follow American Academy of Pediatrics on Twitter
    • Follow American Academy of Pediatrics on Youtube
    • RSS
    American Academy of Pediatrics

    © 2021 American Academy of Pediatrics