Skip to main content

Advertising Disclaimer »

Main menu

  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers
  • Other Publications
    • American Academy of Pediatrics

User menu

  • Log in

Search

  • Advanced search
American Academy of Pediatrics

AAP Gateway

Advanced Search

AAP Logo

  • Log in
  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers

Discover Pediatric Collections on COVID-19 and Racism and Its Effects on Pediatric Health

American Academy of Pediatrics
Commentary

The Challenges of Addressing Pediatric Quality Measurement Gaps

Rita Mangione-Smith
Pediatrics April 2017, 139 (4) e20170174; DOI: https://doi.org/10.1542/peds.2017-0174
Rita Mangione-Smith
Department of Pediatrics, University of Washington, Seattle, Washington; and Center for Child Health, Behavior and Development, Seattle Children’s Research Institute, Seattle, Washington
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • Comments
Loading
Download PDF
  • Abbreviation:
    EHR —
    electronic health record
  • In this issue of Pediatrics, the article by House et al1 provides a summary of pediatric quality measures currently available in national databases as well as an assessment of how comprehensively these measures represent common pediatric issues. The authors found a preponderance of process measures that have not been outcome-validated. They also found a dearth of measures for some of the most common and/or costly conditions, and relatively few health outcome measures. These findings are not unexpected and are unlikely to change without a paradigm shift in how quality measures are developed and implemented in health care systems across the United States.

    The first step in quality measure development is to review the evidence and/or clinical practice guidelines related to the topic under consideration.2 Guidelines represent “state-of-the-art” thinking about how conditions should be diagnosed, treated, and, for chronic conditions, managed over time. Thus, when they exist for a given condition, clinical practice guidelines are usually the main source used to develop quality measures. When guideline recommendations are based on low-quality evidence, which is often the case in pediatrics,3⇓⇓⇓–7 the quality measures they inform will also be based on this same level of evidence. For such quality measures, a critical step in their development is establishing their validity. This goal can be accomplished by examining how scores on the measures relate to improved health and/or health care outcomes after care was received. However, given the lack of available pediatric outcomes that occur with reasonable frequency or that are sensitive to changes in care processes or structures over relatively short periods of time, pediatric quality measure developers often face difficulty in accomplishing this step. A potential solution is to only assess aspects of care supported by high-levels of evidence, but this approach will then provide an extremely narrow assessment of pediatric health care quality.

    Quality measurement is often driven by what we can easily assess given the data we have rather than what we wish to assess related to the most common and costly pediatric conditions. For example, there have been calls to develop measures assessing the quality of care coordination for children with medical complexity,8 a high-cost population of pediatric patients.9 Twenty such measures were developed by one of the Pediatric Quality Measures Program Centers of Excellence,8 and 8 of these measures went on to be endorsed by the National Quality Forum in 2016 supporting the rigorous process that was used in their development.10 Why, therefore, are these measures not in common use? Mainly because they are parent-reported process measures that rely on survey administration, making them resource-intensive to implement. This area of care is unfortunately one that cannot be meaningfully assessed by using readily available data sources such as administrative claims or electronic health records (EHRs). Until there is a willingness to invest in routine electronic survey data collection on a broad scale, measuring quality in areas of care in which consumers are the best source of the information will remain limited.

    The same can be said for common conditions (eg, bronchiolitis) in which implementation of guideline-based quality measures often requires resource-intensive manual abstraction of medical records data from the EHR. Structured EHR data fields that provide automated access to clinical information are extremely limited, and even when they do exist, they often do not provide valid information regarding the care that was rendered.11 Until there are advances in natural language processing and/or the availability of a more comprehensive set of validated, structured EHR data fields for such quality measures, this situation again is unlikely to change.

    The infrequent occurrence of many health care outcomes (including hospital readmissions, emergency department return visits, and mortality in children) make their use as meaningful pediatric quality measures challenging at best. If instead we choose to measure health-related quality of life or functional status,12,13 we face problems of feasibility of implementation and sensitivity to change. These measures require surveys for assessment, making them less feasible to implement on a wide scale. In addition, most children are healthy and primarily receive preventive health services (eg, immunizations), making it difficult to detect meaningful changes in these measures over time. We might assess missed school days or school performance as key pediatric health outcome measures; however, access to educational databases is highly restricted for privacy reasons, making such measurements infeasible on a routine basis.

    In short, there is a tension between what we would like to measure and what we are able to measure, given the current data systems and resources available for quality assessment. Without the development of more sophisticated electronic data systems that afford routine collection of both patient- and parent-reported measures, EHRs that include a more comprehensive set of fields that can be validly queried, and information-sharing across silos, we will continue to have many gaps in pediatric quality measurement.

    Footnotes

      • Accepted January 20, 2017.
    • Address correspondence to Rita Mangione-Smith, MD, MPH, Seattle Children’s Research Institute, Center for Child Health, Behavior, and Development, 2001 Eighth Avenue, Suite 400, Seattle, WA 98121. E-mail: rita.mangione-smith{at}seattlechildrens.org
    • FINANCIAL DISCLOSURE: The author has indicated she has no financial relationships relevant to this article to disclose.

    • FUNDING: No external funding.

    • POTENTIAL CONFLICT OF INTEREST: The author has indicated she has no potential conflicts of interest to disclose.

    • COMPANION PAPER: A companion to this article can be found online at www.pediatrics.org/cgi/doi/10.1542/peds.2016-3269.

    References

    1. ↵
      1. House SA,
      2. Coon ER,
      3. Schroeder AR,
      4. Ralston SL.
      Categorization of national pediatric quality metrics. Pediatrics. 2017;139(4):e20163269
      OpenUrlAbstract/FREE Full Text
    2. ↵
      1. Byron SC,
      2. Gardner W,
      3. Kleinman LC, et al
      . Developing measures for pediatric quality: methods and experiences of the CHIPRA pediatric quality measures program grantees. Acad Pediatr. 2014;14(suppl 5):S27–S32pmid:25169454
      OpenUrlCrossRefPubMed
    3. ↵
      1. Melnyk BM,
      2. Grossman DC,
      3. Chou R, et al; US Preventive Services Task Force
      . USPSTF perspective on evidence-based preventive recommendations for children. Pediatrics. 2012;130(2). Available at: www.pediatrics.org/cgi/content/full/130/2/e399pmid:22753558
      OpenUrlAbstract/FREE Full Text
    4. ↵
      1. Bacharier LB,
      2. Boner A,
      3. Carlsen KH, et al; European Pediatric Asthma Group
      . Diagnosis and treatment of asthma in childhood: a PRACTALL consensus report. Allergy. 2008;63(1):5–34pmid:18053013
      OpenUrlCrossRefPubMed
    5. ↵
      1. Kealey E,
      2. Scholle SH,
      3. Byron SC, et al
      . Quality concerns in antipsychotic prescribing for youth: a review of treatment guidelines. Acad Pediatr. 2014;14(suppl 5):S68–S75pmid:25169461
      OpenUrlPubMed
    6. ↵
      1. Zeng L,
      2. Zhang L,
      3. Hu Z, et al
      . Systematic review of evidence-based guidelines on medication therapy for upper respiratory tract infection in children with AGREE instrument. PLoS One. 2014;9(2):e87711pmid:24586287
      OpenUrlPubMed
    7. ↵
      1. Wiener-Ogilvie S,
      2. Pinnock H,
      3. Huby G,
      4. Sheikh A,
      5. Partridge MR,
      6. Gillies J
      . Do practices comply with key recommendations of the British Asthma Guideline? If not, why not? Prim Care Respir J. 2007;16(6):369–377pmid:18026674
      OpenUrlCrossRefPubMed
    8. ↵
      1. Mistry KB,
      2. Chesley F,
      3. LLanos K,
      4. Dougherty D
      . Advancing children’s health care and outcomes through the pediatric quality measures program. Acad Pediatr. 2014;14(suppl 5):S19–S26pmid:25169453
      OpenUrlPubMed
    9. ↵
      1. Berry JG,
      2. Hall M,
      3. Neff J, et al
      . Children with medical complexity and Medicaid: spending and cost savings. Health Aff (Millwood). 2014;33(12):2199–2206pmid:25489039
      OpenUrlAbstract/FREE Full Text
    10. ↵
      1. National Quality Forum
      . Pediatric Measures. Final Report, June 15, 2016. Washington, DC: Naitonal Quality Forum; 2016
    11. ↵
      1. Gardner W,
      2. Morton S,
      3. Byron SC, et al
      . Using computer-extracted data from electronic health records to measure the quality of adolescent well-care. Health Serv Res. 2014;49(4):1226–1248pmid:24471935
      OpenUrlCrossRefPubMed
    12. ↵
      1. Varni JW,
      2. Burwinkle TM,
      3. Seid M,
      4. Skarr D
      . The PedsQL 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr. 2003;3(6):329–341pmid:14616041
      OpenUrlCrossRefPubMed
    13. ↵
      1. Stein REK,
      2. Jessop DJ
      . Functional status II(R). A measure of child health status. Med Care. 1990;28(11):1041–1055pmid:2250491
      OpenUrlCrossRefPubMed
    • Copyright © 2017 by the American Academy of Pediatrics
    PreviousNext
    Back to top

    Advertising Disclaimer »

    In this issue

    Pediatrics
    Vol. 139, Issue 4
    1 Apr 2017
    • Table of Contents
    • Index by author
    View this article with LENS
    PreviousNext
    Email Article

    Thank you for your interest in spreading the word on American Academy of Pediatrics.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    The Challenges of Addressing Pediatric Quality Measurement Gaps
    (Your Name) has sent you a message from American Academy of Pediatrics
    (Your Name) thought you would like to see the American Academy of Pediatrics web site.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Request Permissions
    Article Alerts
    Log in
    You will be redirected to aap.org to login or to create your account.
    Or Sign In to Email Alerts with your Email Address
    Citation Tools
    The Challenges of Addressing Pediatric Quality Measurement Gaps
    Rita Mangione-Smith
    Pediatrics Apr 2017, 139 (4) e20170174; DOI: 10.1542/peds.2017-0174

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    The Challenges of Addressing Pediatric Quality Measurement Gaps
    Rita Mangione-Smith
    Pediatrics Apr 2017, 139 (4) e20170174; DOI: 10.1542/peds.2017-0174
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    Print
    Download PDF
    Insight Alerts
    • Table of Contents

    Jump to section

    • Article
      • Footnotes
      • References
    • Info & Metrics
    • Comments

    Related Articles

    • No related articles found.
    • PubMed
    • Google Scholar

    Cited By...

    • Validation of a Parent-Reported Hospital-to-Home Transition Experience Measure
    • Google Scholar

    More in this TOC Section

    • Progress in Helping Children Who are Deaf or Hard of Hearing Achieve Their Potential
    • Is Developmental Screening Enough in High-Risk Populations?
    • Vestibular Disorders in Congenital Cytomegalovirus: A Balancing Act
    Show more Commentary

    Similar Articles

    Subjects

    • Evidence-Based Medicine
      • Evidence-Based Medicine
    • Administration/Practice Management
      • Quality Improvement
      • Administration/Practice Management
    • Journal Info
    • Editorial Board
    • Editorial Policies
    • Overview
    • Licensing Information
    • Authors/Reviewers
    • Author Guidelines
    • Submit My Manuscript
    • Open Access
    • Reviewer Guidelines
    • Librarians
    • Institutional Subscriptions
    • Usage Stats
    • Support
    • Contact Us
    • Subscribe
    • Resources
    • Media Kit
    • About
    • International Access
    • Terms of Use
    • Privacy Statement
    • FAQ
    • AAP.org
    • shopAAP
    • Follow American Academy of Pediatrics on Instagram
    • Visit American Academy of Pediatrics on Facebook
    • Follow American Academy of Pediatrics on Twitter
    • Follow American Academy of Pediatrics on Youtube
    • RSS
    American Academy of Pediatrics

    © 2021 American Academy of Pediatrics