Skip to main content

Advertising Disclaimer »

Main menu

  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers
  • Other Publications
    • American Academy of Pediatrics

User menu

  • Log in
  • My Cart

Search

  • Advanced search
American Academy of Pediatrics

AAP Gateway

Advanced Search

AAP Logo

  • Log in
  • My Cart
  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers

Discover Pediatric Collections on COVID-19 and Racism and Its Effects on Pediatric Health

American Academy of Pediatrics
Article

Predictive Validity of a 2-Question Alcohol Screen at 1-, 2-, and 3-Year Follow-up

James G. Linakis, Julie R. Bromberg, T. Charles Casper, Thomas H. Chun, Michael J. Mello, Rachel Richards, Colette C. Mull, Rohit P. Shenoi, Cheryl Vance, Fahd Ahmad, Lalit Bajaj, Kathleen M. Brown, Lauren S. Chernick, Daniel M. Cohen, Joel Fein, Timothy Horeczko, Michael N. Levas, Brett McAninch, Michael C. Monuteaux, Jackie Grupp-Phelan, Elizabeth C. Powell, Alexander Rogers, Brian Suffoletto, J. Michael Dean, Anthony Spirito and for the Pediatric Emergency Care Applied Research Network
Pediatrics March 2019, 143 (3) e20182001; DOI: https://doi.org/10.1542/peds.2018-2001
James G. Linakis
aThe Warren Alpert Medical School, Brown University, Providence, Rhode Island;
bRhode Island Hospital, Providence, Rhode Island;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Julie R. Bromberg
aThe Warren Alpert Medical School, Brown University, Providence, Rhode Island;
bRhode Island Hospital, Providence, Rhode Island;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
T. Charles Casper
cUniversity of Utah, Salt Lake City, Utah;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas H. Chun
aThe Warren Alpert Medical School, Brown University, Providence, Rhode Island;
bRhode Island Hospital, Providence, Rhode Island;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael J. Mello
aThe Warren Alpert Medical School, Brown University, Providence, Rhode Island;
bRhode Island Hospital, Providence, Rhode Island;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rachel Richards
cUniversity of Utah, Salt Lake City, Utah;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Colette C. Mull
dNemours/Alfred I. duPont Hospital for Children, Wilmington, Delaware;
eSidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rohit P. Shenoi
fTexas Children’s Hospital and College of Medicine, Baylor University, Houston, Texas;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cheryl Vance
gUniversity of California, Davis, Davis, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fahd Ahmad
hSt Louis Children’s Hospital and School of Medicine, Washington University in St Louis, St Louis, Missouri;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lalit Bajaj
iChildren’s Hospital Colorado, Aurora, Colorado;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kathleen M. Brown
jChildren’s National Medical Center, Washington, District of Columbia;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lauren S. Chernick
kColumbia University Irving Medical Center, New York City, New York;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel M. Cohen
lNationwide Children’s Hospital, Columbus, Ohio;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel Fein
mChildren’s Hospital of Philadelphia, Philadelphia, Pennsylvania;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Timothy Horeczko
nLos Angeles Biomedical Research Institute, Torrance, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael N. Levas
oMedical College of Wisconsin, Milwaukee, Wisconsin;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brett McAninch
pUniversity of Pittsburg Medical Center Children’s Hospital of Pittsburgh and School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael C. Monuteaux
qBoston Children’s Hospital, Boston, Massachusetts;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jackie Grupp-Phelan
rCincinnati Children’s Hospital Medical Center, Cincinnati, Ohio;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth C. Powell
sAnn and Robert H. Lurie Children's Hospital of Chicago, Chicago, Illinois; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexander Rogers
tUniversity of Michigan, Ann Arbor, Michigan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian Suffoletto
pUniversity of Pittsburg Medical Center Children’s Hospital of Pittsburgh and School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. Michael Dean
cUniversity of Utah, Salt Lake City, Utah;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anthony Spirito
aThe Warren Alpert Medical School, Brown University, Providence, Rhode Island;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • Comments
Loading
Download PDF

Abstract

BACKGROUND: The National Institute on Alcohol Abuse and Alcoholism (NIAAA) 2-question screen is a valid adolescent alcohol screening tool. No studies have examined if this tool predicts future alcohol problems. We conducted a study at 16 pediatric emergency departments to determine the tool’s predictive validity for alcohol misuse and alcohol use disorders (AUDs).

METHODS: Participants (N = 4834) completed a baseline assessment battery. A subsample of participants completed the battery at 1, 2, and 3 years follow up.

RESULTS: Of the 2209 participants assigned to follow-up, 1611 (73%) completed a 1-year follow-up, 1591 (72%) completed a 2-year follow-up, and 1377 (62%) completed a 3-year follow-up. The differences in AUDs between baseline NIAAA screen nondrinkers and lower-risk drinkers were statistically significant at 1 year (P = .0002), 2 years (P <.0001), and 3 years (P = .0005), as were the differences between moderate- and highest-risk drinkers at 1 and 2 years (P < .0001 and P = .0088, respectively) but not at 3 years (P = .0758). The best combined score for sensitivity (86.2% at 1 year, 75.6% at 2 years, and 60.0% at 3 years) and specificity (78.1% at 1 year, 79.2% at 2 years, and 80.0% at 3 years) was achieved by using “lower risk” and higher as a cutoff for the prediction of a Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition diagnosis.

CONCLUSIONS: The NIAAA 2-question screen can accurately characterize adolescent risk for future AUDs. Future studies are needed to determine optimaluse of the screen.

  • Abbreviations:
    AUC —
    area under the curve
    AUD —
    alcohol use disorder
    CI —
    confidence interval
    DISC —
    Diagnostic Interview Schedule for Children
    DSM-5 —
    Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
    NIAAA —
    National Institute on Alcohol Abuse and Alcoholism
    PECARN —
    Pediatric Emergency Care Applied Research Network
    PED —
    pediatric emergency department
    ROC —
    receiver operating characteristic
  • What’s Known on This Subject:

    The early identification of youth with alcohol problems is strongly recommended and the pediatric emergency department is one avenue to identify and intervene. The National Institute on Alcohol Abuse and Alcoholism 2-question screen is 1 brief and valid tool.

    What This Study Adds:

    In this study, we determine the predictive value of the National Institute on Alcohol Abuse and Alcoholism 2-question screen. In this article, we report on the 1-, 2-, and 3-year predictive validity of the screen for alcohol use and alcohol use disorders.

    The early identification of adolescents who are at high risk may be an important step in preventing the escalation of adolescent alcohol use and misuse and the eventual development of alcohol use disorders (AUDs) and their sequelae.1 Screening, brief intervention, and referral to treatment (SBIRT) is awell-recognized strategy for addressing this problem and is widely recommended by federal and professional organizations.2–6 Although a number of alcohol screening tools exist,7 the National Institute on Alcohol Abuse and Alcoholism (NIAAA) recommends the use of a brief adolescent alcohol screen that is used to ask about a patient’s drinking frequency and their friends’ drinking.1 The authors and others have previously reported that this NIAAA 2-question screen is a valid approach to alcohol screening that is briefer than most comparable screens.8–10 Categorizing youth as moderate or higher risk on the NIAAA 2-question screen had high sensitivity and specificity for determining concurrent mild-to-severe AUDs as defined by the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). The DSM-5 can be used to specifically query for 11 alcohol abuse criteria, and the presence of ≥2 of these criteria indicates an AUD. The DSM-5 is generally considered the gold standard for the diagnosis of substance use disorders and was used as such in our present and earlier studies. A positive response to 1 item (drinker versus nondrinker) on the NIAAA 2-question screen for middle school students and, for high school students, to ≥2 drinking days over the past year also had high sensitivity and specificity for an Alcohol Use Disorders Identification Test11–13 score of 4, which is a frequently used cutoff for diagnosing adolescent AUDs. In our earlier study,8 we used the Alcohol Use Disorders Identification Test (AUDIT) to evaluate the convergent validity of the NIAAA 2-question screen.

    Existing psychometric data on the NIAAA 2-question screen are encouraging, and preliminary analyses of the individual questions revealed that the screen may be an effective predictor of future alcohol problems.14,15 The purpose of this study was to determine the predictive validity of the NIAAA 2-question screen with respect to future alcohol use and misuse in adolescents who present to the pediatric emergency department (PED). Specifically, we investigated predictions of the number of adolescent drinking days and DSM-5–based AUDs at 1, 2, and 3 years after the screen’s administration during a PED visit.

    Methods

    Enrollment took place across a 25-month period from May 2013 to June 2015. A criterion assessment battery was self-administered on a tablet computer by participants 12 to 17 years of age who were treated for a nonlife-threatening injury, illness, or mental health condition in 1 of 16 PEDs that belonged to the Pediatric Emergency Care Applied Research Network (PECARN). Institutional review board approval was obtained at all sites before beginning study enrollment. After obtaining informed parental consent and adolescent assent, participants completed the assessment battery that consisted of the NIAAA 2-question screen16 and other measures of substance use and risk behavior, including the number of drinking days in the past year and the Diagnostic Interview Schedule for Children (DISC),17 which is a structured, DSM-5–based interview used to determine alcohol-use diagnoses. For adolescents who report not drinking alcohol, the DISC can be administered in <1 minute; however, depending on the amount of drinking and the scope of drinking-based problems, it can take ≥20 minutes. The questions on the NIAAA 2-question screen differ slightly for middle school and high school students and are used to categorize patients as nondrinkers, lower risk, moderate risk or highest risk.1 For middle school ages, the participant is asked, “Do you have any friends who drank beer, wine, or any drink containing alcohol in the past year?” This is followed by, “How about you? In the past year, on how many days have you had more than a few sips of beer, wine, or any drink containing alcohol?” For high school ages, the participant is first asked, “In the past year, on how many days have you had more than a few sips of beer, wine, or any drink containing alcohol?” Then the participant is asked, “If your friends drink, how many drinks do they usually drink on an occasion?” Participants <16 years of age who consumed alcohol in the past year are classified as either moderate risk or highest risk, depending on their level of drinking, whereas participants aged ≥16 years with past-year drinking are classified as lower risk, moderate risk, or highest risk. A subsample of our original sample was randomly selected to be readministered the criterion assessment battery at 1-, 2-, and 3-year follow-up to examine the predictive validity of the 2-question screen. Follow-up assessments were completed by March 2018. Participants received a $10 gift card for the baseline survey and a $25 gift card for each annual follow-up survey. The original study methodology is detailed in an earlier article.18

    The sensitivity for predicting problematic alcohol use was used as the basis for our sample size requirements. We assumed a target sensitivity of 90%. For the 95% confidence intervals (CIs) around sensitivity to be within ±5%, ∼1600 participants with outcome data would be needed. We planned for ∼20% to 30% attrition. All analyses were performed by using SAS Version 9.4 (SAS Institute, Inc, Cary, NC).

    The number of drinking days in the past year at 1-, 2-, and 3-year follow-up was compared across baseline NIAAA risk categories by using the Kruskal-Wallis test. Predictive validity was examined via a logistic regression model that we used to compare the odds of a DISC diagnosis against a baseline risk category on the NIAAA 2-question screen. Differences in DISC diagnosis of AUD19 (yes or no) between levels that represented a single change in baseline NIAAA risk categorization (nondrinker versus low risk, low versus moderate risk, and moderate versus high risk) were tested with the Wald test. The Cochran-Armitage test was used to examine the trend to receive a DISC diagnosis across all of the screen categories. Receiver operating characteristic (ROC) curve methods were then used to examine the characteristics of the baseline NIAAA 2-question screen for predicting a DISC diagnosis at 1-, 2-, or 3-year follow-up by using various cut points. With this methodology, sensitivity measured the probability that the 2-question screen appropriately categorized participants with a DISC diagnosis of an AUD, whereas specificity measured the probability that the 2-question screen appropriately categorized participants who did not have a DISC diagnosis of an AUD. We defined the optimal cut point as the point at which the sum of sensitivity and specificity was maximized. Test characteristics were calculated at each potential cut point, and the area under the curve (AUC) was used to provide an assessment of the overall accuracy of the screen in predicting DISC diagnoses. These analyses were performed for 1-, 2-, and 3-year follow-up time points.

    Results

    Out of our original baseline sample of 4834 participants, a total of 2209 participants were randomly selected for 1-, 2-, and 3-year follow-up. Of those 2209 participants, 1611 (73%) completed a 1-year follow-up, 1591 (72%) completed a 2-year follow-up, and 1377 (62%) completed a 3-year follow-up. The race and ethnicity of participants at baseline (broken down by age and sex) are shown in Table 1. Participants were equally distributed across sex and age. Demographic characteristics are nearly identical to those of the previously reported full cohort.18 We were able to determine DISC AUD diagnoses for 1549 participants at 1-year follow-up, 1524 participants at 2-year follow-up, and 1314 participants at 3-year follow-up. Demographics of the follow-up sample were significantly different for biological sex (P = .009) and race (P < .001). Female participants were more likely than male participants to complete follow-up, and white and Asian American participants were more likely to complete follow-up compared with those of other races.

    View this table:
    • View inline
    • View popup
    TABLE 1

    Baseline Demographics

    NIAAA Assessment and Past-Year Drinking

    A comparison of the baseline NIAAA risk level of each participant and their reported number of past-year drinking days at 1-, 2-, and 3-year follow-up is shown in Table 2. Those participants who were classified as nondrinkers at baseline had the fewest drinking days at 1-, 2-, and 3-year follow-up, whereas those who were assessed to be at highest risk at baseline had the highest number of drinking days at 1-, 2-, and 3-year follow-up. Participants who were at lower and moderate risk reported a distribution of drinking days that fell between nondrinkers and those at highest risk, but there was little difference between participants who were at lower and moderate risk. In general, the number of drinking days was higher at 2 years than at 1 year across all groups, and it was higher yet at 3 years.

    View this table:
    • View inline
    • View popup
    TABLE 2

    Baseline NIAAA Risk Assessment Versus Drinking Days at Follow-up

    Predictive Validity

    In Table 3, we summarize the DSM-5 diagnoses of AUD on the DISC at 1-, 2-, and 3-year follow-up by categories of the NIAAA risk level at baseline. The differences between both nondrinkers and participants who were at lower risk and between those at moderate risk and highest risk were statistically significant at 1 year (P = .0002), 2 years (P < .0001), and 3 years (P = .0005), whereas the rate of diagnoses of AUD on the DISC was similar between lower and moderate risk. The differences between the moderate-risk group and the highest-risk group were significant at 1-year follow-up (P < .0001) and 2-year follow-up (P = .0088) but not at 3-year follow-up (P = .0758). In Fig 1, we demonstrate the predictive ability of the 2-question screen with reference to DSM-5 diagnoses in ROC format. The best combined sensitivity and specificity score was achieved by using “lower risk” and higher as a cutoff for all 3 years. This resulted in a sensitivity score of 86% (95% CI: 74%–99%) at 1 year, 76% (95% CI: 63%–88%) at 2 years, and 60% (95% CI: 47%–73%) at 3 years, and it resulted in a specificity score of 78% (95% CI: 76%–80%) at 1 year, 79% (95% CI: 77%–81%) at 2 years, and 80% (95% CI: 78%–82%) at 3 years. Overall, the predictive characteristics were comparable for 1-year AUD diagnoses (AUC 0.862) and 2-year AUD diagnoses (AUC 0.795), with a somewhat lower figure for 3 years (AUC 0.711).

    View this table:
    • View inline
    • View popup
    TABLE 3

    Distribution of DSM-5 Diagnoses of AUD at Follow-up and NIAAA 2-Question Screen Risk Assessment at Baseline

    FIGURE 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 1

    ROC curve for the NIAAA 2-question screen when predicting DSM-5 diagnoses at follow-up. NPV, net present value; PPV, positive predictive value.

    Discussion

    Both medical and federal organizations have recommended screening and behavioral counseling interventions to reduce alcohol misuse and have developed resources to support the implementation of these services. In a recent study of US hospitals that treat injured adolescents, only 18% reported providing universal alcohol screening for their adolescent emergency department patients.20 This same study revealed that 31% of the US hospitals that were surveyed did not use a standardized screening instrument but rather incorporated alcohol questions into their general hospital assessments. A brief screen, such as the NIAAA 2-question screen, might significantly contribute to a more widespread adoption of screening.

    This multisite assessment study of the predictive validity of the NIAAA 2-question screen revealed that the screen had acceptable sensitivity and specificity with respect to a DSM-5 diagnosis of AUD 1, 2, and 3 years after its original administration. The unique contribution of this study was the 3-year follow-up period and our ability to examine long-term prediction in this sample. The best combined sensitivity and specificity scores were achieved by using “lower risk” and higher as a cutoff for the prediction of a DSM-5 diagnosis at 1 year (sensitivity = 86.2%; specificity = 78.1%), 2 years (sensitivity = 75.6%; specificity = 79.2%), and 3 years (sensitivity = 60.0%; specificity = 80.0%). The areas under the curve of the DSM-5 diagnosis ROC at 1- and 2-year follow-up compared favorably to those we found for an AUD diagnosis cross-sectionally18; the ROC findings were weaker by 3 years. Although prediction at 1 year might be of most interest to the primary care physician because screening is typically repeated at annual visits, the fact that the NIAAA 2-question screener has comparable relevance for prediction over 2 years adds to our understanding of the use of alcohol-use screening in the PED.

    Adolescents who initially screened as being at highest risk on the NIAAA 2-question screen were shown to be more likely to have a higher number of drinking days and to be at higher risk for AUD at 1, 2, and 3 years. However, it is noteworthy that the predictive ability of the 2-question screen does not differentiate between those who initially screen as being at lower risk and those who screen as being at moderate risk. It appears that at lower numbers of drinking days, the screen is less effective in estimating future risk level. This may be related to the fact that the risk assessment algorithm for the NIAAA 2-question screen1 is based on age, and for 12- to 15-year-old adolescents, any drinking is categorized as at least moderate risk (ie, there is no possibility of being categorized as lower risk in this age group). Because a significant portion of our sample fell into this younger age group, this reduced the likelihood of discerning differences between the lower- and moderate-risk groups even if they existed.

    Research has revealed that over the course of adolescence, the proportion of individuals who report past-year alcohol use increases dramatically, from 17.6% of eighth-graders to 56% of 12th-graders nationwide.21 In our study, at 3-year follow-up, many participants in the lower-risk baseline group would have been at least 18 years of age and might “normally” be expected to be engaged in riskier drinking. This also likely explains the finding that the number of drinking days increased from 1- to 3-year follow-up for all of the baseline risk groups because this appears to represent the “normal” age-based trajectory (ie, prevalence increases). Because we followed the same participants from the time of enrollment through the 3-year follow-up contact, it would be expected that drinking rates would have increased over that time, and hence these data also contribute to our understanding of the natural history of adolescent alcohol use.

    Our findings suggest that the NIAAA 2-question screen may offer a viable first step for screening adolescents who may be at risk for the development of an AUD. In this study (and typically in clinical practice) most adolescents who are screened in this manner will screen with negative results, and, at least in the PED setting, further action would be unnecessary. By using our results as a starting point, an assessment of the consequences of screening can be estimated. For example, using the optimal cutoff from the ROC curve, we would expect about 20 false alarms (patients who have positive results on the screen but do not go on to develop an AUD within 3 years) out of every 100 patients who were screened. Stated another way, because 23% of our participants screened with positive results on the NIAAA screen and 11.6% of those participants exhibited an AUD at the 3-year follow-up, it would be expected that 38 adolescents would need to be screened to detect 1 participant with positive results. Although on first glance this appears to be a relatively modest return, the brevity of the screening process and the potential impact may argue in favor of screening.

    Our findings differ somewhat from those of a recent cross-sectional study22 of adolescents who were screened in primary care clinics, which found age differences in the cutoff score for risk of an AUD. The differential findings might be related to the different settings and/or the cross-sectional versus longitudinal nature of the 2 studies. Nonetheless, the ideal approach for responding to positive results on a screen (lower-risk category or higher) remains to be determined and is likely to vary from 1 setting or 1 PED to another, depending on a number of factors, including the availability of resources. In some resource-intensive settings, a positive response might initiate a more in-depth investigation into the adolescent’s alcohol use either through direct questioning or a more thorough self-report assessment. Although this approach may vary by setting, the ultimate purpose would be to aid decisions about further evaluation and referral to treatment. In fact, researchers in a number of studies have evaluated brief interventions that could potentially be administered in the PED setting.23–30 Additional studies will be required to determine the most effective means for screening, the best process for delivering a brief intervention in the PED when called for, and the circumstances in which referral to further treatment is appropriate.

    There are a number of limitations to this study. First, although the sample was large and diverse, PECARN PEDs are generally based in urban medical centers and may not be representative of US PEDs. Similarly, it is conceivable that those who refused participation in the study differed in some systematic way from those who agreed to participate. Follow-up rates were in the 70% range, thereby allowing for the possibility that those who did not respond to follow-up may systematically differ from the group reported here. Also, measures in the current study were self-administered, and thus we do not know whether the screen would perform differently if administered directly by a health care provider. Importantly, however, self-administered screening for sensitive questions has been shown to be more accurate than face-to-face screening31,32 and should be considered in clinical practice. In addition, because the study required parental permission, adolescent reports of substance use may have been affected despite our reassurances that responses were confidential. Finally (as noted above), the 2-question screen is used to risk stratify the number of drinks in the past year differently for younger adolescents than for older adolescents. This presents some challenges when adolescents are followed longitudinally.

    Conclusions

    The NIAAA 2-question screen has acceptable predictive validity for alcohol use and AUDs at 1, 2, and 3 years of follow-up. The brevity of this screen makes it ideal for use in a PED. Risk categorization on the NIAAA 2-question screen is primarily a function of age and the number of drinking days in the past year, and findings suggest that reporting any drinking days puts an adolescent at risk for a future AUD. The NIAAA screen guide suggests that providers also query middle school adolescents regarding the nature of friends’ alcohol use as well as other risk factors, which allows for a more nuanced decision-making process when determining risk categories in this age group. In future studies, researchers might examine ways to refine the predictive validity for adolescents who report lower numbers of drinking days. The predictive validity with respect to other substance use and behavioral outcomes would also be of interest. Additionally, studies are needed to determine how the screen can be optimally used in the PED to promote both preventive interventions and intervention for those who are identified as being at risk.

    Acknowledgments

    We acknowledge PECARN, PECARN Steering Committee members, staff at the Data Coordinating Center, and the participating PECARN sites, which include the following: Baylor College of Medicine and Texas Children’s Hospital; Boston Children’s Hospital; Children’s Hospital of Philadelphia; Children’s National Health System; Cincinnati Children’s Hospital Medical Center; Columbia University and Morgan Stanley Children’s Hospital of New York-Presbyterian; Hasbro Children’s Hospital; Ann & Robert H. Lurie Children's Hospital of Chicago; Medical College of Wisconsin; Nationwide Children’s Hospital; Sidney Kimmel Medical College and Nemours/Alfred I. duPont Hospital for Children; St. Louis Children’s Hospital and Washington University in St Louis; University of California, Davis; Children’s Hospital Colorado; Michigan Medicine and the University of Michigan; and the University of Pittsburgh and University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh. Our efforts would not have been possible without the commitment of the investigators and research coordinators from these sites. Lastly, the authors thank the participants and their parents for participating in this study.

    Footnotes

      • Accepted December 13, 2018.
    • Address correspondence to James G. Linakis, PhD, MD, Department of Emergency Medicine, Rhode Island Hospital, 55 Claverick St, 2nd Floor, Providence, RI 02903. E-mail: james_linakis_phd{at}brown.edu
    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: Supported in part by the National Institute on Alcohol Abuse and Alcoholism (1R01AA021900; Drs Spirito and Linakis). This project is supported in part by the Health Resources and Services Administration, the Maternal and Child Health Bureau, and the Emergency Medical Services for Children Network Development Demonstration Project under cooperative agreements U03MC00008, U03MC00001, U03MC00003, U03MC00006, U03MC00007, U03MC22684, and U03MC22685. This information and/or content and conclusions are those of the authors and should not be construed as the official position or policy of the Health Resources and Services Administration, the US Department of Health and Human Services, or the US government, nor should any endorsements from these entities be inferred. Funded by the National Institutes of Health (NIH).

    • POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

    • COMPANION PAPER: A companion to this article can be found online at www.pediatrics.org/cgi/doi/10.1542/peds.2018-3654.

    References

    1. ↵
      1. National Institute on Alcohol Abuse and Alcoholism
      . Alcohol screening and brief intervention for youth: a practitioner’s guide. 2011. Available at: www.niaaa.nih.gov/YouthGuide. Accessed December 15, 2017
    2. ↵
      1. Kokotailo PK; Committee on Substance Abuse
      . Alcohol use by youth and adolescents: a pediatric concern. Pediatrics. 2010;125(5):1078–1087pmid:20385640
      OpenUrlAbstract/FREE Full Text
      1. American College of Emergency Physicians
      . Alcohol screening in the emergency department policy statement. 2011. Available at: https://www.acep.org/patient-care/policy-statements/alcohol-screening-in-the-emergency-department. Accessed January 13, 2019
      1. American College of Surgeons Committee on Trauma
      . Resources for optimal care of the injured patient, Sixth Edition. 2014. Available at: www.facs.org/quality-programs/trauma/tqp/center-programs/vrc. Accessed January 13, 2019
      1. Substance Abuse and Mental Health Services Administration.
      Screening, brief intervention and referral to treatment. 2017. Available at: www.samhsa.gov/sbirt. Accessed January 13, 2019
    3. ↵
      1. Higgins-Biddle J,
      2. Hungerford D,
      3. Cates-Wessel K
      . Screening and Brief Intervention (SBI) for Unhealthy Alcohol Use: A Step-By-Step Implementation Guide for Trauma Centers. Atlanta, GA: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control; 2009
    4. ↵
      1. Levy SJ,
      2. Williams JF; Committee on Substance Use and Prevention
      . Substance use screening, brief intervention, and referral to treatment. Pediatrics. 2016;138(1):e20161211pmid:27325634
      OpenUrlAbstract/FREE Full Text
    5. ↵
      1. Spirito A,
      2. Bromberg JR,
      3. Casper TC, et al; Pediatric Emergency Care Applied Research Network
      . Reliability and validity of a two-question alcohol screen in the pediatric emergency department. Pediatrics. 2016;138(6):e20160691pmid:27940674
      OpenUrlAbstract/FREE Full Text
      1. D’Amico EJ,
      2. Parast L,
      3. Meredith LS,
      4. Ewing BA,
      5. Shadel WG,
      6. Stein BD
      . Screening in primary care: what is the best way to identify at-risk youth for substance use? Pediatrics. 2016;138(6):e20161717pmid:27940696
      OpenUrlAbstract/FREE Full Text
    6. ↵
      1. Levy S,
      2. Dedeoglu F,
      3. Gaffin JM, et al
      . A screening tool for assessing alcohol use risk among medically vulnerable youth. PLoS One. 2016;11(5):e0156240pmid:27227975
      OpenUrlPubMed
    7. ↵
      1. Chung T,
      2. Colby SM,
      3. Barnett NP,
      4. Monti PM
      . Alcohol use disorders identification test: factor structure in an adolescent emergency department sample. Alcohol Clin Exp Res. 2002;26(2):223–231pmid:11964562
      OpenUrlCrossRefPubMed
      1. Chung T,
      2. Colby SM,
      3. Barnett NP,
      4. Rohsenow DJ,
      5. Spirito A,
      6. Monti PM
      . Screening adolescents for problem drinking: performance of brief screens against DSM-IV alcohol diagnoses. J Stud Alcohol. 2000;61(4):579–587pmid:10928728
      OpenUrlCrossRefPubMed
    8. ↵
      1. Fairlie AM,
      2. Sindelar HA,
      3. Eaton CA,
      4. Spirito A
      . Utility of the AUDIT for screening adolescents for problematic alcohol use in the emergency department. Int J Adolesc Med Health. 2006;18(1):115–122pmid:16639865
      OpenUrlPubMed
    9. ↵
      1. Chung T,
      2. Smith GT,
      3. Donovan JE, et al
      . Drinking frequency as a brief screen for adolescent alcohol problems. Pediatrics. 2012;129(2):205–212pmid:22218839
      OpenUrlAbstract/FREE Full Text
    10. ↵
      1. Brown S,
      2. Donovan J,
      3. McGue M,
      4. Shulenberg J,
      5. Zucker R,
      6. Goldman M
      . Youth alcohol screening workgroup II: determining optimal secondary screening questions [abstract]. Alcohol Clin Exp Res. 2010;34(suppl 2):267A
      OpenUrl
    11. ↵
      1. National Institute on Alcohol Abuse and Alcoholism
      . Alcohol Screening and Brief Intervention for Youth: A Practitioner’s Guide. Bethesda, MD: National Institutes of Health; 2011
    12. ↵
      1. Fisher PW,
      2. Shaffer D,
      3. Piacentini JC, et al
      . Sensitivity of the Diagnostic Interview Schedule for Children, 2nd edition (DISC-2.1) for specific diagnoses of children and adolescents. J Am Acad Child Adolesc Psychiatry. 1993;32(3):666–673
      OpenUrlCrossRefPubMed
    13. ↵
      1. Bromberg JR,
      2. Spirito A,
      3. Chun T, et al; Pediatric Emergency Care Applied Research Network
      . Methodology and demographics of a brief adolescent alcohol screen validation study [published online ahead of print July 3, 2017]. Pediatr Emerg Care. doi:10.1097/PEC.0000000000001221pmid:29112110
      OpenUrlCrossRefPubMed
    14. ↵
      1. American Psychiatric Association
      . Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Washington, DC: American Psychiatric Association Publishing; 2013
    15. ↵
      1. Schweer LH
      . Pediatric SBIRT: understanding the magnitude of the problem. J Trauma Nurs. 2009;16(3):142–147pmid:19888019
      OpenUrlPubMed
    16. ↵
      1. Johnston LD,
      2. O’Malley PM,
      3. Miech RA,
      4. Bachman JG,
      5. Schulenberg JE
      . Monitoring the Future National Survey Results on Drug Use, 1975-2016: Overview, Key Findings on Adolescent Drug Use. Ann Arbor, MI: Institute for Social Research, The University of Michigan; 2017
    17. ↵
      1. Parast L,
      2. Meredith LS,
      3. Stein BD,
      4. Shadel WG,
      5. D’Amico EJ
      . Identifying adolescents with alcohol use disorder: optimal screening using the National Institute on Alcohol Abuse and Alcoholism screening guide. Psychol Addict Behav. 2018;32(5):508–516pmid:29975071
      OpenUrlPubMed
    18. ↵
      1. Bernstein E,
      2. Edwards E,
      3. Dorfman D,
      4. Heeren T,
      5. Bliss C,
      6. Bernstein J
      . Screening and brief intervention to reduce marijuana use among youth and young adults in a pediatric emergency department. Acad Emerg Med. 2009;16(11):1174–1185pmid:20053238
      OpenUrlCrossRefPubMed
      1. Monti PM,
      2. Colby SM,
      3. Barnett NP, et al
      . Brief intervention for harm reduction with alcohol-positive older adolescents in a hospital emergency department. J Consult Clin Psychol. 1999;67(6):989–994pmid:10596521
      OpenUrlCrossRefPubMed
      1. Spirito A,
      2. Monti PM,
      3. Barnett NP, et al
      . A randomized clinical trial of a brief motivational intervention for alcohol-positive adolescents treated in an emergency department. J Pediatr. 2004;145(3):396–402pmid:15343198
      OpenUrlCrossRefPubMed
      1. Walton MA,
      2. Chermack ST,
      3. Shope JT, et al
      . Effects of a brief intervention for reducing violence and alcohol misuse among adolescents: a randomized controlled trial. JAMA. 2010;304(5):527–535pmid:20682932
      OpenUrlCrossRefPubMed
      1. Newton AS,
      2. Dong K,
      3. Mabood N, et al
      . Brief emergency department interventions for youth who use alcohol and other drugs: a systematic review. Pediatr Emerg Care. 2013;29(5):673–684pmid:23640153
      OpenUrlCrossRefPubMed
      1. D’Amico EJ,
      2. Parast L,
      3. Shadel WG,
      4. Meredith LS,
      5. Seelam R,
      6. Stein BD
      . Brief motivational interviewing intervention to reduce alcohol and marijuana use for at-risk adolescents in primary care. J Consult Clin Psychol. 2018;86(9):775–786pmid:30138016
      OpenUrlPubMed
      1. Walton MA,
      2. Bohnert K,
      3. Resko S, et al
      . Computer and therapist based brief interventions among cannabis-using adolescents presenting to primary care: one year outcomes. Drug Alcohol Depend. 2013;132(3):646–653pmid:23711998
      OpenUrlCrossRefPubMed
    19. ↵
      1. Cunningham RM,
      2. Chermack ST,
      3. Ehrlich PF, et al
      . Alcohol interventions among underage drinkers in the ED: a randomized controlled trial. Pediatrics. 2015;136(4). Available at: www.pediatrics.org/cgi/content/full/136/4/e783pmid:26347440
      OpenUrlAbstract/FREE Full Text
    20. ↵
      1. Hussain N,
      2. Sprague S,
      3. Madden K,
      4. Hussain FN,
      5. Pindiprolu B,
      6. Bhandari M
      . A comparison of the types of screening tool administration methods used for the detection of intimate partner violence: a systematic review and meta-analysis. Trauma Violence Abuse. 2015;16(1):60–69pmid:24343478
      OpenUrlCrossRefPubMed
    21. ↵
      1. Klevens J,
      2. Sadowski L,
      3. Kee R,
      4. Trick W,
      5. Garcia D
      . Comparison of screening and referral strategies for exposure to partner violence. Womens Health Issues. 2012;22(1):e45–e52pmid:21798763
      OpenUrlCrossRefPubMed
    • Copyright © 2019 by the American Academy of Pediatrics
    PreviousNext
    Back to top

    Advertising Disclaimer »

    In this issue

    Pediatrics
    Vol. 143, Issue 3
    1 Mar 2019
    • Table of Contents
    • Index by author
    View this article with LENS
    PreviousNext
    Email Article

    Thank you for your interest in spreading the word on American Academy of Pediatrics.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    Predictive Validity of a 2-Question Alcohol Screen at 1-, 2-, and 3-Year Follow-up
    (Your Name) has sent you a message from American Academy of Pediatrics
    (Your Name) thought you would like to see the American Academy of Pediatrics web site.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Request Permissions
    Article Alerts
    Log in
    You will be redirected to aap.org to login or to create your account.
    Or Sign In to Email Alerts with your Email Address
    Citation Tools
    Predictive Validity of a 2-Question Alcohol Screen at 1-, 2-, and 3-Year Follow-up
    James G. Linakis, Julie R. Bromberg, T. Charles Casper, Thomas H. Chun, Michael J. Mello, Rachel Richards, Colette C. Mull, Rohit P. Shenoi, Cheryl Vance, Fahd Ahmad, Lalit Bajaj, Kathleen M. Brown, Lauren S. Chernick, Daniel M. Cohen, Joel Fein, Timothy Horeczko, Michael N. Levas, Brett McAninch, Michael C. Monuteaux, Jackie Grupp-Phelan, Elizabeth C. Powell, Alexander Rogers, Brian Suffoletto, J. Michael Dean, Anthony Spirito, for the Pediatric Emergency Care Applied Research Network
    Pediatrics Mar 2019, 143 (3) e20182001; DOI: 10.1542/peds.2018-2001

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    Predictive Validity of a 2-Question Alcohol Screen at 1-, 2-, and 3-Year Follow-up
    James G. Linakis, Julie R. Bromberg, T. Charles Casper, Thomas H. Chun, Michael J. Mello, Rachel Richards, Colette C. Mull, Rohit P. Shenoi, Cheryl Vance, Fahd Ahmad, Lalit Bajaj, Kathleen M. Brown, Lauren S. Chernick, Daniel M. Cohen, Joel Fein, Timothy Horeczko, Michael N. Levas, Brett McAninch, Michael C. Monuteaux, Jackie Grupp-Phelan, Elizabeth C. Powell, Alexander Rogers, Brian Suffoletto, J. Michael Dean, Anthony Spirito, for the Pediatric Emergency Care Applied Research Network
    Pediatrics Mar 2019, 143 (3) e20182001; DOI: 10.1542/peds.2018-2001
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    Print
    Download PDF
    Insight Alerts
    • Table of Contents

    Jump to section

    • Article
      • Abstract
      • Methods
      • Results
      • Discussion
      • Conclusions
      • Acknowledgments
      • Footnotes
      • References
    • Figures & Data
    • Info & Metrics
    • Comments

    Related Articles

    • No related articles found.
    • PubMed
    • Google Scholar

    Cited By...

    • Predictive Validity of the CRAFFT for Substance Use Disorder
    • Alcohol Use Disorder: A Pediatric-Onset Condition Needing Early Detection and Intervention
    • Alcohol Use Disorder: A Pediatric-Onset Condition Needing Early Detection and Intervention
    • Google Scholar

    More in this TOC Section

    • Severe Acute Neurologic Involvement in Children With Hemolytic-Uremic Syndrome
    • Hospitals’ Diversity of Diagnosis Groups and Associated Costs of Care
    • A Prevention Program for Insomnia in At-risk Adolescents: A Randomized Controlled Study
    Show more Article

    Similar Articles

    Subjects

    • Substance Use
      • Substance Use
    • Adolescent Health/Medicine
      • Adolescent Health/Medicine
    • Journal Info
    • Editorial Board
    • Editorial Policies
    • Overview
    • Licensing Information
    • Authors/Reviewers
    • Author Guidelines
    • Submit My Manuscript
    • Open Access
    • Reviewer Guidelines
    • Librarians
    • Institutional Subscriptions
    • Usage Stats
    • Support
    • Contact Us
    • Subscribe
    • Resources
    • Media Kit
    • About
    • International Access
    • Terms of Use
    • Privacy Statement
    • FAQ
    • AAP.org
    • shopAAP
    • Follow American Academy of Pediatrics on Instagram
    • Visit American Academy of Pediatrics on Facebook
    • Follow American Academy of Pediatrics on Twitter
    • Follow American Academy of Pediatrics on Youtube
    • RSS
    American Academy of Pediatrics

    © 2021 American Academy of Pediatrics