Skip to main content

Advertising Disclaimer »

Main menu

  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers
  • Other Publications
    • American Academy of Pediatrics

User menu

  • Log in
  • My Cart

Search

  • Advanced search
American Academy of Pediatrics

AAP Gateway

Advanced Search

AAP Logo

  • Log in
  • My Cart
  • Journals
    • Pediatrics
    • Hospital Pediatrics
    • Pediatrics in Review
    • NeoReviews
    • AAP Grand Rounds
    • AAP News
  • Authors/Reviewers
    • Submit Manuscript
    • Author Guidelines
    • Reviewer Guidelines
    • Open Access
    • Editorial Policies
  • Content
    • Current Issue
    • Online First
    • Archive
    • Blogs
    • Topic/Program Collections
    • AAP Meeting Abstracts
  • Pediatric Collections
    • COVID-19
    • Racism and Its Effects on Pediatric Health
    • More Collections...
  • AAP Policy
  • Supplements
  • Multimedia
    • Video Abstracts
    • Pediatrics On Call Podcast
  • Subscribe
  • Alerts
  • Careers

Discover Pediatric Collections on COVID-19 and Racism and Its Effects on Pediatric Health

American Academy of Pediatrics
Review Article

Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review

Kelly L. L’Engle, Emily R. Mangone, Angela M. Parcesepe, Smisha Agarwal and Nicole B. Ippoliti
Pediatrics September 2016, 138 (3) e20160884; DOI: https://doi.org/10.1542/peds.2016-0884
Kelly L. L’Engle
aSchool of Nursing and Health Professions, University of San Francisco, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily R. Mangone
bGillings School of Global Public Health, University of North Carolina Chapel Hill, Chapel Hill, North Carolina;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Angela M. Parcesepe
cHIV Center for Clinical and Behavioral Studies, Columbia University and New York State Psychiatric Institute, New York, New York;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Smisha Agarwal
bGillings School of Global Public Health, University of North Carolina Chapel Hill, Chapel Hill, North Carolina;
dDepartment of International Health Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicole B. Ippoliti
eFHI 360, Durham, North Carolina
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Comments
Loading
Download PDF

Abstract

CONTEXT: Interventions for adolescent sexual and reproductive health (ASRH) are increasingly using mobile phones but may not effectively report evidence.

OBJECTIVE: To assess strategies, findings, and quality of evidence on using mobile phones to improve ASRH by using the mHealth Evidence Reporting and Assessment (mERA) checklist recently published by the World Health Organization mHealth Technical Evidence Review Group.

DATA SOURCES: Systematic searches of 8 databases for peer-reviewed studies published January 2000 through August 2014.

STUDY SELECTION: Eligible studies targeted adolescents ages 10 to 24 and provided results from mobile phone interventions designed to improve ASRH.

DATA EXTRACTION: Studies were evaluated according to the mERA checklist, covering essential mHealth criteria and methodological reporting criteria.

RESULTS: Thirty-five articles met inclusion criteria. Studies reported on 28 programs operating at multiple levels of the health care system in 7 countries. Most programs (82%) used text messages. An average of 41% of essential mHealth criteria were met (range 14%–79%). An average of 82% of methodological reporting criteria were met (range 52%–100%). Evidence suggests that inclusion of text messaging in health promotion campaigns, sexually transmitted infection screening and follow-up, and medication adherence may lead to improved ASRH.

LIMITATIONS: Only 3 articles reported evidence from lower- or middle-income countries, so it is difficult to draw conclusions for these settings.

CONCLUSIONS: Evidence on mobile phone interventions for ASRH published in peer-reviewed journals reflects a high degree of quality in methods and reporting. In contrast, current reporting on essential mHealth criteria is insufficient for understanding, replicating, and scaling up mHealth interventions.

  • Abbreviations:
    ART —
    antiretroviral therapy
    ASRH —
    adolescent sexual and reproductive health
    HPV —
    human papillomavirus
    LIC —
    lower-income country
    m4RH —
    Mobile for Reproductive Health
    mERA —
    mHealth Evidence and Reporting Assessment
    mHealth —
    mobile phone interventions for health improvement
    PRISMA —
    Preferred Reporting Items for Systematic Review and Meta-Analyses
    RCT —
    randomized controlled trial
    SRH —
    sexual and reproductive health
    SMS —
    Short Message Service
    STI —
    sexually transmitted infection
  • Globally, mobile phone use is increasingly rapidly, and a large proportion of mobile phone subscribers are young people.1,2 Four of every 5 citizens in developed countries and 1 of every 2 citizens in developing countries have a mobile phone subscription.3 Young people ≤29 years of age are the most likely to own a mobile phone,2,4 and 15- to 24-year-olds are more likely than older age groups to own a smartphone, indicating this group’s eagerness to use new mobile technologies.2,5,6 Given their popularity among youth, adolescent health professionals are increasingly using mobile phones to link young people to health information and services across global settings.7–10

    This promising approach is called mHealth, the use of mobile phones to improve health knowledge, behaviors and outcomes, and it has advantages when used in health programming for young people. Adolescents commonly report low sexual and reproductive health (SRH) knowledge and risky sexual behaviors,11,12 but they also face barriers to care such as provider bias and fear of stigma, refusal, and embarrassment in seeking information and services.13–17 Mobile phone solutions may help overcome many of these barriers by providing accurate, timely, and engaging information and appropriate care for highly sensitive adolescent sexual and reproductive health (ASRH) topics. Mobile phones are inexpensive, portable, and accessible. They offer privacy in comparison with face-to-face meetings with health care providers, and they can provide young people with tailored and anonymous health information without stigma or judgment. Furthermore, young people are responsive to and excited about using new technologies for SRH promotion.18–21

    Better assessments of mHealth solutions for young people are needed to rigorously evaluate whether they are a viable and effective strategy for reaching adolescents and improving ASRH behaviors in particular. Although a few published reviews have examined digital health solutions to ASRH, none have focused exclusively on mobile phone interventions and used a comprehensive definition of ASRH.8–10 The goals of this research are to assess the strategies, findings, and reporting quality from evidence on mobile phone interventions for ASRH.

    We conducted a systematic review of research from peer-reviewed journal articles by using the new mHealth Evidence and Reporting Assessment (mERA) checklist.22 The checklist was developed by the World Health Organization mHealth Technical Evidence Review Group specifically to assess evidence from mobile phone intervention research for health improvement. The recently published mERA checklist is a valuable tool to assess the quality and completeness of intervention reporting for the many mHealth interventions for ASRH. Effective and comprehensive reporting may help improve program design, foster collaboration between service providers, reduce duplication of efforts, and ultimately increase the impact and ability to scale effective mHealth interventions for ASRH.

    Methods

    Search Strategy

    In August 2014 we searched 8 databases in the fields of medicine and social science: PubMed, Embase, Global Health, PsycINFO, Popline, Cochrane Library, Web of Science, and mHealthevidence.org. Search terms were grouped under 3 domains: adolescence, SRH, and mobile technology (Supplemental Table 6). Because our interest was in the intersection of these domains, the presence of ≥1 search term from each domain was required for inclusion. We also hand-searched the references of 21 relevant systematic reviews. Finally, we issued a global call for resources on mHealth interventions for ASRH, which was widely promoted via social media, relevant electronic mailing lists, and partner Web sites.

    Eligibility

    We took an inclusive approach and used the World Health Organization definition of young people ages 10 to 2423 and included peer-reviewed articles that either presented disaggregated data for young people 10 to 24 or did not disaggregate results but described the sample as having ≥70% of respondents between 10 and 24 years of age. We used the United Nations Family Planning Association definition of sexual and reproductive health,24 which includes contraception, antenatal care, delivery, postnatal care, infertility, abortion, reproductive tract infections, HIV/AIDS, sexually transmitted infections (STIs), sexuality, and violence against women and related practices (eg, female genital mutilation). Included articles also had to describe the use of a mobile device, such as a mobile phone or tablet, to provide SRH information and support, and describe results or feedback from the mobile technology intervention. Systematic reviews, gray literature, documents that were not in English, and documents published before January 1, 2000 were excluded.

    Literature Search Results

    The Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) flow diagram was used to document the search strategy and article selection process (Fig 1).25 A total of 5040 articles were retrieved from the 8 databases described above. After we removed duplicate articles and articles published before January 1, 2000, 2806 records remained.

    FIGURE 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 1

    PRISMA flow diagram of article inclusion.

    All 2806 titles and abstracts were screened and resulted in the exclusion of 2550 unique records; records could be excluded for multiple reasons. The full texts of the 256 remaining records were screened and resulted in the final inclusion of 35 articles. No additional articles meeting inclusion criteria were identified through the search of systematic reviews or through the global call for evidence.

    Two reviewers screened a random selection of 11% of all abstracts (n = 300 out of 2806) for inclusion in the study. There was 94% agreement on article inclusion between the reviewers. Another check was conducted for 20% of documents (n = 50 out of 256) at the full text level. Again, this resulted in a high interrater reliability agreement of 92%. When reviewers did not agree, a third reviewer was consulted to make the final determination about whether the article met eligibility criteria for inclusion.

    Data Extraction and Synthesis

    One reviewer extracted data from included studies and a second reviewer independently confirmed accuracy. Data extraction for each article included name of the mHealth intervention program, study design, population, and aim, and key results. Study design (for each individual article) and program purpose (for each unique mHealth program) were used as classification schemes for synthesizing data. Study designs were cataloged as randomized controlled trials (RCTs), quasiexperimental, observational, or descriptive research. Program purpose included health promotion campaign, curriculum addition, screening and follow-up service utilization, provider counseling, and patient adherence.

    Grading

    Evidence was graded according to the mERA checklist.22 The core checklist defines 14 essential mHealth criteria to support completeness of reporting and replication of the mHealth intervention by addressing its content, context, and implementation features (Supplemental Table 7). In addition, mERA also provides a checklist for reporting on study methods, because the field of mHealth includes a range of research designs and methods. This second checklist defines 30 core elements of research reporting required to facilitate the synthesis of mHealth research findings, regardless of study design (Supplemental Table 8).

    This manuscript is the first review of published literature to use the mERA checklist. Three reviewers were trained on the mERA checklist, and they graded 4 randomly selected articles to yield interrater reliability scores of 82%, 84%, 93%, and 95%, sequentially.

    Results

    Program Strategies

    The 35 articles reported on 28 different mHealth intervention programs where mobile phones were used to address ASRH. Three-quarters of all programs (n = 21) were implemented in the United States. Four were conducted in Australia or New Zealand, and 1 was conducted in the Netherlands. One program was implemented in Tanzania and 1 in the Democratic Republic of the Congo.

    Eight programs focused on pregnancy; 4 of these aimed to increase adoption and correct use of contraceptive methods,20,26–30 2 focused on youth assets and broader pregnancy prevention messaging,19,31 and 2 provided information to pregnant or parenting adolescents.32,33 STIs were the focus of 8 programs, with most of them targeting links to services for STI vaccination,34,35 screening,36,37 or treatment.10,34,38,39 Seven programs targeted general ASRH issues.40–47 Five mHealth programs specifically focused on HIV/AIDS; 3 of them provided adherence support for HIV-positive youth,48–51 and 2 focused on HIV prevention.18,43,52,53

    Health promotion campaigns were the most common purpose of mHealth programs for ASRH included in the review (43%; n = 12). These programs provided a mobile phone platform for youth to text SRH questions to health professionals,33,40,46,47 allowed adolescents to retrieve on-demand SRH content,20,30,44 and offered “push” messaging where SRH content was texted to adolescents on a regular schedule.21,32,41,43,45,51 Two programs complemented delivery of an in-person, evidence-based ASRH curriculum with a mobile phone component to extend program reach particularly to ethnic and minority youth and to stay current on the communication channels frequently used by young people.18,19,52,53

    The 7 mHealth programs for screening and follow-up service utilization included human papillomavirus (HPV) vaccination text message reminders for follow-up,34,35 notification for positive chlamydia and other STI results,10,38,53,54 and chlamydia screening promotion.36,37 Patient adherence to medications or health recommendations was addressed in 7 additional programs that provided text message reminders for taking daily oral contraceptive pills27,28 or antiretroviral therapy (ART) for HIV-positive young people49,50 and in programs that provided regular counseling over the mobile phone to improve adherence to contraception use and continuation26,29 or adherence to ART for HIV-positive youth48,51 or to delay subsequent pregnancy among adolescent mothers.31

    Short message service (SMS) or text messaging was used by the majority of programs (82%, n = 23). Three programs added mobile phone voice calls,39,46,54 and 4 programs used mobile phone voice calls exclusively.26,29,31,48,51 Only a few programs used other communication formats, such as providing mobile phone videos,42 e-mail,37 instant messaging,40 or sparse use of other multimedia applications.18,52,53

    Study Findings

    Research on health promotion interventions (Table 1) that provided a forum for asking SRH questions confidentially via mobile phone33,40,46,47 found that adolescents texted about a wide range of highly sensitive SRH topics, suggesting robust acceptability and relevance of this strategy. Content analyses of text questions found that adolescents commonly asked about sexual acts and practices46,47 physical and sexual development,47 abortion,40 and contraception and unplanned pregnancy.40,47 However, a comprehensive array of SRH topics was mentioned in adolescents’ texts.

    View this table:
    • View inline
    • View popup
    TABLE 1

    Study Characteristics and Results for mHealth Health Promotion Campaigns

    Health promotion campaigns that provided on-demand or pushed out mobile phone messages were found to be highly acceptable to young people20,21,29,32,41,43–45,55 because they liked the confidentiality of mobile phone communication30 and found the SRH content simple to understand,21,30 informative,21,41,55 and easily shared.21,30 Furthermore, research on these campaigns along with a study on a mobile phone curriculum addition53 (Table 2) demonstrated that mHealth intervention exposure was associated with increased sexual health knowledge and awareness,33,43,45,53 lower rates of unprotected sex and higher rates of condom use,42,53,55 and greater STI testing.45

    View this table:
    • View inline
    • View popup
    TABLE 2

    Study Characteristics and Results for mHealth Curriculum Additions

    Several studies of health promotion campaigns investigated levels of mHealth program access among adolescents and lower-income and minority subgroups. Results pointed to a few programs that have successfully reached the general youth population in Africa20,30,46 and specific youth subgroups at higher risk of negative SRH outcomes in the United States.40,44 For example, more than half of the Planned Parenthood Federation of America (PPFA) Chat/Text program users in year 1 were African American, Latino, or from other ethnic or racial minority groups,40 and the Mobile for Reproductive Health (m4RH) program in Kenya found that 22% of users were ≤19 years old, and an additional 56% were 20 to 29 years old.30 On the other hand, research on Text4Baby in the United States showed that younger women with lower income and education were less likely to enroll in the subscription-based text message program for pregnant or parenting women than older, higher-income, and better-educated women.32

    Studies of mHealth applications for screening and follow-up for STIs (Table 3) documented improved submission of biological samples for screening in Australia36 and the Netherlands37 and timely recall and treatment of youth who test positive for STIs in New Zealand,56 Australia,38 and the United States.39,54 An important finding from the Stamp Out Chlamydia program in Australia is that combining text messages with a small financial incentive to encourage screening resulted in a dramatically reduced time period for recruitment, from collecting 638 specimens in 6 months to collecting 472 specimens in just 4 days.36 Finally, 2 studies of HPV vaccination reminders sent via SMS to parents or teens in the United States yielded higher rates of receiving second and third doses of the HPV vaccine and more timely completion of the HPV vaccine series.34,35

    View this table:
    • View inline
    • View popup
    TABLE 3

    Study Characteristics and Results for mHealth Screening and Follow-Up Service Utilization

    Using the mobile phone to place calls to adolescent patients to conduct provider counseling (Table 4) appeared to have limited utility. Two RCTs tested the impact of cell phone calls as a mechanism to improve adolescents’ contraception use.26,29 Both studies took place in the United States. In the California study, calls to 805 adolescents were difficult to complete, and there was no significant impact on contraceptive use, attendance or satisfaction with the clinic, or pregnancy and STI rates29; in the Texas study, mobile phone calls to 1115 young people showed no significant impact on adherence to oral contraceptive pills or condom use at last intercourse.26 A third study of 249 adolescent mothers in Washington, DC that relied on mobile phone calls alone showed low feasibility, with only half of the sessions completed and nonsignificant outcome results from intent-to-treat analyses.31 The remaining program that relied on this intervention approach targeted HIV-positive youth and demonstrated a significant impact on medication adherence and viral load, although the sample size was only 37 participants.48

    View this table:
    • View inline
    • View popup
    TABLE 4

    Study Characteristics and Results for mHealth Provider Counseling

    In contrast, interventions that used text messaging as the primary strategy to increase patient adherence (Table 5) were associated with increased oral contraceptive pill knowledge28 and continuation27 and ART adherence in a small observational study of 87 HIV-positive youth.50

    View this table:
    • View inline
    • View popup
    TABLE 5

    Study Characteristics and Results for mHealth Patient Adherence Programs

    Range and Quality of Evidence

    Articles included in the review reflected study designs across the research spectrum along with variable quality of research reporting (Fig 2). RCTs (n = 9) on average met nearly half (47%) of the essential mHealth criteria and the highest percentage of methodological criteria (93%) of all study designs. Quasiexperimental studies (n = 11) on average met the lowest percentage of essential mHealth criteria (35%) but 80% of methodological criteria. Observational studies (n = 10) on average met 40% of essential mHealth criteria and 73% of methodological criteria. Descriptive studies (n = 5) on average met nearly half of the mHealth criteria (47%) but only 82% of methodological criteria.

    FIGURE 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 2

    Percentage of mERA reporting criteria met, by article and study design.

    Across all 35 studies, fewer criteria for essential mHealth reporting were met than criteria for methodological reporting. In the mERA checklist for mHealth reporting, an average of 41% (range 14%–79%) of criteria was achieved among all 35 studies (Fig 3). The mHealth criteria least commonly reported were contextual adaptation (11%) and cost assessment (17%). Only 3 mHealth reporting criteria were met in more than half of studies: intervention delivery (91%), intervention content (60%), and infrastructure (57%). In the mERA reporting and methodology checklist, an average of 82% (range 52%–100%) of criteria were met across all 35 studies (Fig 4). However, only about half of all graded articles met the criteria for assessing bias, calculating sample size, or having a comparator, and only one-third met criteria for presentation of the study logic model or consideration of generalizability of research findings.

    FIGURE 3
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 3

    Percentage of articles that met mERA essential mHealth criteria. HIS, health information system.

    FIGURE 4
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIGURE 4

    Percentage of articles that met mERA reporting and methodology criteria.

    Sample sizes and recruitment strategies were diverse, reflecting varied study designs and study aims. Sample sizes ranged from 8 respondents in a study to improve medication adherence among HIV-positive youth in California51 to 52 628 youth who were contacted to undergo chlamydia screening in an observational study in the Netherlands.37 Most studies recruited youth participants from health care facilities and clinics, several used community organizations and schools, and population-based studies relied on national registries, mass media advertising, and community events such as music festivals.

    Discussion

    mHealth Program Strategies

    The diversity and ingenuity of mHealth intervention programs identified in this review reflect how ASRH professionals are embracing mobile phones to improve adolescents’ health at myriad levels of the health care system. The interventions identified for this review aimed to promote positive and preventive SRH behaviors, increase adoption and continuation of contraception, support medication adherence for HIV-positive young people, support teen parents, and encourage use of health screening and treatment services. Mobile phones were used to increase health program reach to adolescents and ethnic and minority subgroups, increase confidentiality in providing sensitive SRH information to young people, and provide a supportive “friend in your pocket” who reminds and encourages good health.

    The large majority of mHealth interventions for ASRH relied on SMS platforms. Notably, only 4 mHealth programs included in this review used other technological communication formats in place of or in addition to SMS. From a programmatic lens this is a strategic and defensible choice because SMS remains the most frequently used mobile phone communication format among youth in the world and is often cost-effective, costing just pennies per text at implementation.2,5,57 However, text messaging requires clear and concise content within the 160-character restrictions of SMS and basic literacy for reading and understanding message content. Overall, mHealth interventions demand substantial attention to the user interface and content delivery, yet there is limited knowledge of best practices in mobile phone communication for health promotion.58 Because smartphone and Internet adoption is increasing globally, ASRH professionals should give greater consideration to message content, developing and testing additional communication formats, and criteria for evaluating these innovations.

    Summary of Evidence

    Although the mHealth field has been criticized for producing limited evidence about efficacy and effectiveness of mHealth interventions,59–61 a variety of robust research designs and methods were used in the 35 studies we identified. The 9 RCTs tested the impact of the mHealth intervention on SRH knowledge, sexual behavior, medication adherence, and contraception use, among other ASRH outcomes. Many of the 11 quasiexperimental studies focused on quality improvement of health service delivery and relied on uptake of health screening and treatment services to assess effectiveness of the mHealth intervention. The 10 observational research studies tended to focus on implementation of the mHealth program to track reach and adoption by using a variety of methods such as electronic data monitoring, analysis of national registry data, in-person interviews, and phone calls to participants. The 5 descriptive studies used qualitative methods such as focus group discussions but also content analyses of SRH questions posed by adolescents to assess reactions to intervention content or delivery. This variety of research designs, methods, and aims indicates the development of a robust evidence base at the intersection of mobile phones and ASRH.

    Findings from the reviewed studies provide support for distinct uses of mobile phones to improve ASRH. First, health promotion campaigns implemented with text messaging evidenced robust acceptability and relevance for young people globally and led to improved SRH knowledge, less unprotected sex, and more STI testing. Additionally, young people across races and genders accessed these health promotion programs, suggesting excellent reach into the general youth population and key youth subgroups. Data from both higher-income countries and lower-income countries (LICs) suggests widespread youth access, although caution is needed in reaching conclusions about young people in LICs because few of the included studies were conducted in these settings. Second, leveraging mobile phones to increase youth contact for STI screening and follow-up yielded higher rates of screening and recall and more timely and complete STI treatment and vaccination. These results were found across this body of research conducted in Australia, the Netherlands, New Zealand, and the United States. Third, using text messaging to increase adolescent patient adherence to medication (oral contraceptive pills and ART) was shown to be promising in experimental research conducted with adolescents in the United States. However, using mobile phone calls to provide adolescent patient counseling was ineffective, except for 1 small study of HIV-positive young people. Therefore, results from this review suggest that programs that aim to improve adolescents’ adherence to medication should use text messaging rather than phone calls for reminders and support and that more research should be conducted in this important area.

    mERA Checklist

    The mERA checklist provided a valuable platform for assessing the range and quality of reporting on mHealth interventions for ASRH. Notably, twice the percentage of mERA reporting and methodology criteria were met (81%) compared with essential mHealth criteria (41%), reflecting a high degree of reporting and methodology quality in the 35 reviewed studies and a lower level of reporting completeness on essential features of the mHealth intervention. Guidelines for research reporting are widely available, and our results suggest high dissemination of reporting standards regardless of study design. On the other hand, reporting on mHealth programs is new, and the mERA checklist is the first reporting tool available for complete and transparent reporting on mHealth intervention research. Therefore, low scores for essential mHealth reporting are unsurprising. Increased dissemination and adoption of the mERA checklist will facilitate better reporting and improved ability to synthesize evidence on mHealth interventions.

    Only 3 articles in this review studied mHealth interventions for young people in LICs.20,30,46 The dearth of peer-reviewed evidence from LIC contexts is concerning, especially in light of the high use of mobile phones in these settings and existing reports that have identified many mobile phone interventions in LICs.62,63 Robust research is needed to make evidence-based recommendations about the strategic use of mobile phones to improve ASRH in LICs, where limited resources make the need for evidence about impactful and cost-effective programs even more pressing. It is possible that our search strategy failed to identify peer-reviewed studies from LICs, although the global call for resources was disseminated through numerous channels to tap health researchers and programs in both high-income countries and LICs. In addition, we may have inadvertently excluded eligible articles during screening, and relevant studies may have been discounted because they were not published in peer-reviewed journals or in English, in accordance with our study eligibility requirements. Finally, the mERA checklist is in its infancy, and this review is the first to apply the criteria in their entirety and with some of the rigor of the PRISMA guidelines, and therefore mERA grading results should be considered with caution.

    Conclusions

    This review highlights many innovative, youth-engaging, and effective uses of mobile phones to improve ASRH globally, but room remains for additional evidence and innovation. Research on mHealth interventions increasingly uses robust research designs and is accumulating evidence about the potential impact on ASRH knowledge, behavior, and service utilization. Yet the evidence base would benefit from larger sample sizes, more experimental studies, and primary outcomes focused on a variety of SRH norms and behaviors. Conducting this research in LICs is imperative.

    Additional research also is needed to determine the optimal communication format for mobile phone interventions for ASRH. Data on the cost and cost-effectiveness of mHealth interventions for improving ASRH outcomes, along with cost-effectiveness data comparing mobile phones with other communication channels (such as in-person counseling or community outreach events) also would be beneficial. Finally, as the field matures, we hope the mERA checklist will serve as an important tool to support mHealth evidence evaluation, synthesis, and generation of best practices for adolescents’ health.

    Acknowledgments

    We thank Kate Plourde for support with gathering resources and abstracting studies, and Garret Mehl, Tigest Tamrat, and Lianne Gonsalves for support on search terms and the global call for resources. Details of how to obtain additional data from the study (codebook and dataset) are available from the corresponding author.

    Footnotes

      • Accepted June 29, 2016.
    • Address correspondence to Kelly L. L’Engle, PhD, MPH, School of Nursing and Health Professions, University of San Francisco, 2130 Fulton St, San Francisco, CA 94117. E-mail: klengle{at}usfca.edu
    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: The World Health Organization, Department of Reproductive Health and Research, funded the review. Additional support was provided by the US Agency for International Development (USAID) through the Knowledge for Health project. The funders had no influence on the process or conclusions of the article. The views expressed are those of the authors and not necessarily those of the World Health Organization or USAID. Dr Agarwal and Ms Mangone were supported by the FHI360-UNC Research Fellowship.

    • POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

    References

    1. ↵
      1. International Telecommunication Union (ITU)
      . ICT Facts & Figures: The World in 2015. Geneva, Switzerland: ITU; 2015. Available at: www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2015.pdf
    2. ↵
      1. Pew Research Center
      . Emerging Nations Embrace Internet, Mobile Technology. Washington, DC: Pew Research Center; 2014. Available at: www.pewglobal.org/files/2014/02/Pew-Research-Center-Global-Attitudes-Project-Technology-Report-FINAL-February-13-20147.pdf
    3. ↵
      1. GSMA
      . The Mobile Economy 2015. Available at: www.gsmamobileeconomy.com/GSMA_Global_Mobile_Economy_Report_2015.pdf
    4. ↵
      1. International Telecommunication Union (ITU)
      . The World in 2011: ICT Facts and Figures. Geneva, Switzerland: ITU; 2011. Available at: www.itu.int/ITU-D/ict/facts/2011/material/ICTFactsFigures2011.pdf
    5. ↵
      1. Nielsen Company
      . Mobile Youth Around the World 2010. Available at: www.nielsen.com/us/en/insights/reports/2010/mobile-youth-around-the-world.html.
    6. ↵
      1. Lenhart A
      . Teens, Social Media, & Technology Overview 2015. Washington, DC: Pew Research Center; 2015, Available at: www.pewinternet.org/files/2015/04/PI_TeensandTech_Update2015_0409151.pdf
    7. ↵
      1. Gonsalves L,
      2. L’Engle KL,
      3. Tamrat T, et al
      . Adolescent/Youth Reproductive Mobile Access and Delivery Initiative for Love and Life Outcomes (ARMADILLO) Study: formative protocol for mHealth platform development and piloting. Reprod Health. 2015;12(67):67pmid:26248769
      OpenUrlCrossRefPubMed
    8. ↵
      1. Hightow-Weidman LB,
      2. Muessig KE,
      3. Bauermeister J,
      4. Zhang C,
      5. LeGrand S
      . Youth, technology, and HIV: recent advances and future directions. Curr HIV/AIDS Rep. 2015;12(4):500–515pmid:26385582
      OpenUrlCrossRefPubMed
      1. Jones K,
      2. Eathington P,
      3. Baldwin K,
      4. Sipsma H
      . The impact of health education transmitted via social media or text messaging on adolescent and young adult risky sexual behavior: a systematic review of the literature. Sex Transm Dis. 2014;41(7):413–419pmid:24922099
      OpenUrlCrossRefPubMed
    9. ↵
      1. Lim MSC,
      2. Hocking JS,
      3. Hellard ME,
      4. Aitken CK
      . SMS STI: a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS. 2008;19(5):287–290pmid:18482956
      OpenUrlAbstract/FREE Full Text
    10. ↵
      1. Mulye TP,
      2. Park MJ,
      3. Nelson CD,
      4. Adams SH,
      5. Irwin CE Jr,
      6. Brindis CD
      . Trends in adolescent and young adult health in the United States. J Adolesc Health. 2009;45(1):8–24pmid:19541245
      OpenUrlCrossRefPubMed
    11. ↵
      1. Xu JS,
      2. Shtarkshall R
      . Determinants, outcomes and interventions of teenage pregnancy: an international perspective. Reprod Contracept. 2004;15(1):9–18
      OpenUrl
    12. ↵
      1. Biddlecom AE,
      2. Munthali A,
      3. Singh S,
      4. Woog V
      . Adolescents’ views of and preferences for sexual and reproductive health services in Burkina Faso, Ghana, Malawi and Uganda. Afr J Reprod Health. 2007;11(3):99–110pmid:18458737
      OpenUrlPubMed
      1. Chandra-Mouli V,
      2. McCarraher DR,
      3. Phillips SJ,
      4. Williamson NE,
      5. Hainsworth G
      . Contraception for adolescents in low and middle income countries: needs, barriers, and access. Reprod Health. 2014;11(1):1pmid:24383405
      OpenUrlCrossRefPubMed
      1. Delany-Moretlwe S,
      2. Cowan FM,
      3. Busza J,
      4. Bolton-Moore C,
      5. Kelley K,
      6. Fairlie L
      . Providing comprehensive health services for young key populations: needs, barriers and gaps. J Int AIDS Soc. 2015;18(2 suppl 1):19833pmid:25724511
      OpenUrlPubMed
      1. Kerr JC,
      2. Valois RF,
      3. Diclemente RJ, et al
      . HIV-related stigma among African-American youth in the Northeast and Southeast US. AIDS Behav. 2014;18(6):1063–1067pmid:24402690
      OpenUrlCrossRefPubMed
    13. ↵
      1. Tilson EC,
      2. Sanchez V,
      3. Ford CL, et al
      . Barriers to asymptomatic screening and other STD services for adolescents and young adults: focus group discussions. BMC Public Health. 2004;4(21):1–8pmid:15189565
      OpenUrlCrossRefPubMed
    14. ↵
      1. Cornelius JB,
      2. St Lawrence JS,
      3. Howard JC, et al
      . Adolescents’ perceptions of a mobile cell phone text messaging–enhanced intervention and development of a mobile cell phone-based HIV prevention intervention. J Spec Pediatr Nurs. 2012;17(1):61–69pmid:22188273
      OpenUrlCrossRefPubMed
    15. ↵
      1. Devine S,
      2. Bull S,
      3. Dreisbach S,
      4. Shlay J
      . Enhancing a teen pregnancy prevention program with text messaging: engaging minority youth to develop TOP ® Plus Text. J Adolesc Health. 2014;54(3 suppl):S78–S83pmid:24560081
      OpenUrlPubMed
    16. ↵
      1. L’Engle KL,
      2. Vahdat HL,
      3. Ndakidemi E,
      4. Lasway C,
      5. Zan T
      . Evaluating feasibility, reach and potential impact of a text message family planning information service in Tanzania. Contraception. 2013;87(2):251–256pmid:22935322
      OpenUrlCrossRefPubMed
    17. ↵
      1. Perry RCW,
      2. Kayekjian KC,
      3. Braun RA,
      4. Cantu M,
      5. Sheoran B,
      6. Chung PJ
      . Adolescents’ perspectives on the use of a text messaging service for preventive sexual health promotion. J Adolesc Health. 2012;51(3):220–225pmid:22921131
      OpenUrlCrossRefPubMed
    18. ↵
      1. Agarwal SA,
      2. LeFevre AE,
      3. Lee J, et al
      . Guidelines for reporting mHealth evidence: the mHealth Evidence Reporting and Assessment (mERA) tool. BMJ. 2016;352:i1174pmid:26988021
      OpenUrlFREE Full Text
    19. ↵
      1. World Health Organization (WHO)
      . The Health of Youth Document A42/Technical Discussions/2. Geneva, Switzerland: WHO; 1989
    20. ↵
      1. United National Family Planning Association (UNFPA)
      . Making Reproductive Rights and Sexual Health a Reality for All. New York, NY: UNFPA; 2008
    21. ↵
      1. Moher D,
      2. Liberati A,
      3. Tetzlaff J,
      4. Altman DG; PRISMA Group
      . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097pmid:19621072
      OpenUrlCrossRefPubMed
    22. ↵
      1. Berenson AB,
      2. Rahman M
      . A randomized controlled study of two educational interventions on adherence with oral contraceptives and condoms. Contraception. 2012;86(6):716–724pmid:22840278
      OpenUrlCrossRefPubMed
    23. ↵
      1. Castaño PM,
      2. Bynum JY,
      3. Andrés R,
      4. Lara M,
      5. Westhoff C
      . Effect of daily text messages on oral contraceptive continuation: a randomized controlled trial. Obstet Gynecol. 2012;119(1):14–20pmid:22143257
      OpenUrlCrossRefPubMed
    24. ↵
      1. Hall KS,
      2. Westhoff CL,
      3. Castaño PM
      . The impact of an educational text message intervention on young urban women’s knowledge of oral contraception. Contraception. 2013;87(4):449–454pmid:23062523
      OpenUrlCrossRefPubMed
    25. ↵
      1. Kirby D,
      2. Raine T,
      3. Thrush G,
      4. Yuen C,
      5. Sokoloff A,
      6. Potter SC
      . Impact of an intervention to improve contraceptive use through follow-up phone calls to female adolescent clinic patients. Perspect Sex Reprod Health. 2010;42(4):251–257pmid:21126301
      OpenUrlCrossRefPubMed
    26. ↵
      1. Vahdat HL,
      2. L’Engle KL,
      3. Plourde KF,
      4. Magaria L,
      5. Olawo A
      . There are some questions you may not ask in a clinic: providing contraception information to young people in Kenya using SMS. Int J Gynaecol Obstet. 2013;123(suppl 1):e2–e6pmid:24012514
      OpenUrlCrossRefPubMed
    27. ↵
      1. Katz KS,
      2. Rodan M,
      3. Milligan R, et al
      . Efficacy of a randomized cell phone–based counseling intervention in postponing subsequent pregnancy among teen mothers. Matern Child Health J. 2011;15(suppl 1):S42–S53pmid:21809218
      OpenUrlPubMed
    28. ↵
      1. Gazmararian JA,
      2. Elon L,
      3. Yang B,
      4. Graham M,
      5. Parker R
      . Text4baby program: an opportunity to reach underserved pregnant and postpartum women? Matern Child Health J. 2014;18(1):223–232pmid:23494485
      OpenUrlCrossRefPubMed
    29. ↵
      1. Song H,
      2. May A,
      3. Vaidhyanathan V,
      4. Cramer EM,
      5. Owais RW,
      6. McRoy S
      . A two-way text-messaging system answering health questions for low-income pregnant women. Patient Educ Couns. 2013;92(2):182–187pmid:23711635
      OpenUrlCrossRefPubMed
    30. ↵
      1. Kharbanda EO,
      2. Stockwell MS,
      3. Fox HW,
      4. Andres R,
      5. Lara M,
      6. Rickert VI
      . Text message reminders to promote human papillomavirus vaccination. Vaccine. 2011;29(14):2537–2541pmid:21300094
      OpenUrlCrossRefPubMed
    31. ↵
      1. Matheson EC,
      2. Derouin A,
      3. Gagliano M,
      4. Thompson JA,
      5. Blood-Siegfried J
      . Increasing HPV vaccination series completion rates via text message reminders. J Pediatr Health Care. 2014;28(4):e35–e39pmid:24200295
      OpenUrlCrossRefPubMed
    32. ↵
      1. Currie MJ,
      2. Schmidt M,
      3. Davis BK, et al
      . “Show me the money”: financial incentives increase chlamydia screening rates among tertiary students: a pilot study. Sex Health. 2010;7(1):60–65pmid:20152098
      OpenUrlCrossRefPubMed
    33. ↵
      1. Dokkum NFB,
      2. Koekenbier RH,
      3. van den Broek IVF, et al
      . Keeping participants on board: increasing uptake by automated respondent reminders in an Internet-based chlamydia screening in the Netherlands. BMC Public Health. 2012;12:176pmid:22404911
      OpenUrlCrossRefPubMed
    34. ↵
      1. Bailey SM,
      2. Scalley BC,
      3. Gilles MT
      . Text 2 treat: using SMS to recall clients for treatment. Int J STD AIDS. 2014;25(14):1–3
      OpenUrlAbstract/FREE Full Text
    35. ↵
      1. Huppert JS,
      2. Reed JL,
      3. Munafo JK, et al
      . Improving notification of sexually transmitted infections: a quality improvement project and planned experiment. Pediatrics. 2012;130(2). Available at: www.pediatrics.org/cgi/content/full/130/2/e415pmid:22753557
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Giorgio MM,
      2. Kantor LM,
      3. Levine DS,
      4. Arons W
      . Using chat and text technologies to answer sexual and reproductive health questions: Planned Parenthood pilot study. J Med Internet Res. 2013;15(9):e203pmid:24055754
      OpenUrlCrossRefPubMed
    37. ↵
      1. Gold J,
      2. Lim MSC,
      3. Hellard ME,
      4. Hocking JS,
      5. Keogh L
      . What’s in a message? Delivering sexual health promotion to young people in Australia via text messaging. BMC Public Health. 2010;10:792pmid:21190584
      OpenUrlCrossRefPubMed
    38. ↵
      1. Jones R,
      2. Hoover DR,
      3. Lacroix LJ
      . A randomized controlled trial of soap opera videos streamed to smartphones to reduce risk of sexually transmitted human immunodeficiency virus (HIV) in young urban African American women. Nurs Outlook. 2013;61(4):205–215.e3pmid:23743482
      OpenUrlCrossRefPubMed
    39. ↵
      1. Juzang I,
      2. Fortune T,
      3. Black S,
      4. Wright E,
      5. Bull S
      . A pilot programme using mobile phones for HIV prevention. J Telemed Telecare. 2011;17(3):150–153pmid:21270049
      OpenUrlAbstract/FREE Full Text
    40. ↵
      1. Levine D,
      2. McCright J,
      3. Dobkin L,
      4. Woodruff AJ,
      5. Klausner JD
      . SEXINFO: a sexual health text messaging service for San Francisco youth. Am J Public Health. 2008;98(3):393–395pmid:18235068
      OpenUrlCrossRefPubMed
    41. ↵
      1. Lim MSC,
      2. Hocking JS,
      3. Aitken CK, et al
      . Impact of text and email messaging on the sexual health of young people: a randomised controlled trial. J Epidemiol Community Health. 2012;66(1):69–74pmid:21415232
      OpenUrlAbstract/FREE Full Text
    42. ↵
      1. Nsakala GV,
      2. Coppieters Y,
      3. Kayembe PK
      . An innovative approach to using both cellphones and the radio to identify young people’s sexual concerns in Kinshasa, Democratic Republic of Congo. Arch Public Health. 2014;72(1):21pmid:25089197
      OpenUrlCrossRefPubMed
    43. ↵
      1. Willoughby JF,
      2. Jackson K
      . “Can you get pregnant when u r in the pool?”: young people’s information seeking from a sexual health text line. Sex Educ. 2013;13(1):96–101
      OpenUrlCrossRef
    44. ↵
      1. Belzer ME,
      2. Naar-King S,
      3. Olson J, et al; Adolescent Medicine Trials Network for HIV/AIDS Interventions
      . The use of cell phone support for non-adherent HIV-infected youth and young adults: an initial randomized and controlled intervention trial. AIDS Behav. 2014;18(4):686–696pmid:24271347
      OpenUrlCrossRefPubMed
    45. ↵
      1. Dowshen N,
      2. Kuhns LM,
      3. Gray C,
      4. Lee S,
      5. Garofalo R
      . Feasibility of interactive text message response (ITR) as a novel, real-time measure of adherence to antiretroviral therapy for HIV+ youth. AIDS Behav. 2013;17(6):2237–2243pmid:23546844
      OpenUrlCrossRefPubMed
    46. ↵
      1. Hailey JH,
      2. Arscott J
      . Using technology to effectively engage adolescents and young adults into care: STAR TRACK Adherence Program. J Assoc Nurses AIDS Care. 2013;24(6):582–586pmid:23809658
      OpenUrlCrossRefPubMed
    47. ↵
      1. Puccio JA,
      2. Belzer M,
      3. Olson J, et al
      . The use of cell phone reminder calls for assisting HIV-infected adolescents and young adults to adhere to highly active antiretroviral therapy: a pilot study. AIDS Patient Care STDS. 2006;20(6):438–444pmid:16789857
      OpenUrlCrossRefPubMed
    48. ↵
      1. Cornelius JB,
      2. Cato M,
      3. Lawrence JS,
      4. Boyer CB,
      5. Lightfoot M
      . Development and pretesting multimedia HIV-prevention text messages for mobile cell phone delivery. J Assoc Nurses AIDS Care. 2011;22(5):407–413pmid:21256053
      OpenUrlCrossRefPubMed
    49. ↵
      1. Cornelius JB,
      2. Dmochowski J,
      3. Boyer C,
      4. St Lawrence J,
      5. Lightfoot M,
      6. Moore M
      . Text-messaging-enhanced HIV intervention for African American adolescents: a feasibility study. J Assoc Nurses AIDS Care. 2013;24(3):256–267pmid:23122907
      OpenUrlCrossRefPubMed
    50. ↵
      1. Reed JL,
      2. Huppert JS,
      3. Taylor RG, et al
      . Improving sexually transmitted infection results notification via mobile phone technology. J Adolesc Health. 2014;55(5):690–697pmid:24962503
      OpenUrlCrossRefPubMed
    51. ↵
      1. Suffoletto B,
      2. Akers A,
      3. McGinnis KA,
      4. Calabria J,
      5. Wiesenfeld HC,
      6. Clark DB
      . A sex risk reduction text-message program for young adult females discharged from the emergency department. J Adolesc Health. 2013;53(3):387–393pmid:23707402
      OpenUrlCrossRefPubMed
    52. ↵
      1. Lim EJ,
      2. Haar J,
      3. Morgan J
      . Can text messaging results reduce time to treatment of Chlamydia trachomatis? Sex Transm Infect. 2008;84(7):563–564pmid:18723584
      OpenUrlAbstract/FREE Full Text
    53. ↵
      1. Mangone ER,
      2. Agarwal S,
      3. L’Engle K, et al
      . Sustainable cost models for mHealth at scale: modeling program data from m4RH Tanzania. PLoS One. 2016;11(1):e0148011pmid:26824747
      OpenUrlCrossRefPubMed
    54. ↵
      1. Head KJ,
      2. Noar SM,
      3. Iannarino NT,
      4. Grant Harrington N
      . Efficacy of text messaging–based interventions for health promotion: a meta-analysis. Soc Sci Med. 2013;97:41–48pmid:24161087
      OpenUrlCrossRefPubMed
    55. ↵
      1. Al-Shorbaji N,
      2. Geissbuhler A
      . Establishing an evidence base for e-health: the proof is in the pudding. Bull World Health Organ. 2012;90(5):322–322Apmid:22589560
      OpenUrlCrossRefPubMed
      1. Kumar S,
      2. Nilsen WJ,
      3. Abernethy A, et al
      . Mobile health technology evaluation: the mHealth evidence workshop. Am J Prev Med. 2013;45(2):228–236pmid:23867031
      OpenUrlCrossRefPubMed
    56. ↵
      1. Tomlinson M,
      2. Rotheram-Borus MJ,
      3. Swartz L,
      4. Tsai AC
      . Scaling up mHealth: where is the evidence? PLoS Med. 2013;10(2):e1001382pmid:23424286
      OpenUrlCrossRefPubMed
    57. ↵
      1. Lee SH,
      2. Nurmatov UB,
      3. Nwaru BI,
      4. Mukherjee M,
      5. Grant L,
      6. Pagliari C
      . Effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries: systematic review and meta-analysis. J Glob Health. 2016;6(1):010401pmid:26649177
      OpenUrlPubMed
    58. ↵
      1. Levine R,
      2. Corbacio A,
      3. Konopka S, et al
      . African Strategies for Health. mHealth Compendium. Arlington, VA: Management Sciences for Health; 2015
    • Copyright © 2016 by the American Academy of Pediatrics
    PreviousNext
    Back to top

    Advertising Disclaimer »

    In this issue

    Pediatrics
    Vol. 138, Issue 3
    1 Sep 2016
    • Table of Contents
    • Index by author
    View this article with LENS
    PreviousNext
    Email Article

    Thank you for your interest in spreading the word on American Academy of Pediatrics.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review
    (Your Name) has sent you a message from American Academy of Pediatrics
    (Your Name) thought you would like to see the American Academy of Pediatrics web site.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Request Permissions
    Article Alerts
    Log in
    You will be redirected to aap.org to login or to create your account.
    Or Sign In to Email Alerts with your Email Address
    Citation Tools
    Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review
    Kelly L. L’Engle, Emily R. Mangone, Angela M. Parcesepe, Smisha Agarwal, Nicole B. Ippoliti
    Pediatrics Sep 2016, 138 (3) e20160884; DOI: 10.1542/peds.2016-0884

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review
    Kelly L. L’Engle, Emily R. Mangone, Angela M. Parcesepe, Smisha Agarwal, Nicole B. Ippoliti
    Pediatrics Sep 2016, 138 (3) e20160884; DOI: 10.1542/peds.2016-0884
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    Print
    Download PDF
    Insight Alerts
    • Table of Contents

    Jump to section

    • Article
      • Abstract
      • Methods
      • Results
      • Discussion
      • Conclusions
      • Acknowledgments
      • Footnotes
      • References
    • Figures & Data
    • Supplemental
    • Info & Metrics
    • Comments

    Related Articles

    • PubMed
    • Google Scholar

    Cited By...

    • Effectiveness of mHealth Interventions for Improving Contraceptive Use in Low- and Middle-Income Countries: A Systematic Review
    • Using Digital Technology for Sexual and Reproductive Health: Are Programs Adequately Considering Risk?
    • Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996-2017)
    • A randomised controlled trial of an intervention delivered by app instant messaging to increase the acceptability of effective contraception among young people in Tajikistan: study protocol
    • Google Scholar

    More in this TOC Section

    • Umbilical Cord Management at Term and Late Preterm Birth: A Meta-analysis
    • Umbilical Cord Management for Newborns <34 Weeks' Gestation: A Meta-analysis
    • Efficacy and Safety of Metformin for Obesity: A Systematic Review
    Show more Review Article

    Similar Articles

    Subjects

    • Health Information Technology
      • Health Information Technology
    • Adolescent Health/Medicine
      • Adolescent Health/Medicine
    • Journal Info
    • Editorial Board
    • Editorial Policies
    • Overview
    • Licensing Information
    • Authors/Reviewers
    • Author Guidelines
    • Submit My Manuscript
    • Open Access
    • Reviewer Guidelines
    • Librarians
    • Institutional Subscriptions
    • Usage Stats
    • Support
    • Contact Us
    • Subscribe
    • Resources
    • Media Kit
    • About
    • International Access
    • Terms of Use
    • Privacy Statement
    • FAQ
    • AAP.org
    • shopAAP
    • Follow American Academy of Pediatrics on Instagram
    • Visit American Academy of Pediatrics on Facebook
    • Follow American Academy of Pediatrics on Twitter
    • Follow American Academy of Pediatrics on Youtube
    • RSS
    American Academy of Pediatrics

    © 2021 American Academy of Pediatrics