pediatrics
May 2017, VOLUME139 /ISSUE 5

A Family-Centered Rounds Checklist, Family Engagement, and Patient Safety: A Randomized Trial

  1. Elizabeth D. Cox, MD, PhDa,
  2. Gwen C. Jacobsohn, PhDb,
  3. Victoria P. Rajamanickam, MSc,
  4. Pascale Carayon, PhDd,e,
  5. Michelle M. Kelly, MDa,d,
  6. Tosha B. Wetterneck, MD, MSb,d,e,f,
  7. Paul J. Rathouz, PhDc, and
  8. Roger L. Brown, PhDg
  1. aDepartments of Pediatrics,
  2. bFamily Medicine and Community Health,
  3. cBiostatistics and Medical Informatics, and
  4. fMedicine, School of Medicine and Public Health,
  5. dCenter for Quality and Productivity Improvement,
  6. eDepartment of Industrial and Systems Engineering, and
  7. gDepartment of Research Design and Statistics, School of Nursing, University of Wisconsin–Madison, Madison, Wisconsin
  1. Dr Cox secured funding, conceived and designed the study, codeveloped the intervention and its implementation, created or adapted the video-coding methods, oversaw all data collection, coding, and analyses, and drafted and revised the manuscript; Dr Jacobsohn cocreated the coding scheme for the family-centered rounds checklist elements, oversaw the coding of videos for the family-centered rounds checklist elements, performed analyses, and revised the manuscript; Ms Rajamanickam performed analyses and revised the manuscript; Drs Carayon, Kelly, and Wetterneck codeveloped the intervention and its implementation and revised the manuscript; Drs Rathouz and Brown oversaw analyses and revised the manuscript; and all authors approved the final version for submission.

Abstract

BACKGROUND AND OBJECTIVES: Family-centered rounds (FCRs) have become standard of care, despite the limited evaluation of FCRs’ benefits or interventions to support high-quality FCR delivery. This work examines the impact of the FCR checklist intervention, a checklist and associated provider training, on performance of FCR elements, family engagement, and patient safety.

METHODS: This cluster randomized trial involved 298 families. Two hospital services were randomized to use the checklist; 2 others delivered usual care. We evaluated the performance of 8 FCR checklist elements and family engagement from 673 pre- and postintervention FCR videos and assessed the safety climate with the Children’s Hospital Safety Climate Questionnaire. Random effects regression models were used to assess intervention impact.

RESULTS: The intervention significantly increased the number of FCR checklist elements performed (β = 1.2, P < .001). Intervention rounds were significantly more likely to include asking the family (odds ratio [OR] = 2.43, P < .05) or health care team (OR = 4.28, P = .002) for questions and reading back orders (OR = 12.43, P < .001). Intervention families’ engagement and reports of safety climate were no different from usual care. However, performance of specific checklist elements was associated with changes in these outcomes. For example, order read-back was associated with significantly more family engagement. Asking families for questions was associated with significantly better ratings of staff’s communication openness and safety of handoffs and transitions.

CONCLUSIONS: The performance of FCR checklist elements was enhanced by checklist implementation and associated with changes in family engagement and more positive perceptions of safety climate. Implementing the checklist improves delivery of FCRs, impacting quality and safety of care.

  • Abbreviations:
    CI
    confidence interval
    FCR
    family-centered round
    OR
    odds ratio
  • What’s Known on This Subject:

    Family-centered rounds (FCRs) are suggested to improve the quality and safety of pediatric inpatient care. FCRs have become standard practice, despite limited evidence to support consistent high-quality FCR delivery or rigorous evaluation of their benefit.

    What This Study Adds:

    Implementing the FCR checklist significantly improved the performance of 3 key FCR elements. In addition, performance of specific FCR elements was associated with significant changes in family engagement during FCRs and improvements in parent perceptions of safety.

    Family-centered care has been recommended by the Institute of Medicine as a key to improving the quality and safety of health care.1 To achieve this type of care, experts suggest family-centered rounds (FCRs) as the standard for hospitalized children.24 Although FCRs are being performed at most children’s hospitals and many community hospitals,5 great variability exists in the elements that constitute FCRs.6 Implementing effective FCRs requires the development and assessment of tools supporting standardized FCR delivery.5 To address this need, we developed the FCR checklist intervention, a checklist and associated provider training, to standardize delivery of high-quality FCR (www.hipxchange.org/FamilyRounds).79

    Despite suggested benefits of FCRs,3,1012 rigorous trials of the impact of FCRs are lacking. Only 2 trials have assessed the impact of family presence during rounds, 1 of which is now nearly 30 years old13 and the other randomized only 27 families, finding greater parental satisfaction when rounding with the team at the bedside.10 Other qualitative, quality improvement, or pre–postintervention studies suggest that health care providers and families believe that FCR supports building relationships,1315 sharing information,13,1619 and engaging in decision-making.11,20 However, additional work is needed to assess whether FCR can influence the quality and safety of care for hospitalized children. In this cluster randomized trial, we assessed the impact of our FCR checklist intervention on: (1) performance of checklist elements, (2) family engagement in talk that builds relationships, shares information, or facilitates decision-making, and (3) parent perceptions of the patient safety climate in our children’s hospital.

    Methods

    Study Design, Setting, and Participants

    To represent children’s hospital patients broadly, including both acute and chronic disease admissions, we collected data from 4 services: 2 general pediatric hospitalist services, the pulmonary service, and the hematology/oncology service. The hospitalist services admit many children with acute concerns (eg, respiratory distress), whereas the other services mostly admit children with ongoing or chronic illnesses (eg, cystic fibrosis or cancer). To strengthen our ability to determine causality, our study used a pre–post cluster randomized design,21,22 randomizing 2 services to use the intervention with all their patients, whereas 2 others delivered usual care. Services were aware of their designation as intervention or usual care. One research team member (R.L.B.) used a computer algorithm to randomly designate intervention (1 hospitalist service and the hematology/oncology service) and usual care services (the other hospitalist service and the pulmonary service). The attending, a senior resident, 2 interns, ∼4 medical students, and the patient’s nurse typically participated in FCRs, with other team members joining as appropriate. We collected preintervention data at our 61-bed children’s hospital from October 2010 to May 2011; the postintervention data collection occurred from October 2012 to May 2013.

    During the recruitment periods, the family of each child (aged 0–17 years) admitted to a participating service was approached to participate. Children with stigmatizing reasons for hospitalization (eg, suspected nonaccidental trauma or mental health concerns), new cancer diagnoses, or whose parent(s) were unavailable to consent (absent or sleeping during recruitment) or could not speak or read English did not meet inclusion criteria and were excluded. Written consent was obtained from parents and children ages 15 to 17 years, with children ages 7 to 14 years providing written assent. The University of Wisconsin Health Sciences Institutional Review Board approved this study.

    The FCR Checklist Intervention

    The FCR checklist intervention was developed through stakeholder engagement, including parents, health care team members, institutional leadership, and patient advocates. To identify suggestions to optimize family engagement in FCRs, stimulated recall methods were used with 11 parents, 4 children, and 22 health care team members.8,9,23,24 Suggestions from these interviews were aggregated into 21 possible improvements. These were then prioritized by stakeholders, including 42 parents, based on feasibility and potential impact,8 ultimately resulting in 8 “best practices” for FCRs, organized in a checklist format (Supplemental Fig 2). Checklist elements (Table 1) were arranged in the order they typically occur during rounds, beginning with ensuring the nurse is present and ending with reading back orders, but they could be performed in any order. To optimize implementation, the checklist was bundled with a 1-hour interactive training, a brief refresher training, tools to monitor implementation, and laminated checklists for use as prompts, constituting the FCR checklist intervention (toolkit available at www.hipxchange.org/familyrounds).8

    TABLE 1

    Descriptive Characteristics of the Participants and Study Outcomes for Usual Care and Intervention Services, Pre- and Postintervention

    Data Collection

    Before the consented families’ first FCR, parents completed surveys of demographics, comorbidities, and previous hospitalizations (see Table 1). Child characteristics included child age, sex, and health status (single item, 5-point Likert scale).25 Parent characteristics included age, sex, race/ethnicity, and education (eighth grade or less; 9th to 12th grade but not high school graduate; high school graduate or equivalent; some college; bachelor’s degree; graduate or professional degree). Length of stay was calculated based on admit and discharge dates. A researcher video-recorded each FCR during the child’s stay.

    Outcome Measures

    Checklist Element Performance

    Pairs of trained coders evaluated videos for performance of checklist elements, except for the element “Assess family preference for rounds,” which was not evaluated because this often occurred before rounds and therefore was not always captured on video. Coders received 23 hours of training over 6 weeks, using a training manual and pilot videos, and then met monthly over 8 months to resolve areas of disagreement by consensus. Coders were blinded to intervention or usual care status. For stays >7 days, 7 videos were coded (admit day, day after admission, day before discharge, discharge day, and the 3 days marking one-quarter, half, and three-quarters of the duration of the stay).

    Family Engagement in Rounds

    Family engagement in communication tasks that support family-centeredness was assessed from FCR videos by using 2 reliable, validated coding schemes. Videos were assessed for family engagement in relationship building, information giving, and information gathering, by using the Roter Interaction Analysis System. This widely used system for coding clinical communication provides a mechanism for categorizing each speaker’s talk at the level of the utterance (the smallest discernable speech segment to which a category may be assigned [eg, a word, phrase, or sentence with a single intent]) into 1 of 34 mutually exclusive categories.26,27 To evaluate family engagement in decision-making (proposing a plan, raising risks or benefits of a possible plan, or disagreeing with a proposed plan), coders applied a validated coding scheme developed by one of the authors.28,29 Talk was coded only for periods in which the health care team was present during the round. Child and parent talk was summed to reflect family engagement. As with checklist element performance, 7 representative videos were coded for stays >7 days. To represent family engagement over the entire hospital stay, counts of categorized utterances or events for each communication task were averaged across all of the patient’s FCRs.

    Family engagement was assessed by a team of 20 trained, blinded coders. Each coder received a minimum of 20 hours of training, using a training manual and pilot videos. Subsequently, coders met at least monthly over 9 months to review areas of disagreement. Intercoder reliability was assessed by double-coding a random sample of videos (93 videos [13%] for Roter Interaction Analysis System and 84 videos [12%] for engagement in decision-making). Reliabilities were near perfect for relationship building, information giving, and information gathering (intraclass correlation coefficient >0.8), which were treated as continuous variables, and substantial for family engagement in decision-making (κ > 0.6), treated as a count.30,31

    Parent Perceptions of Children’s Hospital Safety Climate

    Because patients and parents are at the front lines of care, their perceptions of hospital safety are highly relevant indicators of the safety of care relating to outcomes, such as posthospitalization treatment adherence or readmissions.3238 For instance, parents are first-hand witnesses to medication errors, adherence to safety procedures (eg, hand hygiene), and information handoffs during shift changes.39,40 Therefore, the Children’s Hospital Safety Climate Survey was administered at discharge to assess parent perspectives of safety during the stay.38 Domains included overall perceptions of safety (4 items), staff communication openness (3 items), family communication openness (3 items), and handoffs and transitions (4 items). Domain scores were created by averaging item responses, which were on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree), with negatively worded items reverse-scored.

    Analyses

    Descriptive analyses were performed, including proportions or means and SDs. All analyses of intervention effects were performed by the originally assigned arm. To strengthen our ability to infer causality, our random effects linear or logistic regression models of intervention impact included an arm indicator (intervention or usual care, reflecting whether the service eventually received the intervention), an indicator for the intervention period (preintervention or postintervention, regardless of arm), and an intervention-by-arm interaction representing the intervention effect (allowing the pre–post differences for each study arm to differ). This assessment of intervention effect and also the association of family engagement with the performance of each checklist element were assessed with random effects regression models. These models included a patient-level random intercept to account for repeated measures across the stay for a given patient. The association of parent perceptions of the hospital’s safety climate at discharge with average checklist element performance across all FCRs during the admission was assessed with linear regression by using pre- and postintervention data. All models were adjusted for child age and health status, parent education, and length of stay. Results are presented as odds ratios (ORs) or regression coefficients with 95% confidence intervals (CIs). Significance was assessed at P < .05. All analyses were performed by using Stata version 13 (Stata Corp, College Station, TX).

    This study was powered a priori to detect small to moderate effect sizes (0.2–0.3 σ) in family engagement, based on previous work, leading to a goal of 300 participants.28,29 At trial inception, there were no previous data on which to base power calculations for the domains of the Children’s Hospital Safety Climate Survey. However, based on data collected before the intervention’s delivery, our sample size provided 80% power to detect a 10% change in safety climate domain means.

    Results

    Trial Recruitment and Participant Characteristics

    A total of 874 potential participant admissions (402 preintervention; 472 postintervention) were identified (Fig 1). Common reasons for exclusion were inability to consent before initial FCR (eg, parent was asleep or not present) (44%), stigmatizing or traumatic reasons for admission, such as suspected nonaccidental trauma or a new cancer diagnosis (15%), previous participation in the study (12%), and limited English proficiency (6%). Of 518 eligible admissions approached, 340 (66%) agreed to participate, with 164 families participating in the preintervention period and 176 in the postintervention period. Our final sample was 298 families: 144 preintervention (19 families were excluded due to incomplete data; 1 withdrew due to stress of a new diagnosis) and 154 postintervention (21 families were excluded due to incomplete data; 1 withdrew due to stress of a new diagnosis).

    FIGURE 1

    Flow of participants in trial of FCR checklist intervention. A, Preintervention participants. B, Postintervention participants. a For 18 patients, the admitting service was not noted.

    On average, children were young (5–6 years of age), and most were in good to excellent health. Parents were predominantly white, non-Hispanic mothers with a wide range of educational attainment. Common reasons for hospitalization were breathing problems, gastrointestinal problems, and fever. Hospital stays were typically >3 days, although ∼20% of children stayed longer. Rounds were ∼10 to 11 minutes in length. Usual care and intervention arms were comparable across numerous patient and parent characteristics. The only significantly different characteristic was length of stay (χ2, P = .04) (Table 1).

    From the hospital stays of 298 children in the study, 673 FCR videos were evaluated. Usual care services contributed 348 videos (164 preintervention videos from 70 families; 184 postintervention videos from 76 families); intervention services contributed 325 videos (155 preintervention videos from 74 families; 170 postintervention videos from 78 families).

    Descriptive Data for Main Outcomes

    Checklist Element Performance

    On average across services during the study period, ∼4.3 to 5.9 of the 8 checklist elements were performed during rounds (Table 1). Three elements were performed frequently (nurse present, plan summarized, discharge goals discussed), whereas other elements were performed with less regularity.

    Family Engagement During FCRs

    Across services and pre- and postintervention periods, mean family engagement in relationship building during FCRs ranged from 36.0 to 43.7 utterances (Table 1). Overall, families made an average of 23.4 to 33.1 information-giving utterances and 3.0 to 3.3 information-gathering utterances per round. Families engaged in decision-making an average of 2.9 to 4.4 times during FCRs.

    Perceptions of Safety

    Across services and pre- and postintervention periods, families reported strongly positive views of the 4 hospital safety climate domains, with mean scores ranging from 3.9 to 4.5 (Table 1). In general, families rated their own ability to communicate openly most highly, whereas the other 3 measures of safety climate received less positive ratings.

    Intervention Impact

    Impact of the Intervention on Checklist Element Performance

    The intervention significantly improved the total number of checklist elements performed, with intervention teams, on average, completing 1.2 more checklist elements per round than usual care (β = 1.2, 95% CI: 0.72–1.67). The intervention significantly increased the likelihood that families were asked for questions (OR = 2.43, P < .05), the health care team was asked for questions (OR = 4.28, P = .002), and the health care team read back orders during FCRs (OR = 12.43, P < .001). Performance of the other checklist elements was not impacted significantly (Table 2).

    TABLE 2

    Adjusted ORs and 95% CIs for the Intervention’s Effect on FCR Checklist Element Performance (n = 668 Rounds)

    Impact of the Checklist Intervention on Family Engagement

    Adjusted models demonstrated no significant intervention effect on family engagement. However, performance of 2 checklist elements significantly increased family engagement, whereas 2 other checklist elements decreased family engagement (Table 3). Specifically, when the health care team read back orders, families engaged in more information giving (8.20 more utterances; P = .002), information gathering (0.86 more utterances; P = .02), and decision-making (0.66 more decision-making activities; P = .04). In addition, when the health care team discussed goals for discharge, relationship building increased (5.30 more utterances; P = .03). With regard to checklist elements associated with reduced engagement, when health care teams provided assessments of children’s progress, families engaged in significantly less relationship building (4.22 fewer utterances; P = .04), information gathering (0.86 fewer utterances; P = .005), and decision-making (0.57 fewer instances; P = .04). Additionally, when families were asked for questions during FCRs, they engaged in significantly less information giving (12.15 fewer utterances; P < .001).

    TABLE 3

    Adjusted Regression Coefficients (β) and 95% CIs for Association of FCR Checklist Element Performance With Family Engagement in Communication Tasks (n = 668 rounds)

    Impact of Checklist Intervention on Parent Perceptions of Safety

    Adjusted models demonstrated no significant intervention effect on parent perceptions of safety. However, the performance of particular FCR checklist elements improved parent perceptions of 2 safety climate domains (Table 4). Specifically, parent views of staff communication openness significantly increased with the proportion of FCRs in which the family was asked for questions. In addition, parents’ perceptions of the safety of handoffs and transitions significantly increased with the proportion of FCRs in which the health care team gave an assessment of their child’s progress or asked the family if they had any questions.

    TABLE 4

    Adjusted Regression Coefficients (β) and 95% CIs for Association of FCR Checklist Element Performance With Parent Perceptions of Safety (n = 298 Admissions)

    Discussion

    Implementation of the FCR checklist intervention succeeded in increasing the likelihood that key FCR elements, as defined by patients, families, and staff, were performed. Although the intervention did not alter family engagement or perceptions of safety, performance of specific checklist elements significantly influenced both of these outcomes. Thus, implementation of the checklist has implications for the delivery of safe, high-quality pediatric inpatient care. The checklist also offers a way to structure the delivery of FCRs to meet the needs of families, learners, and the health care team while also supporting future research comparing the effects of FCRs on other health care and educational outcomes.

    Teams that used the checklist were significantly more likely to ask families and health care team members for questions. The act of asking for questions allows health care teams to leverage the expertise of families as the primary caregivers for the child and also provides other team members, such as nurses, pharmacists, and case managers, an opportunity to share their expertise. Nurses in particular can present issues or questions that families may have raised to them, but which families may not feel comfortable speaking up about during FCRs.

    Asking families if they have questions was associated with improved perceptions of safety, but also with less information giving by families during FCRs. It is possible that families who were specifically invited to ask questions may have been empowered to directly ask whatever questions they had, rather than repeating or providing additional information in hopes that the health care team might infer their question and address it. Alternatively, health care teams may have been more likely to ask families for questions when the family had been less engaged in providing information during rounds. Yet asking families for questions positively influenced parent perceptions of safety, improving both perceptions of staff communication openness and of the safety of handoffs and transitions, which is consistent with other studies of interventions to promote communication and teamwork.4143 Thus, implementation of this checklist element may be an appropriate intervention to improve parent perceptions of safety in children’s hospitals.

    The intervention also increased the likelihood that orders would be read back during FCRs, and performance of this checklist element increased family engagement. When orders were read back, families both asked for and gave more information and also engaged more in decision-making. Reading back orders may signal a willingness to have those orders questioned or modified. This read back also promotes a shared mental model of the orders, creating a foundation on which families and health care team members could formulate questions. In previous work, we found that many families use FCR as a venue to discuss medication topics.20 Because computerized physician order entry has not yet been able to eliminate medication errors and potential or actual adverse events,44,45 order read back may be particularly powerful in fostering safe medication use for hospitalized children.

    Also, interestingly, providing an assessment of the child’s progress increased perceptions of the safety of handoffs and transitions, yet it reduced family engagement across all 4 communication areas. Because our coding of checklist element performance did not assess the family-centeredness of this performance, providing this assessment may have structured FCRs in a manner that was less family-centered, reducing family comfort with engaging. Alternatively, provision of this assessment may have created reassurance or clarity for families, who then felt less need to engage verbally during FCRs. This latter hypothesis is additionally supported by the fact that providing an assessment was associated with greater parent perception of safety during handoffs and transitions. Thus, although providing an assessment reduced family engagement as measured in this study, this checklist element should not necessarily be seen as a detriment to care. Future work could attempt to tease out these complex relationships, which may lead to improvements in the family-centeredness of this checklist item, for example, by engaging families in providing assessments of children’s progress.

    As with all studies, certain limitations are notable. As a single institution study, findings may not be generalizable to children’s hospitals broadly. Our study population had relatively few minority families and was better educated than the general population. Thus, we may be underrepresenting the impact of the checklist for these families, who may be especially likely to benefit, given that they are often more concerned about the safety of health care.46 In addition, because some tools for assessing family engagement have been validated only for English-speaking interactions, we excluded non–English-speaking families, who may face unique challenges in participating in FCRs. The checklist, however, does incorporate many of the recommendations for successful FCRs with non–English-speaking Latino families.47 Although randomizing 4 services would not be expected to balance measured and unmeasured covariates, trial arms were not significantly different across numerous relevant characteristics. In addition, we employed a pre–post controlled design to mitigate the impact of differences between services and also adjusted our models for imbalances and clinically relevant potential confounders. Coders were blinded, but they may have been able to distinguish between arms after coding multiple videos.

    Our intervention did not significantly affect performance of the remaining 5 checklist elements. For 2 of these, performance rates were high before the intervention. For other elements, performance improved in intervention and usual care services, perhaps because FCRs were a critically important hospital initiative or because the intervention diffused to usual care services through shared staff, such as nurses who worked on both intervention and usual care services daily and interns who cross-cover patients during nights and weekends. Although this diffusion limits our ability to detect significant intervention effects, we still found evidence of the intervention’s impact. To additionally enhance the family-centeredness of the performance of these elements, specific suggestions, such as inviting families to speak, ask questions, or share updates early in FCRs, might additionally improve the impact of the intervention.4850 Future research could also examine whether the intervention improved the family-centeredness of the health care team’s communication with families or had differential effects across services.

    Conclusions

    The FCR checklist intervention succeeded in increasing the performance of specific FCR elements. The intervention itself did not alter family engagement or parent perceptions of safety; however, performance of specific checklist elements significantly influenced both of these outcomes. Thus, the FCR checklist intervention can help effectively promote consistent delivery of high-quality, family-centered pediatric inpatient care while also improving patient safety from the perspective of parents.

    Footnotes

      • Accepted January 27, 2017.
    • Address correspondence to Elizabeth D. Cox, MD, PhD, Department of Pediatrics, University of Wisconsin School of Medicine and Public Health, 600 Highland Ave, H6/558 Clinical Science Center, Madison, WI 53792. E-mail: ecox{at}pediatrics.wisc.edu
    • This trial has been registered at www.clinicaltrials.gov (identifier NCT02625142).

    • FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

    • FUNDING: Funded through an Agency for Healthcare Research and Quality Health Services Research Dissemination and Demonstration grant (R18 HS018680) to Dr Cox. The project described was also supported by the Clinical and Translational Science Award program, previously through the National Center for Research Resources grant 1UL1RR025011 and now by the National Center for Advancing Translational Sciences grant 9U54TR000021. In addition, Dr Cox has received honoraria and contract funding from the Patient-Centered Outcomes Research Institute and serves on their Improving Healthcare Systems advisory panel. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. The funders and sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. Funded by the National Institutes of Health (NIH).

    • POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

    References