ARTICLE |
a Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada
b Divisions of Pediatric and Emergency Medicine
e Child Health Evaluative Sciences, Research Institute, Hospital for Sick Children, Toronto, Ontario, Canada
c Department of Pediatrics, Faculty of Medicine
Departments of d Health Policy, Management, and Evaluation
f Public Health Sciences
g Division of Emergency Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| ABSTRACT |
|---|
|
|
|---|
OBJECTIVE. Our goal was to describe the characteristics of children treated in emergency departments for asthma, the resources and asthma management strategies used by emergency departments, and their effect on return visits within 72 hours.
DESIGN, SETTING, AND PATIENTS. We used a population-based cohort study that incorporated both comprehensive administrative heath and survey data from all 152 emergency departments in Ontario, Canada. We studied all 2- to 17-year-old children who had a visit to an emergency department for asthma from April 2003 to March 2005.
RESULTS. A total of 32996 children (>9% of children with asthma in Ontario) had at least 1 visit to an emergency department for the care of asthma, and most of these visits (68.5%) were triaged as high acuity. The vast majority (148 of 152 [97%]) of emergency departments reported using at least 1 asthma management strategy, and 74% used 3 or more. The overall return-visit rate was 5.6%. Logistic regression models that accounted for the clustering of patients in emergency departments and controlled for patient and emergency department characteristics indicated that preprinted order sheets and access to a pediatrician for consultation were strategies significantly associated with a reduction in return visits. The 11 (17%) emergency departments that used both of these strategies had return visit rates of 4.4% compared with 6.9% in the 95 (63%) that used neither strategy.
CONCLUSIONS. Emergency departments use a range of strategies to manage asthma in children. Preprinted order sheets and access to pediatricians are associated with important reductions in return-visit rates, and more emergency departments should consider using these strategies.
Key Words: asthma return visits emergency department standardized order sheets guidelines
Abbreviations: ED—emergency department OR—odds ratio CI—confidence interval
Rates of childhood asthma have risen markedly in the Western world,1 with current prevalence estimates of 8.9% in the United States2 and 12% in Canada.3,4 Asthma is exceeded by only injuries and pneumonia as a cause for hospitalization in children5 and is estimated to account for
14 million lost school days per year in the United States.2 Acute exacerbations of asthma are often managed in emergency departments (EDs), which in the United States have seen a steady increase of these visits. In 2004, the number of ED visits for children reached >754000.2
Many national bodies such as the National Institutes of Health have developed ED treatment guidelines for asthma that focus not only on evidence-based pharmacotherapy to relieve the acute symptoms and the underlying inflammation but also on assessments of response to treatment and appropriateness for safe discharge.6–10 However, little is known as to whether or how EDs effectively implement these guideline practices.
Although there is great interest in identifying strategies for guideline implementation and quality improvement in all areas of medical practice, a recent review of existing research showed that little is actually known about what works.11 The authors highlighted that there are important limitations to generalizing results from 1 setting to another and that management that requires more complex medical decision-making poses many challenges to the implementation of clinical guidelines. In the case of ED management of childhood asthma, there is some literature on interventions to improve overall care, such as the use of clinical pathways,12 provider13 and patient14 educational interventions such as innovative decision support tools, to improve acute asthma care for children; however, most were reports from single-center trials, which occur often in the setting of an academic children's hospital and usually find some effect on processes of care but not always on patient outcomes.
The objectives of our study were to (1) describe the current asthma management strategies for children used by EDs in the province of Ontario and (2) test which strategies have an impact on 72-hour return visits by children. Return visits to the ED within a single asthma exacerbation are often used as an end point in clinical trials to measure the effectiveness of ED care15 and are used as a hospital quality measure in Canada.16 Expert panels on ED quality have suggested a 72-hour window after the initial ED visit as the most relevant period to assess ED care,17,18 with later revisits often serving as a function of issues such as access to follow-up which are not easily within the control of all EDs. The work of Emerman et al and the Multicenter Airway Research Collaboration19,20 has shown that for both children and adults, the risk of unscheduled return visits to the ED or another health care provider after an acute asthma exacerbation is high (up to 10% within 14 days in the largest prospective study in children).20 A number of studies have articulated important patient factors associated with relapse, including age, markers of chronic asthma severity such as a history of admissions and ED use, medication use, and environmental exposures such as cigarette smoke.20–22 However, few have identified ED interventions that can be effective in preventing relapse. The results of this study will provide an overview of ED-based asthma care for children and identify which interventions are associated with improved outcomes.
| METHODS |
|---|
|
|
|---|
Measures and Data Collection
We surveyed the EDs of all 164 acute care hospitals in Ontario during early 2005. The survey was beta-tested for clarity by a physician in a large academic ED and by a manager of a pediatric ED. Finalized surveys were sent to either the administrative manager or medical chief of the ED, previously identified as the best respondent for other surveys conducted for the Ontario Hospital Report.23 We asked the physician and manager about general resources such as the presence of a short-stay or observation unit, training of front-line medical staff (pediatric or pediatric emergency medicine), the availability of pediatricians for consultation, and specific questions around strategies for the management of asthma in children. These strategies included those directly recommended in Canadian guidelines (routine use of peak flow monitoring),9 others reported in the literature (availability of guidelines, standard order sheets, or personnel trained in asthma education),13,24–27 and those known to the authors to be in practice (preprinted discharge instructions or the ability to dispense aerochambers/spacers).
Records for visits to all EDs in Ontario from April 1, 2003, to March 31, 2005, were obtained from the National Ambulatory Care Reporting System, a routinely collected administrative health database. Anonymized unique identifiers allow linkages of records within the database to identify multiple visits by the same individual and can be linked to hospitalization data. Visits with an ED discharge diagnosis of asthma were selected to determine our cohort, the volume of all patients with asthma at each ED and calculate the propensity of each ED to admit children with asthma.
Our cohort consisted of all children 2- to 17-years old with an ED visit for asthma between April 14, 2003, and March 28, 2005. In the case of multiple visits for asthma, we chose the first visit and looked back to April 1, 2004, to exclude any patient who had a previous ED visit for asthma within the past 2 weeks. We defined an asthma visit as either a primary diagnosis of asthma or status asthmaticus (International Classification of Disease 10CA codes J45 and J46) or as secondary diagnoses with a primary diagnosis of wheeze, dyspnea, cough, or respiratory failure. Our outcome was unplanned (ie, unscheduled) return visits to any ED within 72 hours of the initial visit for patients who had been discharged from the hospital and who had not left the ED before the initial visit was completed.
Patients were allocated to the ED from which they were discharged on the initial visit. We described hospitals as being either academic or community. We categorized the latter group as small- and large-volume hospitals by using the median number of all ED visits by children 0- to 17-years old. We used the National Ambulatory Care Reporting System to assign an overall annual volume of asthma visits for patients of all ages. We excluded EDs with extremely low annual volumes of visits for asthma by children (
10th percentile).
To control for severity of asthma, we linked patients to the Discharge Abstract Database for Ontario, which contains all hospitalization records, and enumerated those with a previous admission for asthma within the 2 years before the ED visit. We used each child's postal code to describe the mean neighborhood income quintile at the level of dissemination area (average population of 650) based on the 2001 Canadian Census.
Statistical Analyses
To control for the possibility that some hospitals might have a lower threshold of admission, which might have an impact on return visits, we developed a measure of each ED's propensity to admit children with asthma. We used a logistic regression model with admission as the outcome to derive odds ratios (ORs) for all patient factors using the entire sample. We then calculated a rate of observed/expected admissions for each hospital by using the coefficients of this model. This observed/expected ratio was then added as a hospital-level characteristic to the main analyses that modeled return visits (see below).
For our main analyses we used logistic regression after we first developed a "risk-adjustment" model. We modeled the effect of patient factors (age, gender, history of previous admission, and neighborhood income quintile), most of which have been shown to be important in asthma relapse,20 and hospital characteristics (type, annual volume of all patients with asthma, and propensity to admit), which we hypothesized would have an effect on return-visit rates. We then individually added each ED strategy from the survey to this risk-adjustment model to test which strategy decreased the likelihood of return visits. We performed subgroup analyses according to hospital type and according to age for strategies that were relevant to academic hospitals only (front-line staff training in pediatrics or pediatric emergency medicine) and to older children (routine peak flow monitoring). Because patients at the same ED may have correlated outcomes, we adjusted all of our models for clustering of patients within EDs by using generalized estimating equations.28 We used an extension of the Hosmer-Lemeshow goodness-of-fit test to ensure model fit.29
| RESULTS |
|---|
|
|
|---|
3 million children of this age in Ontario) who visited 152 EDs for asthma. Overall, there were 49147 visits for asthma, which represented 3% of the 1598915 ED visits for this age group over the study period. There was a preponderance of ED visits for asthma among boys and children in lower-income neighborhoods. Academic and large community hospitals tended to treat younger children, and those of a higher triage score, with overall higher admission rates than those found in small community hospitals. All of these differences across hospital types were statistically significant. Controlling for patient factors, admission rates were not significantly different between hospital types or according to the presence of a short-stay unit in the ED (data not shown). Of the 27801 children discharged from the hospital after a complete ED visit, 5.6% had a return visit within 72 hours, with the highest rate being in the small community hospitals (7.1%). More than two thirds of the children who returned were triaged as needing urgent or emergent care or resuscitation (using Canadian Triage Assessment scores of 1–3)30, with a subsequent admission rate of 16.6%.
|
|
|
|
|
| DISCUSSION |
|---|
|
|
|---|
1 in 10 children with asthma had an ED visit in the study period. Of these children,
6% returned to the ED within 72 hours, the majority of which had high-acuity triage scores and many required admission. Although it is not clear how low return-visit rates could be, the analysis shows that there is variation in these rates, after adjustment for patient factors, and that EDs that use specific strategies have substantially lower return-visit rates than those that do not. The survey showed that almost all EDs reported having taken specific steps to try to ensure the delivery of high-quality care for asthma but that no one strategy or combination of strategies seemed to be used by most institutions. This finding may reflect, in part, a lack of shared knowledge about which strategies are effective. We found that 2 strategies, the use of a standard preprinted order sheet and the ability to access a pediatrician, were associated with a lower risk of return visits. The effect of these 2 strategies seemed to be additive. The study also showed that some strategies, although felt to be effective, did not seem widely used, and they were not associated with better outcomes. For example, although routine peak flow testing is recommended in many guidelines6–8 (although there were documented problems in the effective implementation of the tests, even in older children)31, we found that less than half of all hospitals, and fewer than 17% of academic hospitals, reported using this assessment tool and that this strategy was not associated with reduced return visits.
Return visits for asthma can reflect a number of problems in management, from inappropriate or delayed medication use32 to underestimation of either the acuity of the asthma exacerbation or the ability of the family to care for the child on discharge. The need for complex and coordinated care may explain why standard order sheets and pediatrician care were found to be associated with better outcomes, whereas individual activities such as aerochamber dispensing were not. When we reviewed the majority of these order sheets, the content and form varied. However, the dosing of bronchodilators (salbutamol and ipatropium bromide) and systemic steroids were documented on a consistent basis. All but 4 forms had criteria for assessment of severity, and 2 had space to document clinical reassessments. Only 3 forms had specific discharge criteria, but all but 4 required documentation of follow-up plans.
This study cannot identify the specific components of these order sheets that account for their effectiveness, but the timely use of evidence-based medications is likely to be an important component, given its consistent appearance in all of them. A previous study of adults with asthma found that the use of a preprinted order sheet in the ED resulted in more timely administration of both oral steroids and bronchodilators, with reduced admission rates but not return visits.25 Other studies on clinical pathways in adults and children have also described improved rates of appropriate steroid use,12,33 with no effect on return visits, but the samples were small. It is noteworthy that having asthma management guidelines in the ED did not have the same effect as having a standard order sheet as part of active management. This finding is consistent with what is known from the literature on translating evidence into practice, namely, that guidelines are most effective when embedded in practice.11
Our positive finding for access to a pediatrician for consultation is in line with evidence that more specialized personnel are more likely to be aware of, and compliant with, guideline care for asthma.34 Although not every patient in a hospital with pediatricians would necessarily receive such a consult, the fact that the benefit was similar to having front-line staff trained in pediatrics or pediatric emergency medicine implies some benefit to being seen by staff with pediatric training. Although it is not feasible for every hospital to have a pediatrician on staff, it would be worthwhile to explore what part of the care is optimized by having this resource and whether this benefit could be translated to other providers. Alternatively, there has also been a move toward access to specialists through telemedicine for other common conditions seen in EDs, such as stroke.35
Although having a pediatrician accessible may be difficult to implement, it is worth noting that a preprinted order sheet (or the equivalent in computerized order entry systems) was equally effective at decreasing return visits but was the least frequently implemented strategy, being used by only 17% of all hospitals (including academic ones) that we studied. These order sheets are inexpensive and likely to be accepted in practice.36 It may be appropriate for national bodies such as the Pediatric Section of the Canadian Association of Emergency Physicians or the American Academy of Pediatrics Committee on Pediatric Emergency Medicine to develop a standard form or its computer entry order system equivalent. Future studies should explore what aspects of care (appropriate medication use, discharge planning, etc) this form improves; this may inform what other types of conditions seen in EDs could be improved by the use of standard order sheets.
There are a number of limitations of our study. First, the survey data were reported by a single respondent at the hospital. Although these data had been selected previously by the institution as being the most appropriate means of response, we did not verify any of the data from the questionnaires. The administrative data on ED visits had not been independently validated, although hospitals were asked to verify data that were produced as part of the regular hospital reports.
The analysis of the association between reported strategies and observed outcomes was observational and may have been susceptible to selection bias. Although randomized trials may provide the most valid estimates of the impact of specific clinical interventions, they can be difficult to apply to studies of broad organizational interventions, and the results are difficult to generalize. Well-designed observational studies often can provide useful information on real-world effectiveness of interventions to improve the quality of care.37 Our study design allowed us to study interventions as currently practiced in a range of different ED settings for a large number of children.
Although our analysis was at the level of the patient, we also do not know whether every patient received each intervention at a site with the intervention available (peak flow monitoring, a pediatric consult), and there may have been variation in the use of each strategy by different hospitals. In particular, our data set did not allow us to explore at the individual patient level which children were seen in consultation by a pediatrician in those EDs with access to one. In the analysis, we treated all patients in an ED as being exposed to the intervention if the ED reported that they used it, so this approach might underestimate effects if not all patients were actually exposed.
Similarly, the details of strategies such as using order sheets vary, and as such, we were testing a heterogeneous group of interventions under the same strategy category. However, our results reflect real-world implementation and, thus, are likely to be an accurate reflection of the effectiveness of a given strategy.
Finally, we were not able to control for other factors that might have an impact on the recidivism. Although we speculate that the effect of the preprinted order sheet was likely related, at least in part, to use of systemic steroids, we did not have access to any individual-level data about drugs that were administered during the visit or prescribed on discharge. We also do not have data on medication use, such as inhaled corticosteroids, before the initial visit or on follow-up visits after discharge. However, our previous expert panel work17,18 suggested that recidivism within 72 hours is directly related to ED management and not to outpatient follow-up care. We were also limited by our data in terms of how well we could adjust for severity of asthma. Without drug-use data, we were unable to use measures of persistence such as the Health Plan Employer Data and Information Set criteria, although this definition of persistence has been shown to have limitations in reflecting both the persistence38 and severity39 of the disease. As others have done,20,40,41 we used a history of previous admission as a marker of severity or poor control, and we controlled for acuity at triage. Many of the criteria used to triage children with asthma such as respiratory rate and oxygen saturation have been shown to predict severity of the acute exacerbation.42,43
| CONCLUSIONS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Address correspondence to Astrid Guttmann, MDCM, MSc, Institute for Clinical Evaluative Sciences, G Wing, Sunnybrook and Women's College Health Sciences Centre, 2075 Bayview Ave, Toronto, Ontario, Canada M4N 3M5. E-mail: astrid.guttmann{at}ices.on.ca
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||