a Department of Pediatrics, Michigan State University College of Human Medicine, Marquette, Michigan
b Marquette Family Practice Residency Program, Marquette, Michigan
| ABSTRACT |
|---|
|
|
|---|
METHODS. A decision tree analysis incorporating the total cost and health impact of each management strategy was used to determine cost per quality-adjusted life-year ratios. Sensitivity analyses and Monte Carlo simulations assessed the accuracy of the estimates.
RESULTS. From a societal perspective with current Medicaid reimbursements for testing, performing a throat culture for all patients had the best cost-utility. For private insurance reimbursements, rapid antigen testing had the best cost-utility. Observing without testing or treatment had the lowest morbidity rate and highest cost from a societal perspective but the lowest cost from a payer perspective. The model was most sensitive to the incidence of acute rheumatic fever and peritonsillar abscess after untreated GAS pharyngitis. Monte Carlo simulations demonstrated considerable overlap among all of the options except for treating all patients and observing all patients.
CONCLUSIONS. Observing patients with pharyngitis had the lowest morbidity rate. The costs of this option were primarily from parental time lost from work. Before recommending observation rather than treatment of GAS pharyngitis, accurate estimates of the risk of developing acute rheumatic fever and peritonsillar abscess after GAS pharyngitis are needed.
Key Words: group A streptococcus pharyngitis cost-utility analysis peritonsillar abscess acute rheumatic fever
Abbreviations: GASgroup A hemolytic streptococcal QALYquality-adjusted life-year QALDquality-adjusted life-day PTAperitonsillar abscess ARFacute rheumatic fever AAPAmerican Academy of Pediatrics IDSAInfectious Diseases Society of America CIconfidence interval
Pharyngitis in the pediatric age group is a common complaint, but the optimal approach for these patients has been a matter of debate, primarily driven by the desire to identify, treat, and avoid the complications associated with group A hemolytic streptococcal (GAS) pharyngitis, including acute rheumatic fever (ARF), peritonsillar abscess (PTA), rheumatic heart disease, and death. To date, 6 approaches have been identified, each with its strengths and weaknesses. The first approach, treating all patients with pharyngitis without testing, has the advantage that no case of GAS pharyngitis that presents to a physician goes untreated. Unfortunately, this approach involves treating 70% to 90% of patients with pharyngitis who do not have GAS pharyngitis. Treatment with antibiotics can have side effects, including anaphylaxis and death. Also, indiscriminate antibiotic use has been linked to antibiotic resistance.
The second approach, observing all patients without providing testing or treatment, saves the costs of testing and treatment. Because nearly all cases of GAS pharyngitis resolve spontaneously, the health preserved through treatment may be minimal. The risks associated with antibiotic use are avoided. Conversely, early treatment with antibiotics may decrease the symptoms of GAS pharyngitis by 1 or 2 days and may prevent other rare complications of untreated GAS pharyngitis, including PTA, ARF, rheumatic heart disease, and death.
The third approach, testing all patients with pharyngitis with a rapid antigen test and treating those with positive test results with antibiotics, identifies nearly all individuals with GAS pharyngitis and avoids antibiotic use for those with pharyngitis resulting from other causes. A few patients with GAS pharyngitis are missed and face the risk of untreated disease. This approach is recommended by the American Academy of Pediatrics (AAP) and the Infectious Diseases Society of America (IDSA), if physicians validate adequate sensitivity of the test in their practice.1, 2 The ISDA also recommends this approach for adult patients.2
The fourth approach, testing all patients with pharyngitis with a throat culture and treating those with positive test results with antibiotics, has the advantage of missing few cases of GAS pharyngitis but has the disadvantage of a 2-day delay until treatment is initiated. This increases morbidity and parental lost wages. This is one of the approaches recommended by the AAP,1 the IDSA,2 and the Institute for Clinical Systems Improvement.3
The fifth approach, testing all patients with pharyngitis with a rapid antigen test, treating those with positive test results with antibiotics, and performing a culture for those with negative test results, is a very popular approach. It allows most patients with GAS pharyngitis to initiate therapy immediately and allows nearly all cases of GAS pharyngitis to be identified. It does, however, add the expense of a second test for the 70% to 90% of patients with non-GAS pharyngitis. This is one of the approaches recommended by the AAP and the ISDA.1, 2
Finally, a clinical scoring system to triage the diagnostic approach would ignore those with a low score, test and treat those with positive results with an intermediate score, and treat without testing those with a high score. This scenario combines the advantages and disadvantages of the other approaches. This approach is recommended for all patients by the American Academy of Family Practice4 and for adult patients by the Centers for Disease Control and Prevention.5
Although several studies have explored the cost-effectiveness of different approaches to pharyngitis, the findings of these studies are often presented in dollars saved per rare complication of GAS pharyngitis avoided. For the average practitioner, who is unlikely to have ever seen these complications, this method of reporting the results means little. More valuable to clinicians is a determination of which approach preserves the most health for the money. Cost analyses and cost-effectiveness analyses involving the pediatric population have been performed and reported, but their results have been suspect or difficult to interpret. For example, a 1999 cost analysis favored the third approach, but the study had assumed an inexplicably low cost for throat culture and a low sensitivity for the rapid antigen test, inconsistent with today's clinical practice. The study also failed to provide a sensitivity analysis.6 A more recent study's outcome measure was the cost to prevent 1 case of rheumatic fever.7
None of the analyses of the diagnostic and therapeutic approaches to pharyngitis among children and adolescents measured health outcomes or included a no-testing/no-treatment scenario. To assess the health care value of the 6 options properly, costs must be estimated accurately and health outcomes included. The most commonly used yardstick for health outcomes is quality-adjusted life-years (QALYs). Although a recent study among adults used this standard for health outcomes,8 a cost-utility analysis of the diagnostic and treatment approaches for pharyngitis among children would be substantially different. For example, an analysis involving children would need to include the cost associated with parents missing work to stay home and care for a sick child. The number of QALYs lost because of chronic illness or death would be higher for children. Finally, the incidence of GAS pharyngitis among those presenting to a physician with pharyngitis is higher among children than among adults.9
GAS pharyngitis has a self-limited course, with infrequent complications. We hypothesize that forgoing testing for and treating GAS pharyngitis among children and adolescents may be a cost-effective option, compared with 5 established testing and treatment options currently used in clinical practice. To test this hypothesis, we estimated and compared the cost-utility of these 6 approaches for a patient presenting with pharyngitis, to identify the optimal approach.
| METHODS |
|---|
|
|
|---|
The medical literature was searched by using PubMed, with search phrases of "group A streptococcal pharyngitis" alone and with "cost-effectiveness" and "cost-utility." Additional references were found in the bibliographies of the reviewed articles.
The model used the societal perspective and a discount rate of 3% as part of the reference case standard developed by the Panel on Cost-Effectiveness in Health and Medicine convened by the US Public Health Service in 1993.11 The probability assumptions used in the model are shown in Table 1.
|
|
|
|
4 were treated without testing. Because McIsaac et al15 excluded scores of 1 and 0 from their study, enough patients with scores of 0 and 1 were added to this model to give an overall incidence of GAS of 26%. Those with a score of 0 or 1 were assumed to have a 5% incidence of GAS. The incidences for the other scores and their ranges, the 95% CIs, were taken from the study by McIsaac et al.15 Several of the values used for the variables deserve comment. First is the incidence of abscess formation. Treatment of pharyngitis with antibiotics reduces the risk of developing PTA sixfold to ninefold.23, 24 The incidence in untreated GAS pharyngitis is not well studied, but values between 0.5%7 and 3%25 have been put forth. We used an incidence of 1.5% for our baseline estimate, with a range of 0% to 3%.
Second is the incidence of ARF. Treatment of GAS pharyngitis with antibiotics reduces the risk of ARF eightfold.12 A current accurate estimate of ARF risk is unavailable. In 1961, Seigel et al26 reported 2 cases of ARF among 608 patients with untreated GAS pharyngitis (0.328%; 95% CI: 00.784%). There is evidence suggesting that the incidence of ARF has decreased 50-fold since then.27 Consequently, we estimated the incidence of ARF to be one fiftieth the incidence reported by Seigel et al.26 Ten percent of ARF cases result in complications and 1% in death.28, 29
Third is the cost of throat culture. Previous estimates of the cost of throat cultures were based on the culture being performed in the physician's office.8, 16, 30 This is no longer a common practice.7 We used $30 as the private patient cost and $5 as the Medicaid cost.
Fourth is the cost of death. The cost of lost future wages cannot be used in the standard reference case.11 This cost is an approximate estimate of the medical costs incurred before death.
Fifth is the utility of treatment of GAS pharyngitis. Treatment of GAS pharyngitis with antibiotics hastens recovery, with quicker resolution of sore throat, headache, abdominal pain, and fever.24, 31 Symptoms improve 16 hours to 2.5 days sooner.24, 25, 3235 Utility measures are those used by Neuner et al.8
Sixth is cephalosporin versus penicillin. A recent meta-analysis suggested that cephalosporins are more effective in the treatment of GAS pharyngitis.36 We modeled this by assuming that the costs of a first-generation cephalosporin were $20.29, based on the Red Book costs and the pharmacy fee.17 We assumed that the efficacy improved from 80% to 86%.
Sensitivity analysis of each variable (costs, incidences, and morbidity) across its CI was performed and tornado diagrams were developed. A tornado diagram shows the impact of the range of each variable on the model's outcome. The variables are ordered with those with the broadest range of impact on the top. Variables with progressively narrower ranges of impact are placed below, giving an appearance similar to that of a tornado. Two- and 3-way sensitivity analyses were performed for the most influential variables. Threshold values for variables for the most influential variables were determined. For comparison, analyses were performed by using a payer perspective, in addition to the societal perspective. A CI for the estimated costs and utility for each of 6 options was estimated with Monte Carlo simulation with 10000 repetitions. Monte Carlo simulations use random sampling techniques to assign values from within a specified range and distribution for each of the variables in the model. The cost-utility model is run once with the value of each variable assigned. With repeated simulations, a distribution of results for the model is generated, from which mean values and CIs can be estimated. The analyses were performed with DATA 3.5 for Healthcare for Windows (TreeAge Software, Williamstown, MA).
| RESULTS |
|---|
|
|
|---|
|
|
|
When a societal perspective is used and testing is reimbursed at private insurance rates, treating all cases of pharyngitis is dominated by the clinical scoring, rapid test, and culture options. The rapid test then culture option is dominated by both the rapid test and culture options. To move from the scoring option to the rapid test option, which has lower morbidity rates, would cost $32132.01 per QALY, which by our criteria is worth the expense. To move from the rapid test option to the culture all option would cost $1677492.39 per QALY, and moving to the test none option would cost $233034.71 per QALY. Consequently, in this reimbursement setting, performing a rapid test for all patients with pharyngitis has the best cost-utility. From the payer perspective, the test none option dominated all other options by having the lowest morbidity rate and the lowest cost.
Tornado diagrams are depicted in Figs 3 and 4 for impact on costs and utility, respectively. Not surprisingly, the incidences of PTA and ARF after untreated GAS pharyngitis have the largest impact on the model. For example, 4 of the 5 factors most influential with respect to morbidity reflect the incidence and health impact of PTA and ARF.
|
|
|
The results of the Monte Carlo analysis are shown in Table 6 and as health policy space in Fig 6. In the comparisons of the options, the treat none option was significantly more costly (P > .05) than the scoring, rapid test, culture all, and rapid test then culture options. Conversely, the treat all option has significantly more (P > .05) morbidity than all other options. The treat none option had significantly less morbidity than all other options. The error in the model, as evidenced by the 95% CI bands, makes it difficult to recommend definitively one of the testing options over the others.
|
|
| DISCUSSION |
|---|
|
|
|---|
The justification for testing for and treating GAS pharyngitis among children is to prevent the sequelae of infection. With the risk of ARF being one fiftieth of that reported previously, this model reflects the minimal impact of this complication. Not surprisingly, the incidence of the serious complications from GAS pharyngitis had the most impact on the model. Unfortunately, the studies in which the incidences of ARF and PTA after untreated GAS pharyngitis were estimated are few in number and markedly outdated. We think our estimate of PTA overstates the risk of this complication, because it is rarely seen in a primary care practice. If for every patient seeking health care with a sore throat there are 4 to 6 who do not,37, 38 one would expect to treat more cases of PTA, considering that many, if not most, cases of GAS pharyngitis never present to a physician for care. Conversely, the overprescription of antibiotics may have a role in the decreased incidence of ARF. If treatment of GAS pharyngitis is to be recommended, then the rates of ARF and PTA among untreated patients need to be measured accurately, to justify this recommendation.
Several analyses have suggested that cephalosporins are more effective in eradicating GAS from the throat of affected individuals. Some have suggested that these differences merely reflect the ability of cephalosporins to eradicate GAS in the throat of those normally colonized with the organism. We attempted to measure the impact of using a more expensive antibiotic with slightly improved efficacy, and we found that using low-priced first-generation cephalosporins could decrease costs and morbidity rates. The science behind the increased effectiveness of the cephalosporins has, however, been called into question.39
The financial costs estimated with these models, much like other cost-utility analyses involving children,40 are driven by parental time lost from work. Inclusion of this element in the societal perspective continues to be controversial. One issue driving the controversy is parental time lost from work for contagious infectious illnesses with little morbidity. Small changes in length of illness translate into large changes in overall costs, because the costs from parental time lost from work are disproportionate to the medical costs associated with the illness.
To convey the influence of this factor, most analyses report results from both the payer perspective and the societal perspective. This analysis is no different. The recommended option is markedly different, depending on the model's perspective.
To measure the certainty with which recommendations can be made, the CIs of the model estimates need to be calculated. One method is to calculate the most extreme situations and to expect that the 95% CIs of the estimates lie within that range. The preferred alternative is to use Monte Carlo simulations. By running the model 10000 times, with values for the variables selected from their expected ranges and distributions, a probability distribution for the model estimates is produced. This gives a clearer idea of the model's variability and reliability. In this case, 4 of the options demonstrated considerable overlap. The variability and overlap seen in our Monte Carlo simulations help explain the varying recommendations from previous studies. These simulations also provided the range within which this model can be trusted. Most of the variance in the model is from imprecision and lack of confidence in the accuracy of model assumptions, which reflect the quality of studies on which the values of the assumptions were based.
As with any model, the results are driven by the model's assumptions. For example, Lieu et al18 assumed that the rapid test had a sensitivity of 55% and that a culture cost $5. Not surprisingly, their model recommended throat cultures over the rapid test. Several studies have recommended the rapid test, primarily because of delays in treatment associated with using throat cultures.16, 29, 32
One study found that patients with non-GAS pharyngitis treated with antibiotics had symptoms for 0.9 days less than patients with non-GAS pharyngitis not treated with antibiotics.25 Other studies failed to document the same results.31, 34 If antibiotics shorten the duration of non-GAS pharyngitis, then the treating all patients with pharyngitis may become a reasonable option. Clearly, this is an area deserving additional study.
Before recommending observation rather than treatment of GAS pharyngitis, accurate estimates of the risk of developing ARF and PTA after untreated GAS pharyngitis, both regionally and nationally, are needed. If these risks are found to be low enough to support observation instead of testing and treatment, then the next major barrier would be to make observation acceptable to parents.
| FOOTNOTES |
|---|
Address correspondence to Robert S. Van Howe, MD, MS, FAAP, 1414 W Fair Ave, Suite 226, Marquette, MI 49855. E-mail: rsvanhowe{at}mgh.org
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
H. C. Maltezou, V. Tsagris, A. Antoniadou, L. Galani, C. Douros, I. Katsarolis, A. Maragos, V. Raftopoulos, P. Biskini, K. Kanellakopoulou, et al. Evaluation of a rapid antigen detection test in the diagnosis of streptococcal pharyngitis in children and its impact on antibiotic prescription J. Antimicrob. Chemother., September 30, 2008; (2008) dkn376v2. [Abstract] [Full Text] [PDF] |
||||
![]() |
T A Gaziano Economic burden and the cost-effectiveness of treatment of cardiovascular diseases in Africa Heart, February 1, 2008; 94(2): 140 - 144. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||