ARTICLE |
a Department of Pediatrics, University of California, San Francisco, California
b California Department of Health Services, Richmond, California
c Health Strategies International, Orinda, California
| ABSTRACT |
|---|
|
|
|---|
METHODS. We constructed a decision tree to determine the costs and clinical outcomes of using targeted testing compared with universal screening or no screening. Baseline estimates for input parameters were taken from the medical literature and from California health jurisdiction data. Sensitivity analyses were performed to determine plausible ranges of associated outcomes and costs. We surveyed California health jurisdictions to determine the prevalence of mandatory universal tuberculin skin testing.
RESULTS. In our base-case scenario, the cost to prevent an additional case of tuberculosis by using targeted testing, compared with no screening, was $524897. The cost to prevent an additional case by using universal screening, compared with targeted testing, was $671398. The incremental cost of preventing a case through screening remained above $100000 unless the prevalence of tuberculin skin testing positivity increased to >10%. More than 51% of children entering kindergarten in California live where tuberculin skin testing is mandatory.
CONCLUSIONS. The cost to prevent a case of tuberculosis by using either universal screening or targeted testing of kindergarteners is high. If targeted testing replaced universal tuberculin skin testing in California, then $1.27 million savings per year would be generated for more cost-effective strategies to prevent tuberculosis. Improving the positive predictive value of the risk factor tool or applying it to groups with higher prevalence of latent tuberculosis would make its use more cost-effective. Universal tuberculin skin testing should be discontinued, and targeted testing should be considered only when the prevalence of risk factor positivity and the prevalence of tuberculin skin testing positivity among risk factor–positive individuals are high enough to meet acceptable thresholds for cost-effectiveness.
Key Words: tuberculosis cost-effectiveness school health services mass screening tuberculin test
Abbreviations: TST—tuberculin skin testing TT—targeted tuberculin skin testing PTCG—Pediatric Tuberculosis Collaborative Group RQ—risk factor questionnaire QALY—quality-adjusted life year BESS—Medicare Part B Extract Summary System
Routine tuberculin skin testing (TST) of children entering kindergarten is often practiced in the United States, despite recommendations of major policymaking organizations.1–3 One reason for its persistence may be that these organizations have not collaborated on specific alternative recommendations for specific ages. For example, in 2004, the Pediatric Tuberculosis Collaborative Group (PTCG) released guidelines recommending that universal TST should be replaced by risk factor screening followed by targeted TST for individuals with
1 positive response on the risk factor questionnaire (RQ).4 The recommended RQ is based on evidence from a variety of studies in pediatric populations5–11 and includes questions on country of birth, travel history, tuberculosis exposure, and close contact with someone with positive TST results. However, the PTCG did not specify optimal age groups for testing, and its guidelines suggest that testing in older age groups may be preferable.
In the absence of specific guidelines, public health officials have made individual decisions based on the available evidence and local preferences. In California, local health officers mandate universal prekindergarten TST in many counties and school districts. Universal TST is also required by the state's Medicaid program, through the screening component of the Early and Periodic Screening Diagnosis and Treatment benefit. A decision analysis showed moderate cost-effectiveness for universal screening in Santa Clara county in 1995,12 and individual health officers and program officers have used these findings to make decisions regarding screening. Children in districts and jurisdictions that do not require universal TST may receive TST, risk factor screening followed by targeted TST (TT), or no screening at all at the well-child check before kindergarten entry. Similar inconsistencies have been noted in other states.13,14
TT has been shown to be more cost-effective than universal screening for some populations of US children.12,15 However, the cost-effectiveness of using the newly developed RQ for prekindergarten screening has not been evaluated. To determine the economic and health consequences of alternative strategies for screening children in this age group, we undertook a decision analysis comparing mandatory universal TST, mandatory TT using the RQ, and no mandatory screening. We used a range of estimates for risk factor prevalence, risk of progression to disease, and proportion of TST-positive individuals in the population. We also examined the possible costs and health outcomes expected to be associated with these 3 strategies in California.
| METHODS |
|---|
|
|
|---|
|
1 risk factor would receive TST. The third alternative was no screening. Before kindergarten entry, TST would not be administered unless a provider suspected tuberculosis (eg, the child had symptoms of tuberculosis disease or the child was identified as a contact of a patient with an active case of tuberculosis). We made the following clinical assumptions. (1) All children entering kindergarten are between 4.5 and 6 years of age. (2) Screening would not identify any prekindergarten children with active tuberculosis disease beyond those who would have been identified clinically. (3) Positive TST results for children 4.5 to 6 years of age would not result in a source case investigation (consistent with current national guidelines).18 (4) Tuberculosis disease from 5 to 10 years of age would not initiate a contact investigation. (5) Isoniazid therapy would reduce the incidence of tuberculosis by 70%.3,19–22
Model Input Estimation and Sensitivity Analyses
Estimates for model inputs were obtained from the medical literature and from data provided from selected California health jurisdictions. The medical literature was searched by using Medline, manual searches of references in available literature articles, and personal questioning of tuberculosis control experts. All primary sources were obtained and examined, with questioning of authors if available.
We established a base-case scenario by using the best estimates available for each parameter. For each input, we then determined a plausible range for sensitivity analyses, on the basis of high and low estimates found in the relevant literature. We conducted 1-way sensitivity analyses for each of 4 key model inputs. We also conducted 2-way sensitivity analyses for selected pairs of inputs. The probabilities used at baseline, the minimal and maximal values for each parameter from the medical literature, and the plausible ranges used for sensitivity analyses are presented in Table 1. The rationale for the choice of baseline values is described in the Appendix.
|
Published reports of the specificity of TST range from 90% to 99%.26–29 However, this range was inconsistent with our base-case parameters. Our base-case parameter for the prevalence of TST positivity in the risk factor–negative population was 0.37%, which implies a specificity of not less than 99.6% in that group. The true specificity of TST in our population is not known. However, with higher assumed specificity, any screening intervention seems more cost-effective. Therefore, to allow comparison with current practice in the most conservative manner, we assumed as follows. For our base-case scenario, we postulated that TST had different test characteristics in these 2 populations because of different exposure to BCG vaccine and atypical mycobacteria, both of which may tend to increase false-positive rates and are more common in areas from which individuals tend to immigrate to California.30–32 We then used the highest published specificity, 99%, for the risk factor–positive population and assumed a higher specificity of 99.9% for the risk factor–negative population. We then performed a sensitivity analysis by using a high specificity of 99.9% for both populations.
Costs
Cost estimates are presented in 2004 US dollars. Major costs are summarized in Table 2. A detailed description of cost derivation is available from the corresponding author.
|
Costs of Risk Factor Screening
The RQ was assumed to require 2 minutes of licensed practical nurse time and 0.5 minutes of physician time for review of results, leading to a total cost of $1.41.
Costs of Evaluation and Treatment of TST-Positive Cases Identified Through Screening
For each positive TST result in the prekindergarten screening cohort, we assumed 1 medical visit and 1 chest radiograph, at costs based on BESS data.33 We assumed that all those who completed therapy would use 9 months of isoniazid, at an estimated medication cost based on 2004 Red Book wholesale prices,35 and that those who did not complete therapy would receive 2 months of isoniazid. We assumed 10 minutes of time for nurse management of refills and symptoms. Isoniazid-associated hepatitis is a very rare event in this age group. A health department-based study found no cases of hepatotoxicity among 1468 children 0 to 14 years of age,36 and no case report of significant toxicity from this cause in children <7 years of age could be found in the literature.37–40 Therefore, our model did not include any costs for treatment of hepatotoxicity.
Costs of Active Tuberculosis Disease
We estimated the average cost for a future case of tuberculosis, for age groups 5 to 14 years and 15 to 24 years. The components of this cost were based on expert opinion regarding the standard of care, although we note that there might be variation among practitioners. Included were costs for medical doctor visits estimated by using BESS data,33 costs for antimycobacterial drugs estimated by using the 2004 Red Book,35 costs for sputum assessments estimated by using Current Procedural Terminology codes, and costs for radiology and other laboratory studies estimated by using BESS data.33 Nurse case management time was estimated by using Bureau of Labor Statistics data. Directly observed therapy costs were calculated by averaging estimates from 3 articles.41–43 Hospitalization costs were calculated from the Centers for Disease Control and Prevention Cost of Hospitalization Study, which includes all costs of hospitalization for tuberculosis according to age group.44 Costs of contact investigation for those developing active tuberculosis in adulthood were derived from a California cohort of investigations in 1999 to 2000.45 Costs for contacts were derived by using the aforementioned estimates and data from the US Public Health Service study46 and the published literature regarding isoniazid toxicity in adults.36,47,48
Survey
To determine the scope of possible changes in screening policy, we surveyed all 61 California health jurisdictions regarding whether TST was required for school entry at kindergarten or at any other time. We asked jurisdictions that had access to TST results from prekindergarten screening to provide summary information, including data on place of birth and incidence of TST positivity. Population estimates for California children 5 to 9 years of age were obtained from the California Department of Finance for 2004.49 The survey instrument is available from the corresponding author.
| RESULTS |
|---|
|
|
|---|
|
Of 100000 children screened, no children would begin isoniazid prophylaxis with the no-screening alternative, 795 children would begin isoniazid prophylaxis with TT, and 1170 children would begin isoniazid prophylaxis with universal screening. Because 795 children would begin isoniazid prophylaxis with TT who would not have received isoniazid with no screening, and because TT would avert 1.8 cases of tuberculosis, compared with no screening, 440 children would be treated with isoniazid to prevent 1 case of tuberculosis if TT were used instead of no screening. Because 375 children would begin isoniazid prophylaxis with universal screening who would not have received isoniazid with TT, and because universal screening would avert 0.74 cases of tuberculosis, compared with TT, 507 children would begin isoniazid prophylaxis to prevent 1 additional case of tuberculosis if universal screening were used instead of TT.
Sensitivity Analyses
The incremental cost of using universal testing instead of TT was very sensitive to variations in the probability of TST positivity in the risk factor–negative population. Varying this parameter over a plausible range resulted in estimates of $316054 to $11804901 per case of tuberculosis prevented by using universal testing instead of TT (Fig 2A). The incremental cost-effectiveness of using TT instead of no screening was very sensitive to variations in the probability of TST positivity in the risk factor–positive population. Varying the probability of TST positivity over a plausible range resulted in estimates of $36984 to $653547 per case of tuberculosis prevented by using risk factor screening instead of no screening (Fig 2B).
|
In a sensitivity analysis that assumed that the specificity of the test was 99.9% for both the risk factor–negative and risk factor–positive populations, TT was shown to avert 4.6 cases of tuberculosis per 100000 children screened, compared with no screening, at a total cost of $941965. Therefore, TT had an incremental cost-effectiveness of $204175 per case of tuberculosis averted, with these assumptions about specificity. The incremental cost-effectiveness of universal screening, compared with TT, was unchanged in this sensitivity analysis.
Threshold Analysis
The incremental cost of using universal testing instead of TT to prevent an additional case of tuberculosis did not fall below $100000 when any plausible range for risk factor prevalence was combined with any plausible range for the prevalence of TST positivity among the risk factor–negative children. The incremental cost-effectiveness of using TT instead of no screening fell below $50000 when the prevalence of risk factor positivity was
18% and the prevalence of TST positivity among the risk factor–positive children was
13%. The incremental cost of using TT instead of no screening fell below $100000 when the prevalence of risk factor positivity was
10% and the prevalence of TST positivity among the risk factor–positive children was
7% (Fig 3).
|
51% of California children overall lived in health jurisdictions that required TST before kindergarten entry and
252405 children entered kindergarten in areas of California that required universal TST. | DISCUSSION |
|---|
|
|
|---|
252405 children 5 years of age live in jurisdictions that require universal testing, each year of using TT instead of currently mandated universal testing would save California $1.27 million. Each year of using TT in place of currently mandated universal testing would result in only 1.89 additional cases of tuberculosis over the subsequent 20 years. The $1.27 million in annual savings would be better invested in more cost-effective strategies to prevent tuberculosis.
Our results support strongly the recommendations of the PTCG for discontinuing universal TST of children. The incremental cost of universal screening is very high under our base-case scenario and remains quite high over a wide range of plausible circumstances. However, our results also suggest that the RQ recommended by the PTCG is not optimal for our cohort. The positive predictive value of the recommended RQ for predicting positive TST results in our base-case population is only 1.59%, and our study shows that TT remains costly, compared with no screening, when the prevalence of TST positivity in the population screened is relatively low. Foreign birth has been shown to be the strongest predictor of positive TST results for children without clinical risk factors for tuberculosis.5,7 If foreign birth were the only question used to predict risk factor status, then TT might prove to be more cost-effective than it is using the currently recommended RQ. In Santa Clara and Los Angeles, for example,
15% to 18% of foreign-born kindergarteners have positive TST results and 7% of the kindergarteners are foreign born.12,50 Threshold analyses show that the incremental cost-effectiveness of TT, compared with no screening, falls below $100000 when these estimates are used for the prevalence of foreign birth and the prevalence of TST positivity among foreign-born children.
Therefore, improving the risk factor screening tool may make TT more cost-effective. The choice of age group for screening may also have a strong impact on cost-effectiveness. There are 3 reasons why screening of kindergarteners may be much less cost-effective than screening of older age groups. First, the prevalence of latent tuberculosis infection is relatively low among kindergarteners, compared with older school-aged children. Our sensitivity analyses indicate that both universal screening and TT are much more cost-effective when the prevalence of TST positivity is higher. Second, the risk of transmission from subjects who develop active tuberculosis during childhood is much lower than the risk of transmission from subjects who develop tuberculosis during adolescence or later in adulthood, leading to an overall low rate of secondary transmission for kindergarteners.51 Our estimates of secondary transmission would be higher if our cohort were older. Third, 5 years of age marks the beginning of the "favored age," in which children are less likely to develop tuberculosis disease.51 Our sensitivity analysis of the risk of progression to disease shows that incremental costs per case of tuberculosis averted are lower in populations with a higher risk of progression to disease. Our results suggest that tuberculosis screening would be more cost-effective in older age groups, in which the prevalence of TST positivity, the risk of developing active disease, and the risk of transmitting disease are higher. However, additional research is needed to determine whether increased nonadherence and hepatotoxicity in older children outweigh the benefits of later screening.10,37,40
Our results differ from those obtained in Santa Clara with a screening cohort from 1992, in which TT was found to be cost-effective.12 In contrast to our work, the Santa Clara study used a single question regarding place of birth to determine risk status and the prevalence of TST positivity in their foreign-born kindergartners was 18%, which would improve cost-effectiveness substantially. In addition, our study used a 20-year time horizon, whereas the Santa Clara analysis used a lifetime horizon, although the impact is lessened by the 3% annual rate of discount used in both studies.
There are several important limitations to our study. First, the risk of progression to disease and the specificity of TST are both parameters that are challenging to estimate for US children. However, examination of a wide range of plausible estimates for these parameters showed no incremental cost-effectiveness less than $390000 per tuberculosis case averted. Second, our model assumes that universal TST or TT detects no cases of active tuberculosis disease in prekindergarteners and that children with active tuberculosis have symptoms that prompt their clinicians to perform TST at the time of their prekindergarten well-child checks. One universal TST program identified no active cases,12 but another detected an average of 0.2 cases per 100000 kindergarteners screened per year.50 If these cases would not have been identified clinically in routine well-child checks, then the incremental cost-effectiveness of screening would be somewhat lower than we report. Third, this model did not incorporate QALYs, because of the paucity of data on QALYs associated with either tuberculosis disease in childhood or isoniazid treatment for kindergarteners. Additional research in this area is needed.
With little economic or clinical argument to support universal prekindergarten TST, this practice has outlived its historical utility. Most, if not all, school districts in California fail to meet the threshold for cost-effective tuberculosis screening with either universal screening or TT using the RQ recommended by the PTCG. We recommend that universal TST before kindergarten entry be discontinued in all California school districts and that TT be considered only where and when the prevalence of risk factor positivity and the prevalence of TST positivity among risk factor–positive individuals are high enough to meet acceptable thresholds for cost-effectiveness. Savings should be redirected to more cost-effective methods to prevent tuberculosis. Screening with TT may be cost-effective in middle school and high school, and districts may wish to consider screening for those age groups while awaiting additional research regarding the optimal age for screening. Our evidence suggests that screening of immigrants may be very cost-effective, and additional research is needed to explore the cost-effectiveness of replacing the RQ recommended by the PTCG with a single question regarding county of birth. Screening at an older age with a tool with higher positive predictive value may yield most of the benefits of prekindergarten TT at a much lower cost.
| APPENDIX: CHOICE OF BASELINE VALUES FOR MODEL INPUT ESTIMATION |
|---|
|
|
|---|
The risk of progression to disease is very difficult to estimate for current US children. Available estimates identified from reviews22,56 and from examination of the literature come from historical populations,57,58 from largely adult populations,59–61 or from cohorts weighted heavily with very young children.62 Because routine isoniazid therapy was initiated for US populations in 1952, there is no recent US estimate for the risk of progression to disease in this age group.63 Our baseline estimate is the most widely cited estimate for this parameter, that is, 90.2 cases per 100000 annually without discounting, from a Puerto Rican cohort enrolled in 1949 to 1951 and monitored for 18 to 20 years.57 Our minimal estimate for this parameter comes from a Hong Kong cohort.64 An alternative figure of 55.7 cases per 100000 annually without discounting was found in 1924 to 1934 in Massachusetts.58
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Address correspondence to Valerie J. Flaherman, MD, MPH, University of California San Francisco, 3333 California St, San Francisco, CA 94118. E-mail: flahermanv{at}peds.ucsf.edu
The contents of this article are solely the responsibility of the authors and do not necessarily represent the official view of the National Center for Research Resources or the National Institutes of Health.
The authors have indicated they have no financial relationships relevant to this article to disclose.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. N. Lobato, J. A. Jereb, and J. R. Starke Unintended Consequences: Mandatory Tuberculin Skin Testing and Severe Isoniazid Hepatotoxicity Pediatrics, June 1, 2008; 121(6): e1732 - e1733. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||