|
|||||
|
|
||||||
Originally published as JCO Early Release 10.1200/JCO.2005.03.3365 on January 9 2006 © 2006 American Society of Clinical Oncology. Results of the National Initiative for Cancer Care Quality: How Can We Improve the Quality of Cancer Care in the United States?From the RAND Corporation, Santa Monica; Department of Medicine, University of California Los Angeles, Los Angeles, CA; Department of Health Policy and Management, Harvard School of Public Health; Section on Health Policy, Division of General Medicine, Brigham and Women's Hospital, Boston, MA; and the Department of Clinical Bioethics, Warren G. Magnuson Clinical Center, National Institutes of Health, Bethesda, MD. Address reprint requests to Jennifer L. Malin, MD, Amgen, One Amgen Center Dr, MS 28-3-A, Thousand Oaks, CA 91320; e-mail: jmalin{at}amgen.com
PURPOSE: In 1999, the National Cancer Policy Board called attention to the quality of cancer care in the United States and recommended establishing a quality monitoring system with the capability of regularly reporting on the quality of care for patients with cancer. METHODS: Using data from a patient survey 4 years after diagnosis and review of medical records, we determined the percentage of stage I to III breast cancer and stage II to III colorectal cancer survivors in five metropolitan statistical areas (MSAs) across the United States who received recommended care specified by a comprehensive set of explicit quality measures. RESULTS: Two thousand three hundred sixty-six (63%) of 3,775 eligible patients responded to the survey, and 85% consented to have their medical records reviewed. Our final analytic sample (n = 1,765) included 47% of the eligible patients. Patients with breast and colorectal cancer received 86% of recommended care (95% CI, 86% to 87%) and 78% of recommended care (95% CI, 77% to 79%), respectively. Adherence to quality measures was less than 85% for 18 of the 36 breast cancer measures, and significant variation across MSAs was observed for seven quality measures. The percent adherence was less than 85% for 14 of the 25 colorectal cancer measures, and one quality measure demonstrated statistically significant variation across the MSAs. CONCLUSION: Initial management of patients with breast and colorectal cancer in the United States seemed consistent with evidence-based practice; however, substantial variation in adherence to some quality measures point to significant opportunities for improvement.
Despite considerable progress in its prevention and treatment, cancer remains a leading cause of morbidity and mortality in the United States.1 Although the Institute of Medicine has called attention to problems with the quality of care in the United States2-4 and additional reports have confirmed that the problems are widespread,5-7 few reports have focused on the quality of care for patients with a diagnosis of cancer. In its 1999 report Ensuring the Quality of Cancer Care, the Institute of Medicine's National Cancer Policy Board (NCPB) concluded, "Based on the best available evidence, some individuals with cancer do not receive care known to be effective for their condition. The magnitude of the problem is not known, but the National Cancer Policy Board believes it is substantial."8 To address these concerns and the paucity of data on the quality of care for patients with cancer, the NCPB recommended establishing a quality monitoring system with capability of routine reporting of results. Motivated by the NCPB report, a number of initiatives are underway to begin to measure and improve the quality of care of patients with cancer. Examples include the joint effort of the National Cancer Institute and the National Quality Forum to identify and evaluate quality measures for cancer care9; the American Society of Clinical Oncology Quality Oncology Practice Initiative10; the Oncology Demonstration Project sponsored by the Centers for Medicare and Medicaid Services11; and the National Initiative for Cancer Care Quality (NICCQ), which is led by American Society of Clinical Oncology in collaboration with multiple oncology professional societies, patient advocates, and researchers.12 In this report, we present the findings of the NICCQ, an in-depth study of the quality of care for patients with a new diagnosis of breast cancer or colorectal cancer in five different sites across the United States.
Eligibility Criteria Patients were considered eligible if they had a new diagnosis of stage I to III breast cancer or stage II to III colorectal cancer during 1998 and were registered in an American College of Surgeons (ACoS) approved hospital cancer registry located in one of the following five metropolitan statistical areas (MSAs): Atlanta, GA; Cleveland, OH; Houston, TX; Kansas City, KS; and Los Angeles, CA. To be eligible, participants had to be 21 to 80 years old at diagnosis, English speaking, and alive when contacted to participate in this study approximately 4 years after diagnosis. Twenty-seven percent of colorectal cancer patients and 9% of breast cancer patients were found to be deceased when identified by participating ACoS hospital cancer registries and, thus, not eligible for our analytic sample. Males with breast cancer were excluded.
Hospital Registry Sampling and Recruitment
Patient Sampling and Recruitment Patient contact information was obtained from the local hospital cancer registries. Before contacting a patient, the physician of record was notified by mail of our intent to contact the patient for a research study. Unless a physician indicated that a patient should not be contacted, 2 weeks later the patient was mailed a letter explaining the study and a postage-paid postcard allowing the patient to opt out without further contact.
Development of Quality Measures and Data Collection Instruments
After selecting the measures, we developed both a patient survey and a medical record abstraction instrument to collect the specific data elements necessary for each quality measure. The survey included questions regarding patients' initial therapy and experiences, symptoms related to cancer or its treatment, and current quality of life. In addition, patients were asked to provide the names and addresses of all physicians who had provided their medical care since their diagnosis. Data obtained from the medical record included detailed information about the tumor characteristics, staging, referrals and decision making, initial cancer treatment, adjunctive medications, and comorbid conditions. To be eligible for an individual measure, the patient's medical records had to contain the records for the specialist generally responsible for providing the care. In addition, if the quality measure relied on information that is typically documented in a specific document (eg, pathology report), the patient's medical record had to contain this document for the patient to be eligible for inclusion in the measure. For example, to be eligible for the measure of "IF a patient is treated with chemotherapy, THEN body-surface area should be documented," a patient's medical record would need to contain the records of the medical oncologist and the chemotherapy flow sheet.
Data Collection We requested photocopies of consenting patients' ambulatory medical records from all cancer providers and primary care physicians as well as the inpatient record for colorectal cancer patients. Trained nurses abstracted all available records using a computer-based medical record abstraction instrument. When abstraction revealed cancer providers not reported by the patients, we requested those physicians' medical records and abstracted them as well.
Statistical Analyses We adjusted for both hospital and patient nonresponse for the following hospital characteristics using ACoS data and patient characteristics using NCDB data: hospital ownership; oncology surgeon on staff; dummy variables for the individual participating hospitals; patient age, sex, race, education, insurance, employment, country of origin, and primary language; cancer type and stage; and cancer treatment. Although we report weighted results because we believe they are most representative, weighting did not affect the direction or statistical significance of any reported results.
Recruitment of Cohort Of the 94 hospital cancer registries we invited to participate in NICCQ, 65 registries (69%) agreed. Among 3,775 eligible patients, 2,366 responded to the survey (63%); and, of these patients, 2,002 (85%) consented to have their medical records reviewed. We obtained at least one medical record for 98% of consenting patients, and the records of 88% of consenting patients (n = 1,765) were adequate for abstraction. Our final analytic sample included 47% of the eligible patients. The characteristics of the analytic cohort are listed in Table 2.
Quality of Care Among the patients with breast cancer (n = 1,287), there were 20,291 eligible events specified by 36 quality measures ( Table 3). On average, patients received 86% of recommended care (95% CI, 86% to 87%). Among the domains of care assessed, Diagnostic Evaluation had the greatest number of eligible events (n = 9,887), and Management of Treatment Toxicity had the fewest (n = 378). Adherence to recommended care within domains ranged from 73% (95% CI, 69% to 78%) for Management of Treatment Toxicity to 94% (95% CI, 92% to 95%) for Post-Treatment Surveillance. Adherence to recommended care across the different components of care ranged from 13% (95% CI, 7% to 21%) for Referral to 60% (95% CI, 57% to 62%) for Documentation to 96% (95% CI, 95% to 97%) and 97% (95% CI, 96% to 97%) for Receipt of Treatment and Testing, respectively.
Among the patients with colorectal cancer, there were 4,538 eligible events based on the 25 colorectal cancer measures ( Table 3). On average, patients received 78% of recommended care (95% CI, 77% to 79%). Again, the greatest number of eligible events was in Diagnostic Evaluation (n = 1,635). The domain of Post-Treatment Surveillance had the smallest number of eligible events (n = 478). Domain-specific adherence ranged from 50% (95% CI, 46% to 55%) for Post-Treatment Surveillance to 93% (95% CI, 91% to 95%) for Surgery. Adherence to recommended care across the different components of care ranged from 57% (95% CI, 53% to 62%) for Respect for patient references and 59% (95% CI, 50% to 68%) for Referral to 93% (95% CI, 91% to 94%) for Pathology.
Variation in Quality of Care Across NICCQ MSAs
Adherence to quality measures was less than 85% for 18 of the 36 breast cancer measures, and there was significant variation in the percent adherence across MSAs for seven of the quality measures ( Table 5). As much as a two-fold difference in adherence was observed for some measures across MSAs. For example, among patients treated with chemotherapy, the planned dose was consistent with published regimens for 58% of patients; however, this ranged from 29% to 74%, when weighted for hospital and patient nonresponse (P < .001). Notably, six of the measures with less than 85% adherence pertained to documentation of key clinical factors believed to be essential to providing appropriate cancer care, such as components of disease stage and patient's body-surface area.
The percent adherence was less than 85% for 14 of the 25 colorectal cancer measures; however, only one quality measure demonstrated statistically significant variation across the MSAs ( Table 6). In patients with stage II or III rectal cancer, we found that only 66% received radiation therapy as recommended; this varied by MSA from 58% to 92% (P = .05).
Our results suggest that patients with breast cancer receive 86% of recommended care, whereas patients with colorectal cancer receive 78% of recommended care. Adherence to several quality measures approached 100%, demonstrating that excellent quality of care is achievable. Yet, despite high adherence to many measures of the quality of cancer care, we observed less than 85% adherence for almost half of the quality measures, and for many of these measures, there was substantial variability in quality across the five metropolitan areas. How do we put these results in context? Our results can be compared with a growing literature that addresses the quality of care of patients with chronic medical conditions, as well as prior studies that describe the patterns of care for patients with cancer. For example, two recent national studies, using methodology similar to that of NICCQ, suggest that the quality of care for cancer may be better than that observed for other chronic medical conditions. In one study, 73% of Medicare beneficiaries received health care services specified by one of 24 quality measures addressing heart disease, stroke, and pneumonia.5 Another recent study of the general population in 12 metropolitan areas of the United States concluded that participants received approximately 55% of recommended care for a wide variety of medical conditions.6 In contrast, the NICCQ results suggest that higher percentages of patients with breast and colorectal cancer receive recommended care. Compared with prior studies of cancer care summarized by the NCPB, our results show strikingly higher adherence to processes of care believed to be essential for improving the outcomes of patients with breast and colorectal cancer. There are several possible explanations for this difference. In contrast to most prior studies, NICCQ used explicit quality measures with clinically detailed eligibility criteria.18,19 When simple utilization rates (eg, receipt of tamoxifen in nonmetastatic breast cancer patients) are used to estimate receipt of recommended care, quality of care may seem artificially low because many patients included in the analysis may not really be eligible for the specified care (eg, patients whose tumors do not express the estrogen or progesterone receptor). Furthermore, few studies have used the comprehensive data collection methods applied in NICCQ.20,21 NICCQ used patient self-report data along with data abstracted from multiple outpatient medical records (an average of 3.6 records per patient). The NCPB based its conclusions about the state of cancer care in the United States primarily on studies of existing administrative records, insurance claims, and cancer registry data. Such data frequently lack the clinical detail necessary to determine whether a patient is truly eligible for a particular intervention8,20,22 and may under-report the treatments provided, especially when delivered in the ambulatory setting.23-25 In fact, the few studies that used analogous methods to NICCQ to evaluate the quality of cancer care have reported better than 80% adherence.6,25-27 If the quality of care for cancer is indeed higher than for other medical conditions, what factors might contribute to the difference? It may be that the urgency of a new diagnosis of cancer focuses the attention of patients and providers on assuring treatment in a way that chronic diseases, especially silent ones such as hypertension or diabetes, cannot. Differences in the configuration of treatment teams, reimbursement for services, training, and public attention may also play a role. This study assessed performance on a wide variety of quality metrics derived from the clinical literature. All of the measures underwent review and refinement by a multidisciplinary expert panel comprising clinical experts in breast and colorectal cancer, health services researchers, oncology nurses, and patient advocates. Many measures were linked by scientific evidence with improved patient outcomes. For example, randomized trials have demonstrated improved survival with 5 years of tamoxifen therapy in women with hormone receptorpositive breast cancer. In other instances, the measures focused on operational issues that clinical experts viewed as necessary to the delivery of high-quality care. For example, documentation of patient body-surface area in the medical record of the medical oncologist delivering chemotherapy is necessary for the physician to determine the appropriate dose and for the nursing or pharmacy staff to verify the prescribed dose to ensure patient safety. Given adherence rates of less than 85% on almost half of the quality measures, our results suggest many opportunities to improve the quality of cancer care. Of concern, we found that, although most patients seemed to be receiving adjuvant chemotherapy when indicated, patients were often not prescribed a dose of the chemotherapy that was consistent with published regimens, and many began therapy more than 8 weeks after surgery. In addition to focusing on improving the quality of adjuvant chemotherapy delivery, our results suggest that quality improvement efforts should target management of treatment toxicity; advising patients about treatment options, especially when patient preference is a key factor in the decision-making process (ie, type of breast surgery and breast reconstruction after mastectomy); and improving documentation of key information regarding patients' cancer and treatment that may be needed by many other clinicians involved in the patients' care. Our findings should be viewed in light of several limitations of our study design. First, our study was limited to patients with stage I to III breast cancer and stage II to III colorectal cancer. The quality of care for patients with other types of cancer and stages of disease may be different. Second, our quality measures reflect the weight of both scientific evidence and expert opinion. Variability in the strength of evidence underpinning individual measures could affect the pattern of performance we found. Third, we were unable to include patients who could not complete a survey in English or who died before study enrollment, two groups for whom the quality of care may be lower. The omission of patients who died within the first few years of diagnosis may be of particular concern because premature death could be an outcome of poor quality of care. If patients who die receive care that that is of lower quality than that received by survivors, then our results may overestimate the quality of care of colorectal cancer patients because 27% of patients reported by the registries were deceased when identified by NICCQ. However, only 9% of breast cancer patients were deceased 4 years after diagnosis, so the exclusion of decedents from our sampling frame is not likely to have had a large effect on our estimate of the quality of breast cancer care. Fourth, nonparticipation of hospitals and patients may also limit the generalizability of our results. Our final sample included 47% of eligible patients, which is comparable to other studies that have obtained survey and consent to review medical records from population-based samples.6 We used nonresponse weights to account for the different distribution of race/ethnicity and age in our final sample, and our results did not change substantively. Nevertheless, our results could still be biased if nonresponders were less likely to get appropriate care. Finally, although this study included data from both patient self report and abstraction from the medical records of all the physicians providing cancer care to patients, recall bias and missing documentation may have led to under-reporting of care that was actually provided. Despite these limitations, we believe that our results provide a useful benchmark for other efforts to evaluate the quality of cancer care. To our knowledge, this the first report of a comprehensive evaluation of the quality of care for patients with cancer. Although our results imply that the quality of initial management of patients with breast and colorectal cancer in the United States is often consistent with evidence-based practice, care is still not perfect. Viewed from the perspective of the patient with breast or colorectal cancer, a person with a new diagnosis of cancer has approximately a one in five chance of failing to receive elements of cancer care consistent with the best evidence in the literature and expert-defined standards of clinical practice. Important opportunities to improve care exist. Our results may provide guidance for professional societies and clinicians involved in cancer care on how best to improve the care of patients with cancer.
The appendix is included in the full-text version of this article, available online at www.jco.org. It is not included in the PDF (via Adobe® Acrobat Reader®) version.
Abbreviations: NICCQ, National Initiative for Cancer Care Quality; AJCC, American Joint Committee on Cancer; ER, estrogen receptor; PR, progesterone receptor; BCS, breast-conserving surgery; 5HT, 5-hydroxytryptamine-3. Measure includes data abstracted from patients' medical records. Measure includes data obtained from a patient survey approximately 4 years after diagnosis. The associated table of chemotherapy regimens appropriate for adjuvant therapy of breast cancer in 1998 included all published variations of doxorubicin and cyclophosphamide (AC), including those with the addition of a taxane (AC
Althoguh all authors completed the disclosure declaration, the following authors or their immediate family members have indicated a financial interest. No conflict exists for drugs or devices used in a study if they are not being evaluated as part of the investigation. For a detailed description of the disclosure categories, or for more information about ASCO's conflict of interest policy, please refer to the Author Disclosure Declaration and the Disclosures of Potential Conflicts of Interest section in Information for Contributors.
Dollar Amount Codes (A) < $10,000 (B) $10,000-99,999 (C)
We thank Joseph Bailes and Deborah Kamin, along with the following members of the America Society of Clinical Oncology's Quality Task Force for their leadership and thoughtful suggestions throughout the study: Chandra Belani, Charles Bennett, Al Benson, Susan Braun, Nancy Davidson, Lawrence Einhorn, Arlene Forastiere, Becky Garcia, Michael Goldstein, Craig Henderson, Bruce Hillner, Patricia Jassak, Margaret Kemeny, Nancy Kemeny, Patricia Legant, Bernard Levin, William McGivney, Monica Morrow, Linda Mulvihill, Catherine Park, David Pfister, Lori Pierce, Arnold Potosky, Mack Roach, Christopher Rose, Carolyn Runowicz, Lowell Schnipper, Deborah Schrag, Joseph Simone, Thomas Smith, Glenn Steele, Ellen Stovall, Jane Weeks, William Wood, and Rodger Winn. We also acknowledge Carol Cosenza, Floyd J. Fowler Jr, and Matt Jans of the Center for Survey Research for contributions to the patient survey design and fieldwork. In addition, we also acknowledge the following individuals for their important contributions to the National Initiative for Cancer Care Quality: Chantal Avila, Robin Beckman, Matt Cioffi, Carol Edwards, Fuan-Ye Kung, Lorraine Scampini, and Jie Zheng for statistical programming; Jeff Adams, Marc Chow, Chris Collopy, Christy Herring, Nancee Inouye, and Mayde Rosen for project administration and management; Clifford Ko, Peggy Wallace, and Ann Zisser for assistance with the development and implementation of the medical record abstraction tool; and Peggy Wallace for assistance with specification of the quality measures. Finally, we express our gratitude to the patients and the cancer registrars and staff at all of the participating hospitals and medical practices, without whom this study would not have been possible.
Supported by a grant from the American Society of Clinical Oncology. J.L.M. was supported by a CI-10 Damon Runyon-Lilly Clinical Investigator Award from the Damon Runyon Cancer Research Foundation. The authors have received honoraria for presenting research results at conferences sponsored by the American Society of Clinical Oncology and the American College of Surgeons. Presented in part at the 38th Annual Meeting of the American Society of Clinical Oncology (ASCO), Orlando, FL, May 18-21, 2002; the 39th Annual Meeting of ASCO, Chicago, IL, May 31-June 3, 2003; the 40th Annual Meeting of ASCO, New Orleans, LA, June 5-8, 2004; and the 41st Annual Meeting of ASCO, Orlando, FL, May 13-17, 2005. The assertions and opinions expressed in this article are solely those of the authors and are not necessarily those of the American Society of Clinical Oncology or its representatives. Authors' disclosures of potential conflicts of interest and author contributions are found at the end of this article.
1. Jemal A, Murray T, Ward E, et al: Cancer statistics, 2005. CA Cancer J Clin 55:10-30, 2005 2. Institute of Medicine: Envisioning the National Health Care Quality Report. Washington, DC, National Academy Press, 2001 3. Institute of Medicine: To Err Is Human: Building a Safer Health System. Washington, DC, National Academy Press, 1999 4. Institute of Medicine: Crossing the Quality Chasm. Washington, DC, National Academy Press, 2001 5. Jencks SF, Huff ED, Cuerdon T: Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001. JAMA 289:305-312, 2003 6. McGlynn EA, Asch SM, Adams J, et al: The quality of health care delivered to adults in the United States. N Engl J Med 348:2635-2645, 2003 7. Agency for Healthcare Research and Quality: National Healthcare Quality Report: AHRQ Publication No. 04-RG003. http://www.ahrq.gov/qual/nhqr03/nhqrsum03.htm 8. Hewitt M, Simone J: National Cancer Policy Board, Institute of Medicine: Ensuring Quality Cancer Care. Washington, DC, National Academy Press, 1999 9. Lipscomb J, Davidson M: Outcomes research at the National Cancer Institute: Measuring, understanding and improving the outcomes of cancer care. Clin Ther 25:699-712, 2003[CrossRef][Medline] 10. Neuss MN, Desch CE, McNiff KK, et al: A process for measuring the quality of cancer care: The Quality Oncology Practice Initiative. J Clin Oncol 23:6233-6239, 2005 11. Twombly R: Medicare demonstration projects acknowledge evidence-based medicine in cancer care. J Natl Cancer Inst 97:6-7, 2005 12. Schneider EC, Epstein AM, Malin JL, et al: Developing a system to assess the quality of cancer care: ASCO's national initiative on cancer care quality. J Clin Oncol 22:2985-2991, 2004 13. Malin JL, Asch SM, Kerr EA, et al: Evaluating the quality of cancer care: Development of cancer quality indicators for a global quality assessment tool. Cancer 88:701-707, 2000[CrossRef][Medline] 14. Desch CE, Benson AB III, Smith TJ, et al: Recommended colorectal cancer surveillance guidelines by the American Society of Clinical Oncology. J Clin Oncol 17:1312, 1999 15. National Comprehensive Cancer Network: Update: NCCN practice guidelines for the treatment of breast cancer. Oncology (Williston Park) 13:41-66, 1999 16. National Institutes of Health: NIH Consensus Conference: Treatment of early-stage breast cancer. JAMA 265:391-395, 1991[CrossRef][Medline] 17. National Institutes of Health: NIH Consensus Conference: Adjuvant therapy for patients with colon and rectal cancer. JAMA 264:1444-1450, 1990[CrossRef][Medline] 18. Kahn KL, Rogers WH, Rubenstein LV, et al: Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system. JAMA 264:1969-1973, 1990[Abstract] 19. Mandelblatt J, Ganz PA, Kahn K: Proposed agenda for the measurement of quality-of-care outcomes in oncology practice. J Clin Oncol 17:2614-2622, 1999 20. Malin JL, Schuster MA, Kahn KA, et al: Quality of breast cancer care: What do we know? J Clin Oncol 20:4381-4393, 2002 21. Kahn KL, Malin JL, Adams J, et al: Developing a reliable, valid, and feasible plan for quality-of-care measurement for cancer: How should we measure? Med Care 40:III73-III85, 2002 (suppl 6)[Medline] 22. National Comprehensive Cancer Board, Institute of Medicine: Enhancing Data Systems to Improve the Quality of Cancer Care. Washington, DC, National Academy Press, 2000 23. Cress RD, Zaslavsky AM, West DW, et al: Completeness of information on adjuvant therapies for colorectal cancer in population-based cancer registries. Med Care 41:1006-1012, 2003[CrossRef][Medline] 24. Bickell NA, Chassin MR: Determining the quality of breast cancer care: Do tumor registries measure up? Ann Intern Med 132:705-710, 2000 25. Malin JL, Kahn KL, Adams J, et al: Validity of cancer registry data for measuring the quality of breast cancer care. J Natl Cancer Inst 94:835-844, 2002 26. White J, Morrow M, Moughan J, et al: Compliance with breast-conservation standards for patients with early-stage breast carcinoma. Cancer 97:893-904, 2003[CrossRef][Medline] 27. Guadagnoli E, Shapiro CL, Weeks JC, et al: The quality of care for treatment of early stage breast carcinoma: Is it consistent with national guidelines? Cancer 83:302-309, 1998[CrossRef][Medline] Submitted June 30, 2005; accepted November 7, 2005. This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||