Data systems for assessing quality of cancer care: Are building blocks in place for person-centered care?

Main Article Content

Mariko Carey
Christine Paul
Robert Sanson-Fisher
Heather Buchan


Introduction: There is an urgent need to improve quality of care across many areas of health, including cancer care. Accurate and reliable measurement of current practice is an important first step toward this goal.Assessing quality of care data systems: This paper proposes several criteria that may be used in order to judge the suitability of current data systems for measuring the quality of cancer care. These include characteristics of indicators of care; the capacity of the data system to provide data that are representative of patients, providers and practices and the capacity of the system to be used for quality of care improvement activities.  How do current approaches to assessing quality of care measure up?: Current data systems used in the assessment of quality of care include medical records, administrative systems, cancer registries and patient and clinician self- reporting. All these data systems have strengths and weaknesses and none performed well against all of the criteria described. Unlike other methods, clinician self-report, however, does have the advantage of allowing the collection of the ‘fine grained’ detail needed to judge the appropriateness of care. Conclusions: This study suggests that it may be necessary to consider alternative ways of collecting data for quality improvement purposes. Advances in e-technology may allow for the development of flexible, specific self-report tools to assess clinical practice, allowing rapid feedback to stakeholders.

Article Details

Regular Articles


Institute of Medicine. (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academy Press.

Chassin, M.R. & Galvin, R.W. (1998). The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. Journal of the American Medical Association 280, 1000-1005.

Malin, J.L., Schuster, M.A., Kahn, K.A. & Brook, R.H. (2002). Quality of breast cancer care: what do we know? Journal of Clinical Oncology 20 (21) 4381-4393.

Segnan, N., Senore, C., Andreoni, B., Arrigoni, A., Bisanti, L., Cardelli, A., Castiglione, G., Crosta, C., DiPlacido, R., Ferrari, A., Ferraris, R., Ferrero, F., Fracchia, M., Gasperoni, S., Malfitana, G., Recchia, S., Risio, M., Rizzetto, M., Saracco, G., Spandre, M., Turco, D., Turco, P., Zappa, M. & SCORE2 Working Group-Italy. (2005). Randomized trial of different screening strategies for colorectal cancer: patient response and detection rates. Journal of the National Cancer Institute 97, 347-357.

Berry, J., Caplan, L., Davis, S., Minor, P., Count-Spriggs, M., Glover, R., Ogunlade, V., Bumpers, K., Kauh, J., Brawley, O.W. & Flowers, C. (2010). A black-white comparison of the quality of stage-specific colon cancer treatment. Cancer 116 (3) 713-722.

U.S. Preventive Services Task Force. (2009). Counseling and interventions to prevent tobacco use and tobacco-caused disease in adults and pregnant women: U.S Preventive Services Task Force Reaffirmation recommendation statement. Annals of Internal Medicine 150, 551-555.

Thorndike, A.N., Rigotti, N.A., Stafford, R.S. & Singer, D.E. (1998). National patterns in the treatment of smokers by physicians. Journal of the American Medical Association 279 (8) 604-608.

Ellerbeck, E.F., Ahluwalia, J.S., Jolicoeur, D.G., Gladden, J. & Mosier, M.C. (2001). Direct observation of smoking cessation activities in primary care practice. Journal of Family Practice 50 (8) 688-693.

U.S. Preventive Services Task Force. (2008). Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement. Annals of Internal Medicine 149, 627-637.

Apolone, G., Corli, O., Caraceni, A., Negri, E., Deandrea, S., Montanari, M., Greco, M.T. & Cancer Pain Outcome Research Study Group (CPORSG) Investigators. (2009). Pattern and quality of care of cancer pain management. Results from the Cancer Pain Outcome Research Study Group. British Journal of Cancer 100 (10) 1566-1574.

Strauss, S., Tetroe, J. & Graham, I. (Eds.). (2009). Knowledge Translation in Health Care: Moving from Evidence to Practice. Oxford: Wiley-Blackwell.

Grol, R., Wensing, M. & Eccles, M. (Eds.). (2005). Improving Patient Care: The Implementation of Change in Clinical Practice. Oxford: Elsevier.

Pronovost, P.J., Nolan, T., Zeger, S., Miller, M. & Rubin, H. (2004). How can clinicians measure safety and quality in acute care? Lancet 363 (9414) 1061-1067.

Scholle, S.H., Roski, J., Adams, J.L., Dunn, D.L., Kerr, E.A., Dugan, D.P. & Jensen, R.E. (2008). Benchmarking physician performance: reliability of individual and composite measures. American Journal of Managed Care 14 (12) 833-838.

Shiffman, R.N., Dixon, J., Brandt, C., Essaihi, A., Hsiao, A., Michel, G. & O’Connell, R. (2005). The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Medical Informatics and Decision Making 5, 23.

Donabedian, A. (2005). Evaluating the quality of medical care. 1966. Milbank Quarterly 83, 691-729.

Bot, S.D., Terwee, C.B., van der Windt, D.A., Bouter, L.M., Dekker, J. & de Vet, H.C. (2004). Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature. Annals of the Rheumatic Diseases 63 (4) 335-341.

Grol, R., Dalhuijsen, J., Thomas, S., Veld, C., Rutten, G., Mokkink, H. (1998). Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. British Medical Journal 317 (7162) 858-861.

Asch, S.M., Kerr, E.A., Lapuerta, P., Law, A. & McGlynn, E.A. (2001). A new approach for measuring quality of care for women with hypertension. Archives of Internal Medicine 161 (10) 1329-1335.

Campbell, S.M., Braspenning, J., Hutchinson, A. & Marshall, M. (2002). Research methods used in developing and applying quality indicators in primary care. Quality and Safety in Health Care 11 (4) 358-364.

Hysong, S., Best, R. & Pugh, J. (2006). Audit and feedback and clinical practice guideline adherence: Making feedback actionable. Implementation Science 1, 9.

Rodriguez, H.P., von Glahn, T., Chang, H., Rogers, W.H. & Safran, D.G. (2007). Patient samples for measuring primary care physician performance: Who should be included? Medical Care 45 (10) 989-996.

Haward, R., Amir, Z., Dawson, J., Borrill, C., Scully, J., West, M. & Sainsbury, R. (2003). Breast cancer terms: the impact of constitution, new cancer workload and methods of operation on their effectiveness. British Journal of Cancer 89 (1) 15-22.

Doumit, G., Gattellari, M.G. & O'Brien, M. (2007). Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Systematic Review.

Davis, D.A. & Taylor-Vaisey, A. (1997). Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. Canadia Medical Association Journal 157, 408-416.

Jamtvedt, G., Young, J.M., Kristoffersen, D.T., et al. (2006) Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Systematic Review: CD000259.

Brien, S.E., Dixon, E. & Ghali, W.A. (2009). Measuring and reporting on quality in health care: a framework and road map for improving care. Journal of Surgical Oncology 99 (8) 462-466.

Poon, E.G., Wright, A., Simon, S.R., Jenter, C.A., Kaushal, R., Volk, L.A., Cleary, P.D., Singer, J.A., Tumolo, A.Z. & Bates, D.W. (2010). Relationship between use of electronic health record features and health care quality: results of a statewide survey. Medical Care 48 (3) 203-209.

Donabedian, A. (1988). The quality of care. How can it be assessed? Journal of the American Medical Association 260, 1743-1748.

Parkin, D.M. (2006). The evolution of the population-based cancer registry. Nature Reviews: Cancer 6 (8) 603-612.

Armstrong, B.K. (1992). The role of the cancer registry in cancer control. Cancer Cause Control 3, 569-579.

Hofferkamp, J. (2008). Standards for Cancer Registries Volume III: Standards for Completeness, Quality, Analysis, Management, Security, and Confidentiality of Data. Springfield, IL: North American Association of Central Cancer Registries.

Pearson, M.L., Ganz, P.A., McGuigan, K., Malin, J.R., Adams, J. &Kahn, K.L. (2002). The case identification challenge in measuring quality of cancer care. Journal of Clinical Oncology 20 (21) 4353-4360.

Malin, J.L., Asch, S.M., Kerr, E.A. & McGlynn, E.A. (2000). Evaluating the quality of cancer care: development of cancer quality indicators for a global quality assessment tool. Cancer 88 (3) 701-707.

Bickell, N.A. & Chassin, M.R. (2000). Determining the quality of breast cancer care: do tumor registries measure up? Annals of Internal Medicine 132, 705-710.

Coory, M., Thompson, B., Baade, P. & Fritschi, L. (2009). Utility of routine data sources for feedback on the quality of cancer care: an assessment based on clinical practice guidelines. BMC Health Services Research 9, 84.

Hill, D.J., White, V.M., Giles, G.G., Collins, J.P. & Kitchen, P.R. (1994). Changes in the investigation and management of primary operable breast cancer in Victoria. Medical Journal of Australia 161 (2) 110-111.

White, V., Pruden, M., Giles, G., Kitchen, P., Collins, J., Inglis, G. & Hill, D. (2006). Changes in the management of ductal carcinoma in situ before the release of clinical practice recommendations in Australia: the case in Victoria. ANZ Journal of Surgery 76 (1-2) 28-34.

Leaf, D.A., Neighbor, W.E., Schaad, D. & Scott, C.S. (1995). A comparison of self-report and chart audit in studying resident physician assessment of cardiac risk factors. Journal of General Internal Medicine 10 (4) 194-198.

Kuentzel, J., Henderson, M. & Melville, C. (2008). The impact of social desirability biases on self-report among college student and problem gamblers. Journal of Gambling Studies 24 (3) 307-319.

Spies, T., Mokkink, H., deVries, R. & Grol, R.P. (2004). Which data source in clinical performance assessment? A pilot study comparing self-recording with patient records and observation. International Journal for Quality in Health Care 16 (1) 65-72.

Braunholtz, D.A., Edwards, S.J. & Lilford, R.J. (2001). Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect". Journal of Clinical Epidemiology 54, 217-224.

Donabedian, A. (1992). The Lichfield Lecture: Quality Assurance in health care: consumers' role. Quality in Health Care 1 (4) 247-251.

Coulter, A. & Ellins, J. (2007). Effectivenesss of strategies for informing, educating and involving patients. British Journal of Cancer 355, 24-27.

Rao, M., Clarke, A., Sanderson, C. & Hammersley, R. (2006). Patients' own assessments of quality of primary care compared with objective records based measures of technical quality of care: Cross sectional study. British Medical Journal 332 (7557) 19.

Ferrante, J.M., Ohman-Strickland, P., Hahn, K.A., Hudson, S.V., Shaw, E.K., Crosson, J.C. & Crabtree, B.F. (2008). Self-report versus medical records for assessing cancer-preventive services delivery. Cancer Epidemiology, Biomarkers and Prevention 17 (11) 2987-2994.

Carey, M., Buchan, H., Sanson-Fisher, R. (2009). The cycle of change: implementing best-evidence clinical practice. International Journal for Quality in Health Care 21 (1) 37-43.

James, B. (2003). Information system concepts for quality measurement. Medical Care 41, 71