University of Wisconsin–Madison Medical College of Wisconsin

METRICS for Metrics

Melissa M. Stiles, MD; Bruce Barrett, MD, PhD; John W. Beasley, MD

WMJ. 2018;117(3):104-105.

Download full text pdf.

Article Excerpt

Metrics are pulling medicine into a large data vortex at the potential expense of patient care and physician satisfaction. Primary care clinicians are inundated with data from patient satisfaction scores, patient panel size reports, quality metrics, and electronic medical record (EMR) meaningful use metrics. The use of metrics, like other medical interventions, has potential costs and harms as well as benefits and should be based on good science and a careful analysis of outcomes.

As physicians, we have a professional and ethical obligation to apply the same rigor of evidence to implementing metrics as we do for diagnostic testing and therapeutic decision-making. In this essay, we ask the following questions: Do metrics lead to positive patient care outcomes? What is the cost of measuring and reporting metrics? What are the risks and unintended consequences of focusing on metrics? We cannot definitively answer these questions, but we do provide a rubric to guide such endeavors.

  1. Institute for Healthcare Improvement. Accessed August 16, 2018.
  2. Eijkenaar F, Emmert M, Scheppach M, Schöffski O. Effects of pay for performance in health care: a systematic review of systematic reviews. Health Policy. 2013;110(2-3):115-130.
  3. Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011(7):CD009255.
  4. Scott A, Sivey P, Ait Ouakrim D, et al. The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database Syst Rev. 2011(9):CD008451.
  5. Roland M, Campbell S. Successes and failures of pay for performance in the United Kingdom. N Engl J Med. 2014;370(20):1944-1949.
  6. Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368-378.
  7. Gillam SJ, Sirawardena AN, Steel, N. Pay-forperformance in the United Kingdom: impact on the quality and outcomes framework: a systematic review. Ann Fam Med. 2012;10(5):461-468.
  8. Blecker E. The challenges in achieving successful P4P programs. Find Brief. 2014;42(2):1-3.
  9. MacLean CH, Kerr EA, Qaseem A. Time out – charting a path for improving performance measurement. N Engl J Med. 2018;378(19):1757-1761.
  10. Glasziou PP, Buchan H, Del Mar C, et al. When financial incentives do more good than harm: a checklist. BMJ. 2012;345:e5047.
  11. Casalino LP, Gans D, Weber R, et al. US physician practices spend more than $15.4 billion annually to report quality measures. Health Aff. 2016;35(3):401-406.
  12. Zgierska A, Rabago D, Miller MM. Impact of patient satisfaction ratings on physicians and clinical care. Patient Prefer Adherence. 2014;8:437-446.
  13. Steel N, Willems S. Learning from the QOF: a review of existing research. In: Gillam S, Siriwardena AN, eds. The Quality and Outcomes Framework: QOF Transforming General Practice. Oxford, UK: Radcliffe Publishing Ltd; 2010:31–69.
  14. McDonald R, Roland M. Pay for performance in primary care in England and California: comparison of unintended consequences. Ann Fam Med. 2009;7(2):121-127.
  15. Young RA, Roberts RG, Holden RJ. The challenges of measuring, improving, and reporting quality in primary care. Ann Fam Med. 2017;15(2):175-182.
  16. Saver BG, Martin SA, Adler NR, et al. Care that matters: quality measurement and health care. PLoS Med. 2015;12(11):e1001902. doi:1371/journal.pmed.1001902.

Author Affiliations: Department of Family Medicine and Community Health, University of Wisconsin-Madison, Madison, Wis (Stiles, Barrett, Beasley).
Corresponding Author: Melissa M. Stiles, MD, Department of Family Medicine and Community Health, University of Wisconsin-Madison; 1100 Delaplaine Court, Madison, WI 53715; phone 608.424.3384; fax 608.263.5813; email Melissa.
Funding/Support: None declared.
Financial Disclosures: None declared.
Share WMJ