Commentary

Statistics to assess patient satisfaction with primary care called into question


 

References

I believe wholeheartedly in the value of patient-centered interaction, but I am not confident that the cross-sectional observational study by Flocke and colleagues1 provides much evidence to support my belief. The 9-item visit rating form from the Medical Outcomes Study2 that was used in Flocke’s study is an ordinal scale. Although each of the succeeding levels of satisfaction (poor, fair, good, very good, and excellent) denotes “more satisfaction” than the preceding level, they do not necessarily do so by any uniform interval. “Excellent” is better than “very good,” but we don’t know if “good” is better than “fair” by the same increment. Attaching the numbers 1 to 5 to the ordered response categories does not change this fact.

With numbers attached, means can be calculated to many decimal places, as they are in Tables 3 and 4 of Flocke’s article, but they have no substantive meaning, and indeed can be deceptive. I believe the appropriate measure of central tendency for an ordinal scale is the median. I would not be surprised if the differences seen in Tables 3 and 4 disappeared, and all the numbers evolved into “4s,” if the medians of the variables were used, along with an appropriate statistical test.

Christopher W. Ryan, MD
SUNY Upstate Medical University
Clinical Campus at Binghamton and Wilson Family Practice Residency
Johnson City, New York
E-mail: cryan@binghamton.edu

Dr Flocke responds:

I thank Dr Ryan for his comments regarding the choice of analyses for the data in our article.1 He is correct that the outcome variables represent the sum of ordinal variables and use of a nonparametric statistical test such as the Kruskal-Wallis test that utilizes rankings would be appropriate. Univariate analyses of these data using a Kruskal-Wallis test resulted in medians and P values that were similar to means and P values generated using analysis of variance.

Our choice of analysis was driven by the nested structure of the data. In our case, multiple patient observations are represented per physician; our dependent variable is a patient level score; and our independent variable is measured at the physician level. The appropriate analysis to avoid bias given this structure of data is multilevel modeling. Multilevel modeling can take into account the effect of patients being nested within physician and correctly model the data without inflating (ignoring the physician level and analyzing data as if 2760 patients) or deflating the sample size (aggregating patient data to the physician level as if the sample were 138 physicians). However, no nonparametric equivalent exists for multilevel modeling as there is for analysis of variance. Therefore, we needed to decide which analysis option was the least biased. Our decision was to use the multilevel modeling because this strategy also allows inclusion of covariates at the patient and physician levels to rule out alternative explanations for the observed associations.

Susan A. Flocke, PhD
Case Western Reserve University
Cleveland, Ohio
E-mail: saf6@po.cwru.edu

Recommended Reading

What are effective strategies for reducing the risk of steroid-induced osteoporosis?
MDedge Family Medicine
Prevalence of overactive bladder and urinary incontinence
MDedge Family Medicine
The hospitalist movement and family practice— An uneasy fit
MDedge Family Medicine
Urea breath testing and analysis in the primary care office
MDedge Family Medicine
What are the indications for urodynamic testing in older adults with incontinence?
MDedge Family Medicine
What is the best diagnostic approach to paresthesias of the hand?
MDedge Family Medicine
CORRECTIONS
MDedge Family Medicine
Stages of change analysis of smokers attending clinics for the medically underserved
MDedge Family Medicine
Effectiveness of a chart prompt about immunizations in an urban health center
MDedge Family Medicine
Primary care family physicians and 2 hospitalist models: Comparison of outcomes, processes, and costs
MDedge Family Medicine