Clinical Review

Current Concepts in Clinical Research: Anterior Cruciate Ligament Outcome Instruments

Publish date: May 4, 2018

References

1. Mall NA, Chalmers PN, Moric M, et al. Incidence and trends of anterior cruciate ligament reconstruction in the United States. Am J Sports Med. 2014;42(10):2363-2370. doi:10.1177/0363546514542796.

2. Brophy RH, Schmitz L, Wright RW, et al. Return to play and future ACL injury risk after ACL reconstruction in soccer athletes from the Multicenter Orthopaedic Outcomes Network (MOON) group. Am J Sports Med. 2012;40(11):2517-2522. doi:10.1177/0363546512459476.

3. Johnson DS, Smith RB. Outcome measurement in the ACL deficient knee- what’s the score? Knee. 2001;8(1):51-57. doi:10.1016/S0968-0160(01)00068-0.

4. Graham B, Green A, James M, Katz J, Swiontkowski M. Measuring patient satisfaction in orthopaedic surgery. J Bone Joint Surg Am. 2015;97(1):80-84. doi:10.2106/JBJS.N.00811.

5. Kocher MS, Steadman JR, Briggs K, Zurakowski D, Sterett WI, Hawkins RJ. Determinants of patient satisfaction with outcome after anterior cruciate ligament reconstruction. J Bone Joint Surg Am. 2002;84(9):1560-1572. doi:10.2106/00004623-200209000-00008.

6. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to their Development and Use. Oxford: Oxford University Press; 1989.

7. Terwee CB, Bot SD, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. doi:10.1016/j.jclinepi.2006.03.012.

8. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966;19(1):3-11. doi:10.2466/pr0.1966.19.1.3.

9. Scholtes VA, Terwee CB, Poolman RW. What makes a measurement instrument valid and reliable? Injury. 2011;42(3):236-240. doi:10.1016/j.injury.2010.11.042.

10. Fries J, Rose M, Krishnan E. The PROMIS of better outcome assessment: responsiveness, floor and ceiling effects, and internet administration. J Rheumatol. 2011;38(8):1759-1764. doi:10.3899/jrheum.110402.

11. Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt L. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833-1840.

12. Gandek B. Measurement properties of the Western Ontario and McMaster Universities Osteoarthritis Index: a systematic review. Arthritis Care Res (Hoboken). 2015;67(2):216-229. doi:10.1002/acr.22415.

13. Angst F, Aeschlimann A, Stucki G. Smallest detectable and minimal clinically important differences of rehabilitation intervention with their implications for required sample sizes using WOMAC and SF-36 quality of life measurement instruments in patients with osteoarthritis of the lower extremities. Arthritis Rheum. 2001;45(4):384-391. doi:10.1002/1529-0131(200108)45:4<384::AID-ART352>3.0.CO;2-0.

14. Ryser L, Wright BD, Aeschlimann A, Mariacher-Gehler S, Stuckl G. A new look at the Western Ontario and McMaster Universities Osteoarthritis Index using Rasch analysis. Arthritis Care Res. 1999;12(5):331-335.

15. Wolfe F, Kong SX. Rasch analysis of the Western Ontario MacMaster questionnaire (WOMAC) in 2205 patients with osteoarthritis, rheumatoid arthritis, and fibromyalgia. Ann Rheum Dis. 1999;58(9):563-568. doi:10.1136/ard.58.9.563.

16. Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)—development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28(2):88-96. doi:10.2519/jospt.1998.28.2.88.

17. Salavati M, Akhbari B, Mohammadi F, Mazaheri M, Khorrami M. Knee injury and Osteoarthritis Outcome Score (KOOS): reliability and validity in competitive athletes after anterior cruciate ligament reconstruction. Osteoarthritis Cartilage. 2011;19(4):406-410. doi:10.1016/j.joca.2011.01.010.

18. Roos EM, Roos HP, Lohmander LS. WOMAC Osteoarthritis Index—additional dimensions for use in subjects with post-traumatic osteoarthritis of the knee. Western Ontario and MacMaster Universities. Osteoarthritis Cartilage. 1999;7(2):216-221. doi:10.1053/joca.1998.0153.

19. Roos EM, Toksvig-Larsen S. Knee injury and osteoarthritis outcome score (KOOS)—validation and comparison to the WOMAC in total knee replacement. Health Qual Life Outcomes. 2003;1(1):17. doi:10.1186/1477-7525-1-17.

20. Paradowski PT, Bergman S, Sunden-Lundius A, Lohmander LS, Roos EM. Knee complaints vary with age and gender in the adult population: population-based reference data for the Knee injury and Osteoarthritis Outcome Score (KOOS). BMC Musculoskeletal Disord. 2006;7(1):38. doi:10.1186/1471-2474-7-38.

21. MARS Group. Effect of graft choice on the outcome of revision anterior cruciate ligament reconstruction in the Multicenter ACL Revision Study (MARS) Cohort. Am J Sports Med. 2014;42(10):2301-2310. doi:10.1177/0363546514549005.

22. Ventura A, Legnani C, Terzaghi C, Borgo E, Albisetti W. Revision surgery after failed ACL reconstruction with artificial ligaments: clinical, histologic and radiographic evaluation. Eur J Orthop Surg Traumatol. 2014;21(1):93-98. doi:10.1007/s00590-012-1136-3.

23. Wasserstein D, Huston LJ, Nwosu S, et al. KOOS pain as a marker for significant knee pain two and six years after primary ACL reconstruction: a Multicenter Orthopaedic Outcomes Network (MOON) prospective longitudinal cohort study. Osteoarthritis Cartilage. 2015;23(10):1674-1684. doi:10.1016/j.joca.2015.05.025.

24. Zaffagnini S, Grassi A, Muccioli GM, et al. Return to sport after anterior cruciate ligament reconstruction in professional soccer players. Knee. 2014;21(3):731-735. doi:10.1016/j.knee.2014.02.005.

25. Duffee A, Magnussen RA, Pedroza AD, Flanigan DC; MOON Group, Kaeding CC. Transtibial ACL femoral tunnel preparation increases odds of repeat ipsilateral knee surgery. J Bone Joint Surg Am. 2013;95(22):2035-2042. doi:10.2106/JBJS.M.00187.

26. Bellamy N, Buchanan WW. A preliminary evaluation of the dimensionality and clinical importance of pain and disability in osteoarthritis of the hip and knee. Clin Rheumatol. 1986;5(2):231-241. doi:10.1007/BF02032362.

27. Fries J, Rose M, Krishnan E. The PROMIS of better outcome assessment: responsiveness, floor and ceiling effects, and Internet administration. J Rheumatol. 2011;38(8):1759-1764. doi:10.3899/jrheum.110402.

28. Hancock KJ, Glass NA, Anthony CA, et al. Performance of PROMIS for healthy patients undergoing meniscal surgery. J Bone Joint Surg Am. 2017;99(11):954-958. doi:10.2106/JBJS.16.00848.

29. Hung M, Clegg Do, Greene T, et al. Evaluation of the PROMIS physical function item bank in orthopedic patients. J Orthop Res. 2011;29(6):947-953. doi:10.1002/jor.21308.

30. Hung M, Baumhauer JF, Brodsky JW, et al; Orthopaedic Foot & Ankle Outcomes Research (OFAR) of the American Orthopaedic Foot & Ankle Society (AOFAS). Psychometric comparison of the PROMIS physical function CAT with the FAAM and FFI for measuring patient-reported outcomes. Foot Ankle Int. 2014;35(6):592-599. doi:10.1177/1071100714528492.

31. Hung M, Stuart AR, Higgins TF, Saltzman CL, Kubiak EN. Computerized adaptive testing using the PROMIS physical function item bank reduces test burden with less ceiling effects compared with the short musculoskeletal function assessment in orthopaedic trauma patients. J Orthop Trauma. 2014;28(8):439-443. doi:10.1097/BOT.0000000000000059.

32. Hancock, et al. PROMIS: A valid and efficient outcomes instrument for patients with ACL tears. KSSTA. In press.

33. Scott, et al. Performance of PROMIS physical function compared with KOOS, SF-36, Eq5D, and Marx activity scale in patients who undergo ACL reconstruction. In press.

34. Papuga MO, Beck CA, Kates SL, Schwarz EM, Maloney MD. Validation of GAITRite and PROMIS as high-throughput physical function outcome measures following ACL reconstruction. J Orthop Res. 2014;32(6):793-801. doi:10.1002/jor.22591.

35. Mohtadi N. Development and validation of the quality of life outcome measure (questionnaire) for chronic anterior cruciate ligament deficiency. Am J Sports Med. 1998;26(3):350-359. doi:10.1177/03635465980260030201.

36. Lafave MR, Hiemstra L, Kerslake S, Heard M, Buchko G. Validity, reliability, and responsiveness of the anterior cruciate ligament quality of life measure: a continuation of its overall validation. Clin J Sport Med. 2017;27(1):57-63. doi:10.1097/JSM.0000000000000292.

37. Noyes FR, McGinniss GH, Mooar LA. Functional disability in the anterior cruciate insufficient knee syndrome: Review of knee rating systems and projected risk factors in determining treatment. Sports Med. 1984;1(4):278-302. doi:10.2165/00007256-198401040-00004.

38. Noyes FR, Matthews DS, Mooar PA, Grood ES. The symptomatic anterior cruciate-deficient knee: Part II. The results of rehabilitation, activity modification, and counseling on functional disability. J Bone Joint Surg Am. 1983;65(2):163-174. doi:10.2106/00004623-198365020-00004.

39. Barber-Westin SD, Noyes FR, McCloskey JW. Rigorous statistical reliability, validity, and responsiveness testing of the Cincinnati knee rating system in 350 subjects with uninjured, injured, or anterior cruciate ligament-reconstructed knees. Am J Sports Med. 1999;27(4):402-416. doi:10.1177/03635465990270040201.

40. Bollen S, Seedhorn BB. A comparison of the Lysholm and Cincinnati knee scoring questionnaires. Am J Sports Med. 1991;19(2):189-190. doi:10.1177/036354659101900215.

41. Sgaglione NA, Del Pizzo W, Fox JM, Friedman MJ. Critical analysis of knee ligament rating systems. Am J Sports Med. 1995;23(6):660-667. doi:10.1177/036354659502300604.

42. Marx RG, Jones EC, Allen AA, et al. Reliability, validity, and responsiveness of four knee outcome scales for athletic patients. J Bone Joint Surg Am. 2001;83(10):1459-1469. doi:10.2106/00004623-200110000-00001.

43. Lysholm J, Gillquist J. Evaluation of knee ligament surgery results with special emphasis on use of a scoring scale. Am J Sports Med. 1982;10(3):150-154. doi:10.1177/036354658201000306.

44. Tegner Y, Lysholm J. Rating systems in the evaluation of knee ligament injuries. Clin Orthop Relat Res. 1985;198:43-49. doi:10.1097/00003086-198509000-00007.

45. Lukianov AV, Gillquist J, Grana WA, DeHaven KE. An anterior cruciate ligament (ACL) evaluation format for assessment of artificial or autologous anterior cruciate reconstruction results. Clin Orthop Relat Res. 1987;218:167-180. doi:10.1097/00003086-198705000-00024.

46. Bengtsson J, Mollborg J, Werner S. A study for testing the sensitivity and reliability of the Lysholm knee scoring scale. Knee Surg Sports Traumatol Arthrosc. 1996;4(1):27-31. doi:10.1007/BF01565994.

47. Risberg MA, Holm I, Steen J, Beynnon BD. Sensitivity to changes over time for the IKDC form, the Lysholm score, and the Cincinnati knee score. A prospective study of 120 ACL reconstructed patients with a 2-year follow-up. Knee Surg Sports Traumatol Arthrosc. 1999;7(3):152-159. doi:10.1007/s001670050140.

48. Irrgang JJ, Anderson AF, Boland AL, et al. Development and validation of the international knee documentation committee subjective knee form. Am J Sports Med. 2001;29(5):600-613. doi:10.1177/03635465010290051301.

49. Irrgang JJ, Anderson AF, Boland AL, et al. Responsiveness of the International Knee Documentation Committee Subjective Knee Form. Am J Sports Med. 2006;34(10):1567-1573. doi:10.1177/0363546506288855.

50. Logerstedt D, Di Stasi S, Grindem H, et al. Self-reported knee function can identify athletes who fail return-to-activity criteria up to 1 year after anterior cruciate ligament reconstruction: a Delaware-Oslo ACL cohort study. J Orthop Sports Phys Ther. 2014;44(2):914-923. doi:10.2519/jospt.2014.4852.

51. Lentz TA, Zeppieri G Jr, George SZ, et al. Comparison of physical impairment, functional and psychosocial measures based on fear of reinjury/lack of confidence and return-to-sport status after ACL reconstruction. Am J Sports Med. 2015;43(2):345-353. doi:10.1177/0363546514559707.

52. Greco NJ, Anderson AF, Mann BJ, et al. Responsiveness of the International Knee Documentation Committee Subjective Knee Form in comparison to the Western Ontario and McMaster Universities Osteoarthritis Index, modified Cincinnati Knee Rating System, and Short Form 36 in patients with focal articular cartilage defects. Am J Sports Med. 2010;38(5):891-902. doi:10.1177/0363546509354163.

53. Hefti F, Muller W, Jakob RP, Staubli HU. Evaluation of knee ligament injuries with the IKDC form. Knee Surg Sports Traumatol Arthrosc. 1993;1(3-4):226-234. doi:10.1007/BF01560215.

54. Schmitt LC, Paterno MV, Huang S. Validity and internal consistency of the International Knee Documentation Committee Subjective Knee Evaluation Form in children and adolescents. Am J Sports Med. 2010;38(12):2443-2447. doi:10.1177/0363546510374873.

55. Briggs KK, Lysholm J, Tegner Y, Rodkey WG, Kocher MS, Steadman JR. The reliability, validity, and responsiveness of the Lysholm and Tegner activity scale for anterior cruciate ligament injuries of the knee: 25 years later. Am J Sports Med. 2009;37(5):890-897. doi:10.1177/0363546508330143.

56. Negahban H, Mostafaee N, Sohani SM, et al. Reliability and validity of the Tegner and Marx activity rating scales in Iranian patients with anterior cruciate ligament injury. Disabil Rehabil. 2011;33(23-24):2305-2310. doi:10.3109/09638288.2011.570409.

57. Marx RG, Stump TJ, Jones EC, Wickiewicz TL, Warren RF. Development and evaluation of an activity rating scale for disorders of the knee. Am J Sports Med. 2001;29(2):213-218. doi:10.1177/03635465010290021601.

58. Garratt AM, Brealey S, Gillespie WJ, in collaboration with the DAM-ASK Trial Team. Patient-assessed health instruments for the knee: a structured review. Rheumatology. 2004;43(11):1414-1423. doi:10.1093/rheumatology/keh362.

59. American Academy of Orthopaedic Surgeons. Scoring algorithms for the lower limb: Outcomes data collection instrument. Rosemon, IL: American Academy of Orthopaedic Surgeons; 1998.

60. Johanson NA, Liang MH, Daltroy L, Rudicel S, Richmond J. American Academy of Orthopaedic Surgeons lower limb outcomes assessment instruments. Reliability, validity, and sensitivity to change. J Bone Joint Surg Am. 2004;86-A(5):902-909.

MARX ACTIVITY RATING SCALE

The Marx activity rating scale was developed to be utilized with other knee rating scales and outcome measures as an activity assessment.⁵⁷ In contrast to the Tegner activity score, the Marx activity rating scale measures function rather than sport-specific activity. The scale is a short, patient-based activity assessment that consists of a 4-question survey evaluating patients’ knee health by recording the frequency and intensity of participation in a sporting activity. Questions are scored from 0 to 4 on the basis of how often the activity is performed. The 4 sections of the Marx scale that are rated include running, cutting, decelerating, and pivoting. This scale has been validated in patients with ACL injuries, chondromalacia patellae, and meniscal lesions.^42,56-58 Acceptable ceiling effects of 3% and floor effects of 8% were noted in the study of ACL-injured patients.⁵⁷

AMERICAN ACADEMY OF ORTHOPAEDIC SURGEONS (AAOS) SPORTS KNEE SCALE

The American Academy of Orthopaedic Surgeons (AAOS) Sports Knee Rating Scale consists of 5 parts and 23 items, including a section addressing stiffness, swelling, pain and function (7 questions), locking/catching (4 questions), giving way (4 questions), limitations of activity (4 questions), and pain with activity (4 questions).^59,60 Items may be dropped if patients select particular responses, which can lead to difficulties when using the survey. This scoring system has been found to be satisfactory when all subscales were combined and the mean was calculated.⁴²

DISCUSSION

PRO measures play an increasingly important role in the measurement of success and impact of health care services. Specifically, for ACL reconstruction, patient satisfaction is key for demonstrating the value of operative or other interventions. Selecting a suitable outcome measurement tool can be daunting, as it can be difficult to ascertain which outcome measures are appropriate for the patient or disorder in question. As there is currently no instrument that is universally superior in the evaluation of ACL outcomes, clinicians must consider the specific patient population in which the outcome instrument has been evaluated. Investigators should also use instruments with reported minimal clinically important differences so that variation in scores can be interpreted as either clinically significant or not. When choosing which outcome instrument to use, there is rarely a single appropriate rating system that is entirely comprehensive. In most cases, a general health outcome measure should be used in combination with a condition-specific rating scale. Activity rating scales, such as Marx or Tegner, should be included, especially when evaluating patients with low-activity lifestyles.

CONCLUSION

There are a number of reliable, valid, and responsive outcome measures that can be utilized to evaluate outcomes following ACL reconstruction in an array of patient populations. Outcome measures should be relevant to patients, easy to use, reliable, valid, and responsive to change. By increasing familiarity with these outcome measures, orthopedic surgeons and investigators can develop better studies, interpret data, and implement findings in practice with sound and informed judgment. Future research should focus on identifying the most relevant outcome metrics for assessing function following ACL reconstruction.

This paper will be judged for the Resident Writer’s Award.