Original Research

Evaluation of Internet Information About Rotator Cuff Repair

Am J Orthop. 2016 March;45(3):E136-E142

References

1. Brunnekreef JJ, Schreurs BW. Total hip arthroplasty: what information do we offer patients on websites of hospitals? BMC Health Serv Res. 2011;11:83.

2. Koh HS, In Y, Kong CG, Won HY, Kim KH, Lee JH. Factors affecting patients’ graft choice in anterior cruciate ligament reconstruction. Clin Orthop Surg. 2010;2(2):69-75.

3. Nason GJ, Baker JF, Byrne DP, Noel J, Moore D, Kiely PJ. Scoliosis-specific information on the Internet: has the “information highway” led to better information provision? Spine. 2012;37(21):E1364-E1369.

4. Groves ND, Humphreys HW, Williams AJ, Jones A. Effect of informational Internet web pages on patients’ decision making: randomised controlled trial regarding choice of spinal or general anaesthesia for orthopaedic surgery. Anaesthesia. 2010;65(3):277-282.

5. Purcell K, Brenner J, Rainie L. Search Engine Use 2012. Washington, DC: Pew Internet & American Life Project; 2012.

6. Duncan IC, Kane PW, Lawson KA, Cohen SB, Ciccotti MG, Dodson CC. Evaluation of information available on the Internet regarding anterior cruciate ligament reconstruction. Arthroscopy. 2013;29(6):1101-1107.

7. Lichtenfeld LJ. Can the beast be tamed? The woeful tale of accurate health information on the Internet. Ann Surg Oncol. 2012;19(3):701-702.

8. Ahmed OH, Sullivan SJ, Schneiders AG, McCrory PR. Concussion information online: evaluation of information quality, content and readability of concussion-related websites. Br J Sports Med. 2012;46(9):675-683.

9. Bruce-Brand RA, Baker JF, Byrne DP, Hogan NA, McCarthy T. Assessment of the quality and content of information on anterior cruciate ligament reconstruction on the Internet. Arthroscopy. 2013;29(6):1095-1100.

10. Dy JC, Taylor SA, Patel RM, Kitay A, Roberts TR, Daluiski A. The effect of search term on the quality and accuracy of online information regarding distal radius fractures. J Hand Surg Am. 2012;37(9):1881-1887.

11. Garcia RM, Messerschmitt PJ, Ahn NU. An evaluation of information on the Internet of a new device: the lumbar artificial disc replacement. J Spinal Disord Tech. 2009;22(1):52-57.

12. Gosselin MM, Mulcahey MK, Feller E, Hulstyn MJ. Examining Internet resources on gender differences in ACL injuries: what patients are reading. Knee. 2013;20(3):196-202.

13. Lam CG, Roter DL, Cohen KJ. Survey of quality, readability, and social reach of websites on osteosarcoma in adolescents. Patient Educ Couns. 2013;90(1):82-87.

14. Morr S, Shanti N, Carrer A, Kubeck J, Gerling MC. Quality of information concerning cervical disc herniation on the Internet. Spine J. 2010;10(4):350-354.

15. Starman JS, Gettys FK, Capo JA, Fleischli JE, Norton HJ, Karunakar MA. Quality and content of Internet-based information for ten common orthopaedic sports medicine diagnoses. J Bone Joint Surg Am. 2010;92(7):1612-1618.

16. Stinson JN, Tucker L, Huber A, et al. Surfing for juvenile idiopathic arthritis: perspectives on quality and content of information on the Internet. J Rheumatol. 2009;36(8):1755-1762.

17. Sullivan TB, Anderson JS, Ahn UM, Ahn NU. Can Internet information on vertebroplasty be a reliable means of patient self-education? Clin Orthop Relat Res. 2014;472(5):1597-1604.

18. Weil AG, Bojanowski MW, Jamart J, Gustin T, Lévêque M. Evaluation of the quality of information on the Internet available to patients undergoing cervical spine surgery. World Neurosurg. 2014;82(1-2):e31-e39.

19. Yi PH, Ganta A, Hussein KI, Frank RM, Jawa A. Readability of arthroscopy-related patient education materials from the American Academy of Orthopaedic Surgeons and Arthroscopy Association of North America web sites. Arthroscopy. 2013;29(6):1108-1112.

20. Boyer C, Selby M, Scherrer JR, Appel RD. The Health On the Net code of conduct for medical and health websites. Comput Biol Med. 1998;28(5):603-610.

21. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor—Let the reader and viewer beware. JAMA. 1997;277(15):1244-1245.

22. Fabricant PD, Dy CJ, Patel RM, Blanco JS, Doyle SM. Internet search term affects the quality and accuracy of online information about developmental hip dysplasia. J Pediatr Orthop. 2013;33(4):361-365.

23. Aslam N, Bowyer D, Wainwright A, Theologis T, Benson M. Evaluation of Internet use by paediatric orthopaedic outpatients and the quality of information available. J Pediatr Orthop B. 2005;14(2):129-133.

24. Wetzler MJ. “I found it on the Internet”: how reliable and readable is patient information? Arthroscopy. 2013;29(6):967-968.

25. Qureshi SA, Koehler SM, Lin JD, Bird J, Garcia RM, Hecht AC. An evaluation of information on the Internet about a new device: the cervical artificial disc replacement. Spine. 2012;37(10):881-883.

When the 2011 and 2014 website content was compared, several changes were noted. Percentage of websites providing an author contact method increased from 21% to 50% (Figure 2), percentage detailing rotator cuff repairs increased from 82% to 91%, and percentage introducing treatment options in addition to surgical management increased from 11.5% to 61%. Percentage discussing surgical eligibility, however, decreased from 43% to 18%. Percentage citing peer-reviewed sources remained relatively constant (28%, 26%), as did percentage discussing surgical technique for rotator cuff repair (55%, 59%) (Figure 3). A major decrease was found in percentage of websites discussing surgical complications, 42% in 2011 down to 25% in 2014, whereas a major increase was found in percentage discussing rehabilitation, from 39% in 2011 up to 73% in 2014. In 2014, no websites discussed double- versus single-row surgery—compared with 6% in 2011. False claims remained low between 2011 and 2014. In both searches, no website guaranteed a return to sport, and few made claims of painless or bloodless surgery.

DISCERN scores for websites found during the 2014 search were averaged for each of the 6 authorship groups (Figure 4). The highest DISCERN scores were given to academic institution websites (51.6) and public education websites (49). For the academic websites, this difference was significant relative to news, blog, and private physician websites (Ps = .012, .001, .001) The lowest DISCERN scores were given to news organization websites and personal blogs. DISCERN scores were 43.8 for industry sources and 40.7 for private physician groups; the difference was not significant (P = .229). Overall mean DISCERN score for all websites was 44. Eleven percent of websites were HONcode-certified.

No correlation was found between website readability and DISCERN score; correlation coefficient r was .01 (Figure 5). For the websites in 2014, mean Flesch-Kincaid readability score was 50.17, and mean grade level was 10.98; coefficient of determination r² was 0.00012.

The Table compares our data with data from other orthopedic studies that have analyzed the quality of Internet information about various orthopedic injuries, diseases, and procedures.^{3-6,8,9,11-18} With its mean DISCERN score of 44, the present rotator cuff tear study was ranked third of 6 studies that have used this scoring system to analyze website content. Of these 6 studies, those reviewing osteosarcoma and juvenile idiopathic arthritis were ranked highest (mean scores, 49.8 and 48.9, respectively), and the study reviewing scoliosis surgery was ranked lowest (38.9). Bruce-Brand and colleagues9 recently found a mean DISCERN score of 41 for anterior cruciate ligament (ACL) reconstruction. When considering HONcode-certified websites, our Internet search for rotator cuff tears found the third lowest percentage, 10.5%, compared with the other studies (Table); the highest percentage, 30%, was found for websites discussing concussions in athletes. When considering authorship, our rotator cuff study found the third highest percentage, 76%, authored by academic centers, physicians, and public education websites; the highest percentage was found in websites discussing ACL reconstruction. Websites discussing ACL reconstruction also had the highest percentage of websites authored by industry.⁹

Discussion

To our knowledge, this is the first study specifically analyzing the quality of Internet information about rotator cuff repairs. A similar study, conducted by Starman and colleagues¹⁵ in 2010, addressed the quality of web information about 10 common sports medicine diagnoses, one of which was rotator cuff tears. In that study, only 16 of the websites included discussed rotator cuff tears. In addition, the authors used a customized, HONcode-based grading system to analyze each website, making their data difficult to compare across studies.

Ideally, a high-quality medical website should be written by a credible source and should cover a disorder, treatment options, eligibility, rehabilitation, and complications. As there is no standard grading system for analyzing web content about rotator cuff repairs, we analyzed the websites for specific information we thought should be included in a high-quality website (Figures 2, 3). When considering authorship, we found academic centers, private physicians, and educational sources comprised 76% of the sources; industry sources made up only 12%. Similar findings were noted by investigators analyzing Internet information about other orthopedic topics, including ACL reconstruction, lumbar arthroplasty, osteosarcoma, and cervical spine surgery.^5,11,22 Studies analyzing websites for information on ACL tears and distal radius fractures found have a higher percentage of industry-sponsored websites.^9,10

DISCERN showed that the highest-quality information came from websites with academic affiliations, consistent with previous studies,^3,9,17 and its mean score (51.6) was significantly higher than the scores for private physician websites, news sites, and blogs (Ps = .001, .016, .001); the least reliable information was from personal blogs and news outlets. Of note, mean DISCERN score was higher for the industry websites we found than for private physician websites (43.8 vs 40.7), though the difference was not significant (P = .229). Previous investigators considered number of industry-sponsored websites as a marker of poor quality of information relating to a given topic; however, given the DISCERN scores in our study, this might not necessarily be true.⁶ Based on the present study’s data, websites affiliated with academic institutions would be recommended for patients searching for high-quality information about rotator cuff tears.