We reviewed publications currently available about breast cancer screening to assess what information was provided about test accuracy and pretest and posttest disease probabilities, as this information is needed by consumers to make informed decisions about whether to undergo testing and to fully understand test results. A rating form was developed and used to assess 54 publications about their reports of breast cancer tests. A description of how the test is done was provided by almost all publications (93%). About half (48%) provided some information about possible adverse effects of the test. Eighteen percent of publications provided some (generally qualitative) information about test accuracy, and none provided quantitative information about the probability of disease given normal and abnormal test results.
It has been well established that patients want to participate in decisions about their treatment options1-3; therefore, they most likely also wish to participate in decisions about whether to undergo common diagnostic tests. A literature review (using the MESH headings Patient education, Consumer participation, and Sensitivity and Specificity) revealed only 1 study of patient knowledge and understanding of test accuracy for routine diagnostic tests.4 This study found that patients knew little about disease probabilities and diagnostic test characteristics, even if they had previous experience with the target disease. Some studies have addressed the information that people should be given about screening tests,5-8 and guidelines from the General Medical Council of the United Kingdom specify that information about the likelihood of positive or negative findings including false-negative and false-positive results must be provided.9 Logically, similar information should be available to individuals undergoing common diagnostic tests, but to our knowledge, no systematic assessment of the information available to consumers about common tests has been conducted. We therefore set out to assess the information provided about common tests in current consumer publications. Given the findings of the previous study,4 we were particularly interested to see whether information about test accuracy and about pretest and posttest probabilities was provided. We assessed breast cancer screening and diagnostic tests because much has been written for the public about breast cancer tests, and the information provided is usually relatively sophisticated.
Methods
The rating form
We developed a rating form to record the type of information in each publication. Following the recommendation that consumers’ questions should drive the content of information,3 we used “Questions to ask your physician about tests” in Smart Health Choices, a consumer-oriented book about making health decisions,10 and the General Medical Council guideline for providing information about screening tests9 to develop the rating form. In addition to assessing information about false-positive and false-negative results (test accuracy), pretest probabilities and posttest probabilities given a normal or abnormal test result, we assessed whether information was given about how the test is conducted, likely emotional responses to being tested, and shared clinical decision making. The rating form consisted of 16 items (see Table W1, available at http://www.jfponline.com). A 5-point Likert scale was used to rate the publications on each item from 1 (no information) to 5 (detailed information).
The publications
In December 1999 and January 2000 we telephoned the New South Wales (NSW) Cancer Council (the leading cancer advocacy center in NSW), the NSW BreastScreen Coordinating Unit (which coordinates all government-funded breast screening and assessment services in NSW, operating from 36 clinics) and 2 large private breast clinics. We also phoned the larger BreastScreen clinics directly. We asked for all pamphlets, booklets, or other written patient education materials about breast tests. Publications were received from 12 locations of 14 telephoned, (86%).
Rating agreement
We chose 10 publications at random and 2 of us (A.B. and P.B.) rated them independently. Overall, there was perfect agreement for 79% of the items, near agreement (1 point difference on the Likert scale) on 12% of items, and more than 1 point difference on the Likert scale on the remaining 9% of items. Based on these results we modified the scale slightly to reduce ambiguity and clarified how to rate information in a written guide. One of us (E.C.) rated all 54 publications using the guide and the rating form.
Results
We received 54 publications. Of these, 43% contained information on breast self-examination, 51% clinical examination, 69% screening mammography, 44% diagnostic mammography, 30% diagnostic ultrasound, 30% fine-needle aspiration biopsy, 28% core biopsy, 13% open surgical biopsy, and 7% genetic testing. The publications were written by cancer organisations, the BreastScreen Coordinating Unit, and by individual public and private clinics. Most were brief (1–4 A4 pages) although 1, on all aspects of breast cancer detection and treatment, was 44 pages long.