On the day of the colonoscopy, veterans in the intervention group were surveyed in the waiting room about their experience receiving the text messages and soliciting feedback for improvement or surveyed via telephone call within 3 days of their procedure. Patient satisfaction was quantified with a scale from 1 (low) to 10 (high), including questions about how helpful the texts were in relation to total number, timing, and content of messages as well as whether veterans would like to receive the text messages again for future procedures.
We reviewed individual charts and collected Boston Bowel Preparation Scale (BBPS) scores to determine adequate preparation. BBPS assigns a score of 0 to 3 for the right, transverse, and left colon applied upon withdrawal after flushing and suctioning have been completed.12 Adequate preparation is considered a total score of ≥ 6 with no segment scoring < 2. This method of preparation assessment is preferred due to its ability to account for difference in preparation quality among colonic segments, well-defined scoring characteristics, and several studies validating its use showing inter- and intraobserver reliability.12 Follow-up studies have shown validity of the BBPS when compared with relevant outcomes such as polyp detection rate and recommended timing for repeat procedure.13 Variables associated with poor bowel preparation (ie, gender, prior abdominal surgery, impaired mobility, high body mass index, diabetes mellitus, stroke, dementia, any neurologic diagnosis, cirrhosis, smoking, polypharmacy [> 8 active medications], and narcotic or tricyclic antidepressant medication use) were also collected through chart review.3-5 We note that immobility was defined by International Classification of Diseases (ICD)-9 and ICD-10 codes and prescriptions for assistive devices (ie, canes, wheelchairs, 4-wheeled walkers).
Veterans assent to be enrolled in Annie. After enrollment, veterans must text back a specific word response to an initial text message to receive the protocolized messages from the Annie program. A contact phone number to the gastrointestinal nurse line was provided for questions during business hours. The start date for the text message protocol is 6 days prior to the procedure date. If a patient rescheduled their colonoscopy, the Annie database was updated manually.
Statistical Analysis
We used both Pearson χ2 test and 2-sample t test analyses to compare demographic information and patient satisfaction scores between the control and intervention groups. We compared continuous BBPS scores between Annie intervention vs control group using parametric and nonparametric independent t tests using the Mann-Whitney U test. We repeated this analysis controlling for both mental health diagnoses and age using linear regression. We were unable to survey 61 of the 187 veterans who received Annie text messages.
RESULTS
During PDSA cycles 1 and 2, 640 veterans were scheduled for outpatient colonoscopy: 453 veterans were in the control group; 187 veterans were in the intervention group, of which 126 were surveyed. A significant percentage of veterans declined participation because they felt like they did not need reinforced education; others were not eligible for Annie due to requirement for extended bowel preparation, cancelled colonoscopy, inability to physically read text messages, or lack of cell phone.
The mean (SD) age was 65 (8) years; 184 (28.8%) had a diabetes mellitus diagnosis, and the mean (SD) body mass index was 31.6 (6.4). The Annie group was slightly more likely to have mental health diagnoses and lower age compared with the control group (Table 1).
Annie text messaging instructions were associated with a higher BBPS score (8.2) compared with usual care (7.8); P = .007 using independent t test, and P = .002 using parametric independent t test. Differences between Annie and control groups remained significant after controlling for age and mental health diagnoses (P = .04)Patient Feedback
We collected feedback from veterans after each PDSA cycle to identify areas for improvement by both in-person and telephone surveys. Based on feedback from PDSA cycle 1, we decreased the total number of text messages to create a more succinct set of instructions. The most frequently requested change involved timing the text messages to align with the exact morning a specific instruction should take place.
Patient satisfaction with the Annie text messaging service was high.
All veterans from PDSA cycle 2 wanted to receive the text messages again for future procedures, a significant improvement from PDSA cycle 1 (Table 2). Veterans most appreciated the factors of convenience and brevity; they felt much pride that their VA was making technologic advancements.