Analyses
Descriptive statistics were used for EHR data and satisfaction surveys. For qualitative analysis, each transcript was read in full by 2 researchers to get an overview of the data, and a rapid analysis approach was used to identify central themes focused on how technology was used and the experiences of the participants.11,12 Relevant text for each topic was tabulated, and a summary table was created that highlighted overlapping ideas discussed by the interviewees as well as differences.
Results
Of the 22 veterans who participated in the project, 11 completed satisfaction surveys and 4 participated in qualitative interviews. The rural and nonrural groups did not differ demographically or by diagnosis, which was predominantly mental health related. Only 1 veteran in each group owned a tablet; the majority of both groups required VA-issued devices: 80% (n = 8) rural and 91.7% (n = 11) nonrural. The number of VRtele sessions for the groups also was similar, 53 for rural and 60 for nonrural, as was the mean (SD) number of sessions per veteran: 5.3 (SD, 3.2) rural and 5.0 (SD, 2.5) urban. Overall, 63 miles per session were saved, mostly for rural veterans, and the number of mean (SD) miles saved per veteran was greater for rural than nonrural veterans: 379.2 (243.0) and 256.1 (275.9), respectively. One veteran who moved to a different state during the program continued VRtele at the new location. In a qualitative sampling of 5 VRtele sessions, all the VRSs used office desktop computers.
Level of satisfaction with aspects of VRtele related to the technology rated was consistently > 4 on the Likert scale. The lowest mean (SD) ratings were 4.2 (1.0) for audio quality and 4.4 (0.5) for video quality, and the highest rating was given for equipment operation explanation and privacy was respected, 4.9 (0.3) for both. All questions related to satisfaction with services were also rated high: The mean (SD) lowest ratings were 4.3 (1.0) given to both vocational needs 4.3 (1.0) and tasks effectively helped achieve goals 4.3 (0.7). The highest mean (SD) ratings were 4.6 (0.5) given to VR program service explained and 4.7 (0.5) for appointment timeliness.
Qualitative Results
At first, some VRSs thought the teleconferencing system might be difficult or awkward to use, but they found it easier to set up than expected and seamless to use. VRS staff reported being surprised at how well it worked despite some issues that occurred with loading the software. Once loaded, however, the connection worked well, one VRS noting that following step-by-step instructions solved the problem. Some VRSs indicated they did not invite all the veterans on their caseload to participate in VRtele due to concerns with the patient’s familiarity with technology, but one VRS stated, “I haven’t had anybody that failed to do a [session] that I couldn’t get them up and running within a few minutes.”
When working in the community, VRSs reported using laptops for VRtele but found that these devices were unreliable due to lack of internet access and were slow to start; several VRSs thought tablets would have been more helpful. Some veterans reported technical glitches, lack of comfort with technology, or a problem with sound due to a tablet’s protective case blocking the speakers. To solve the sound issue, a veteran used headphones. This veteran also explained that the log-on process required a new password every time, so he would keep a pen and paper ready to write it down. Because signing in and setting up takes a little time, this veteran and his VRS agreed to start connecting 5 minutes before their meeting time to allow for that set- up time.
Initially, some VRSs expressed concern that transitioning to VRtele would affect the quality of interactions with the veterans. However, VRSs also identified strengths of VRtele, including flexibility, saved time, and increased interaction. One VRS discussed a veteran’s adaptation by saying, “I think he feels even more involved in his plan [and] enjoys the increased interaction.” Veterans reported enjoying using tablets and identified the main strength of VRtele as being able to talk face-to-face with the VRS. Echoing the VRSs, veterans reported teleconferencing saved time by avoiding travel and enabled spontaneous meetings. One of the veterans summed up the benefits of using VRtele: “I’d rather just connect. It’s going to take us 40 to 50 minutes [to meet in person] when we can just connect right here and it takes 15 to 20. We don’t have to go through the driving.… So this right here, doing it ahead of time and having the appointment, it’s a lot easier.”
In their interviews, VRSs talked about enjoying VRtele. A VRS explained: “It makes it a lot easier. It makes me feel less guilty. This way [veterans] don’t have to use their gas money, use their time. I know [the veteran] had something else he needed to do today.” Thus, both veterans and VRSs were satisfied with their VRtele experiences.