Site B is small, 45-bed community hospital in a semi-rural community. The hospitalist service began in December 2016, with 4 FTE hospitalists caring for an average of 28 patients daily. This constituted 2 hospitalists rounding daily on admitted patients, with on-call coverage provided from home.
Site C is a 188-bed community hospital with a hospitalist service initially introduced in 2005. In 2016, the program was disbanded and the site moved back to a primarily community-based model, in which family physicians in the community were invited to assume the care of hospitalized patients. However, the hospitalist program had to be reintroduced in January 2017 due to poor uptake among PCPs in the community. At the time of evaluation, 19 FTE hospitalists (with 7 hospitalists working daily) provided most responsible physician care to a daily census of 116 patients (average individual census: 16). The program also covered ED admissions in-house until midnight, with overnight call provided from home.
Approach
We adopted a utilization-focused evaluation approach to guide our investigation. In this approach, the assessment is deliberately planned and conducted in a way that it maximizes the likelihood that findings would be used by the organization to inform learning, adaptations, and decision-making.11 To enable this, the evaluator identified the primary intended recipients and engaged them at the start of the evaluation process to understand the main intended uses of the project. Moreover, the evaluator ensured that these intended uses of the evaluation guided all other decisions made throughout the process.
We collected data using an online survey of the staff at the 3 facilities, complemented by a series of semistructured qualitative interviews with FH administrators and frontline providers.
Online survey
We conducted an open online survey of a broad range of stakeholders who worked in the 3 facilities. To develop the questionnaire, we searched our department’s archives for previous surveys conducted from 2001 to 2005. We also interviewed the regional HM program management team to identify priority areas and reached out to the local leadership of the 3 acute care facilities for their input and support of the project. We refined the survey through several iterations, seeking input from experts in the FH Department of Evaluation and Research. The final questionnaire contained 10 items, including a mix of closed- and open-ended questions (Appendix A).