To reach the target audience, we collaborated with each hospital’s local leadership as well as the Divisions of Family Practice (DFP) that support local community PCPs in each hospital community.10 Existing email lists were compiled to create a master electronic survey distribution list. The initial invitation and 3 subsequent reminders were disseminated to the following target groups: hospital physicians (both hospitalists and nonhospitalists), PCPs, nursing and other allied professionals, administrators, and DFP leadership.
The survey consent form, background information, questions, and online platform (SimpleSurvey, Montreal, QC) were approved by FH’s Privacy Department. All respondents were required to provide their consent and able to withdraw at any time. Survey responses were kept anonymous and confidential, with results captured automatically into a spreadsheet by the survey platform. As an incentive for participation, respondents had the opportunity to win 1 of 3 $100 Visa gift cards. Personal contact information provided for the prize draw was collected in a separate survey that could not link back to respondents’ answers. The survey was trialed several times by the evaluation team to address any technical challenges before dissemination to the targeted participants.
Qualitative interviews
We conducted semistructured interviews with a purposive sample of FH administrators and frontline providers (Appendix B). The interview questions broadly mirrored the survey but allowed for more in-depth exploration of constructs. Interviewees were recruited through email invitations to selected senior and mid-level local and regional administrators, asking interviewees to refer our team to other contacts, and inviting survey respondents to voluntarily participate in a follow-up interview. One of the authors (EM), a Credentialed Evaluator, conducted all the one-time interviews either in-person at the individual participant’s workplace or by telephone. She did not have pre-existing relationships with any of the interviewees. Interviews were recorded and transcribed for analysis. Interviewees were required to consent to participate and understood that they could withdraw at any point. They were not offered incentives to participate. Interviews were carried out until thematic saturation was reached.
Analysis
A content analysis approach was employed for all qualitative data, which included open-ended responses from the online survey and interview transcripts. One of the authors (EM) conducted the analysis. The following steps were followed in the inductive content analysis process: repeated reading of the raw data, generation of initial thematic codes, organizing and sorting codes into categories (ie, main vs subcategories), coding of all data, quantifying codes, and interpreting themes. When responding to open-ended questions, respondents often provided multiple answers per question. Each of the respondents’ answers were coded. In alignment with the inductive nature of the analysis process, themes emerged organically from the data rather than the researchers using preconceived theories and categories to code the text. This was achieved by postponing the review of relevant literature on the topic until after the analysis was complete and using an external evaluation consultant (with no prior relationship to FH and limited theoretical knowledge of the topic matter) to analyze the data. Descriptive statistics were run on quantitative data in SPSS (v.24, IBM, Armonk, NY). For survey responses to be included in the analysis, the respondents needed to indicate which site they worked at and were required to answer at least 1 other survey question. One interviewee was excluded from the analysis since they were not familiar with the hospitalist model at their site.
Ethics approval
The evaluation protocol was reviewed by FH Department of Evaluation and Research and was deemed exempt from formal research ethics review.