Skip to main content

Advertisement

Table 3 The general evaluation plan including areas to measure, general process questions, data sources and data collection methods

From: Systematic evaluation of implementation fidelity of complex interventions in health and social care

Areas to measure General process questions Data source and data collection method
Evaluation of adherence
Content Was each of the intervention components implemented as planned? - observations of work practices
- project leaders' logbooks
- interviews with stakeholders and participants
- Intervention 3: a previously developed and validated instrument IPS-fidelity scale will be used
Frequency/Duration (Dosage, Dose delivery) Were the intervention components implemented as often and for as long as planned? - observations of work practices
- project leaders logbooks
- interviews with stakeholders and participants
Coverage (Reach) What proportion of target group participated in the intervention? - interviews with project leaders and other relevant stakeholders
Potential moderating factors
Participant responsiveness (Dose received) How were the participants engaged with the intervention services?
How satisfied were the participants with the intervention services?
How did the participants perceive the outcomes and relevance of the intervention?
- project leaders' logbooks
- interviews with project leaders and participants
- questionnaire items to participants included in the follow-up measurements
Intervention complexity How complex is the intervention? - a group of external researchers will evaluate the intervention complexity
Comprehensiveness of policy description How specific is the interventions description? - a group of external researchers will evaluate the comprehensiveness of policy description
Strategies to facilitate implementation What strategies were used to support implementation?
How were these strategies perceived by staff involved in the project?
- interviews with project leaders, participants and other relevant stakeholders,
- questionnaire items to participants included in the follow-up measurements
Quality of delivery How was the quality of delivering the intervention components? - interviews with project leaders and participants,
- observations of work practices
Recruitment What recruitment procedures were used to attract individuals to the intervention? What constituted barriers to maintaining involvement of individuals? - interviews with those who recruited the participants
- interviews with project leaders and participants
Context What factors at political, economical, organizational, and work group levels affected the implementation? - interviews with project leaders, participants, and other relevant stakeholders
- project leaders' logbooks
- questionnaire items to participants included in the follow-up measurements