Skip to main content

Table 3 The general evaluation plan including areas to measure, general process questions, data sources and data collection methods

From: Systematic evaluation of implementation fidelity of complex interventions in health and social care

Areas to measure

General process questions

Data source and data collection method

Evaluation of adherence

Content

Was each of the intervention components implemented as planned?

- observations of work practices

- project leaders' logbooks

- interviews with stakeholders and participants

- Intervention 3: a previously developed and validated instrument IPS-fidelity scale will be used

Frequency/Duration (Dosage, Dose delivery)

Were the intervention components implemented as often and for as long as planned?

- observations of work practices

- project leaders logbooks

- interviews with stakeholders and participants

Coverage (Reach)

What proportion of target group participated in the intervention?

- interviews with project leaders and other relevant stakeholders

Potential moderating factors

Participant responsiveness (Dose received)

How were the participants engaged with the intervention services?

How satisfied were the participants with the intervention services?

How did the participants perceive the outcomes and relevance of the intervention?

- project leaders' logbooks

- interviews with project leaders and participants

- questionnaire items to participants included in the follow-up measurements

Intervention complexity

How complex is the intervention?

- a group of external researchers will evaluate the intervention complexity

Comprehensiveness of policy description

How specific is the interventions description?

- a group of external researchers will evaluate the comprehensiveness of policy description

Strategies to facilitate implementation

What strategies were used to support implementation?

How were these strategies perceived by staff involved in the project?

- interviews with project leaders, participants and other relevant stakeholders,

- questionnaire items to participants included in the follow-up measurements

Quality of delivery

How was the quality of delivering the intervention components?

- interviews with project leaders and participants,

- observations of work practices

Recruitment

What recruitment procedures were used to attract individuals to the intervention? What constituted barriers to maintaining involvement of individuals?

- interviews with those who recruited the participants

- interviews with project leaders and participants

Context

What factors at political, economical, organizational, and work group levels affected the implementation?

- interviews with project leaders, participants, and other relevant stakeholders

- project leaders' logbooks

- questionnaire items to participants included in the follow-up measurements