Table 1 Implementation Outcome measures
Outcome | Measure (data source) | Frequency |
|---|---|---|
User-centered adaptation | Stakeholder interviews and workflow analysis | Pre-implementation |
Workflow integration | Usability testing and piloting | Pre-implementation |
Acceptability • Perceived usefulness • Perceived ease of use | TAM3 questionnaire (RN survey) Live usability testing | 6-months 6-months |
Fidelity | Live usability checklist | 6-months |
Adoption | # RN triage completed (EHR) # risk calculators completed (EHR) # order sets completed (EHR) # RN visits (EHR) | 6-, 12-months |
Appropriateness | Satisfaction (RN, clinician, patient survey) | Pre-implementation, 6-months |
Sustainability | Factors re: maintenance and scaling of RN iCPR (interviews) | 12-months |
Impact | ARI encounters with inappropriate antibiotic Rx (%) (EHR) Diagnostic testing (Rapid strep, CXR) (EHR) | Post-intervention |
Cost | Cost-effectiveness (EHR, reported training times, institutional salaries) | Post-intervention |