Measures of intervention fidelity can be used to identify specific intervention components promoting desired change - the active ingredients - yet such applications are rare. In the context of a social-emotional learning intervention, we illustrate how fidelity measures can be used to identify program active ingredients. We applied one customary and two novel approaches to creating indices of fidelity. In the customary approach, we averaged fidelity ratings across all core components. In the novel approaches, we computed fidelity indices for specific components by (a) averaging responses from like-items and (b) deriving factor scores from a multitrait, multimethod factor analysis. We then tested indices in relation to achievement gains (N = 1442). Indices derived using novel approaches explained more outcome variance than indices from the customary approach. Further, novel approaches revealed one component as a potential active ingredient. Discussion highlights strengths and limitations of the indices and implications for identifying program active ingredients.
Details
- Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients
- Abry, Tashia (Author)
- Hulleman, Chris S. (Author)
- Rimm-Kaufman, Sara E. (Author)
- College of Liberal Arts and Sciences (Contributor)
- Digital object identifier: 10.1177/1098214014557009
- Identifier TypeInternational standard serial numberIdentifier Value1098-2140
- Identifier TypeInternational standard serial numberIdentifier Value1557-0878
- http://dx.doi.org/10.1177/1098214014557009
Citation and reuse
Cite this item
This is a suggested citation. Consult the appropriate style guide for specific citation guidelines.
Abry, Tashia, Hulleman, Chris S., & Rimm-Kaufman, Sara E. (2015). Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients. AMERICAN JOURNAL OF EVALUATION, 36(3), 320-338. http://dx.doi.org/10.1177/1098214014557009