The Next 7 Years of Published Research on Evaluation: A Follow‐Up of Coryn et al. (2017)
Dana Linnell Wanzer & Alicia Stachowski
What the paper says
ABSTRACT Meta‐research on evaluation (meta‐RoE) is needed to understand the current landscape of RoE and to help move RoE forward. The last systematic review of RoE was published in 2017 by Coryn et al. and examined articles published in 14 evaluation journals between 2005 and 2014. They found that of the 3390 articles published in this time frame, 257 (7.58%) were coded as RoE. This study extends their work by using similar methods to examine articles published between 2015 and 2021. Of the 3099 articles published in this time frame, 708 (22.85%) were coded as RoE. These articles were further examined against Mark's (2008) framework for subjects and modes of inquiry, finding that most published RoE examined evaluation activities using description. This study can be used to inform future RoE by using the published data as starting points for literature reviews. It also highlights current challenges with defining RoE and coding articles for whether they are RoE.
8 citations
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.50 × 0.4 = 0.20 |
| M · momentum | 0.70 × 0.15 = 0.10 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.