A Meta‐Study of <i>New Directions for Evaluation</i>: An Analysis of Publication Characteristics From 2010 to 2024
Ziyu Zhao et al.
What the paper says
ABSTRACT This meta‐study evaluates trends and patterns in author and article characteristics found in the New Directions for Evaluation from first publication in 2010 to 2024. Research articles were coded and analyzed by both author (e.g., sex, affiliation) and article (e.g., domain, sample size, sampling procedures, design type, statistical analyses) characteristics. Findings suggested significant shifts in authorship (e.g., majority female authors, more international lead authors, 3.09 authors per article) and content type (e.g., more international development and higher education articles and fewer education articles). Only about 10% of NDE articles were classified as research. Nearly all participant, research design, and analysis characteristics were stable over time, with the exception of a substantial increase in the use of consensual qualitative research (CQR) approaches in NDE qualitative and mixed method research studies. The use of effect size, sample reliability (or dependability), and validity (or generalizability) estimates should be addressed in future NDE research articles.
1 citation
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.16 × 0.4 = 0.06 |
| M · momentum | 0.53 × 0.15 = 0.08 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.