Comparing Three Approaches to Handling Dependency: A Case Study of a Meta-Analysis of Writing Self-Efficacy and Writing Proficiency
Ting Sun et al.
What the paper says
This study compared three approaches (i.e., averaging within-study effect sizes, three-level meta-analysis, and robust variance estimation) to handle dependent correlational effect sizes in conducting a meta-analysis. Data were from a meta-analytic study examining the relationship between writing self-efficacy and writing proficiency. To examine the differences in the performance of the three approaches, seven conditions were created by the number of studies and the number of effect sizes per study. While all three approaches produced similar results in the average effect size and standard error, the averaging approach had much smaller variance estimates. The patterns were basically consistent across different conditions. This study informs meta-analysts of appropriate procedures in handling the dependent effect sizes.
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.50 × 0.4 = 0.20 |
| M · momentum | 0.50 × 0.15 = 0.07 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.