arbiter
JournalsAccount

Conditional Dependencies Between Response Time and Item Discrimination: An Item-Level Meta-Analysis

Joshua B. Gilbert et al.

Educational and Psychological Measurement2026https://doi.org/10.1177/00131644261426972article
ABDC A
Weight
0.50

Abstract

The use of process data, such as response time (RT) in psychometrics, has generally focused on the relationship between speed and accuracy. The potential relationships between RT and item discrimination remain less explored. In this study, we propose a model for simultaneously estimating the relationships between RT and item discrimination at the person, item, and person-by-item (residual) levels and illustrate our approach through an item-level meta-analysis of 40 empirical data sets comprising 1.84 million item responses. We find no evidence of average differences in item discrimination between items of different time intensity or persons of different average RT, while residual RT strongly and negatively predicts item discrimination (pooled coef. = -.27% per 1% difference in RT, SE = .04, τ = .17). While heterogeneity is high, we find little evidence of moderation by overall data set characteristics. Flexible generalized additive models show that the relationship between residual RT and item discrimination is generally curvilinear, with discrimination maximized just below average RT and minimized at the extremes. Our results suggest that RT data can provide insights into the measurement properties of educational and psychological assessments, but that the relationships between RT and item discrimination are highly variable.

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.1177/00131644261426972

Or copy a formatted citation

@article{joshua2026,
  title        = {{Conditional Dependencies Between Response Time and Item Discrimination: An Item-Level Meta-Analysis}},
  author       = {Joshua B. Gilbert et al.},
  journal      = {Educational and Psychological Measurement},
  year         = {2026},
  doi          = {https://doi.org/https://doi.org/10.1177/00131644261426972},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Conditional Dependencies Between Response Time and Item Discrimination: An Item-Level Meta-Analysis

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.50

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.50 × 0.4 = 0.20
M · momentum0.50 × 0.15 = 0.07
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.