arbiter
JournalsAccount

Impact of Parameter Predictability and Joint Modeling of Response Accuracy and Response Time on Ability Estimates

Maryam Pezeshki & Susan E. Embretson

Applied Psychological Measurement2025https://doi.org/10.1177/01466216251322646article
AJG 2ABDC B
Weight
0.37

Abstract

To maintain test quality, a large supply of items is typically desired. Automatic item generation can result in a reduction in cost and labor, especially if the generated items have predictable item parameters and thus possibly reducing or eliminating the need for empirical tryout. However, the effect of different levels of item parameter predictability on the accuracy of trait estimation using item response theory models is unclear. If predictability is lower, adding response time as a collateral source of information may mitigate the effect on trait estimation accuracy. The present study investigates the impact of varying item parameter predictability on trait estimation accuracy, along with the impact of adding response time as a collateral source of information. Results indicated that trait estimation accuracy using item family model-based item parameters differed only slightly from using known item parameters. Somewhat larger trait estimation errors resulted from using cognitive complexity features to predict item parameters. Further, adding response times to the model resulted in more accurate trait estimation for tests with lower item difficulty levels (e.g., achievement tests). Implications for item generation and response processes aspect of validity are discussed.

1 citation

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.1177/01466216251322646

Or copy a formatted citation

@article{maryam2025,
  title        = {{Impact of Parameter Predictability and Joint Modeling of Response Accuracy and Response Time on Ability Estimates}},
  author       = {Maryam Pezeshki & Susan E. Embretson},
  journal      = {Applied Psychological Measurement},
  year         = {2025},
  doi          = {https://doi.org/https://doi.org/10.1177/01466216251322646},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Impact of Parameter Predictability and Joint Modeling of Response Accuracy and Response Time on Ability Estimates

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.37

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.16 × 0.4 = 0.06
M · momentum0.53 × 0.15 = 0.08
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.