It's All Relative: Degree, Causes, and Impact of Ipsativity on Forced‐Choice Personality Tests
Andrew B. Speer et al.
Abstract
Personality tests are susceptible to faking, leading to increased use in forced choice (FC) measures. However, a major challenge is that FC tests are often ipsative, meaning scores are dependent upon one another, therefore distorting inter‐individual comparisons. Despite this, ipsativity is poorly understood as it occurs in real‐world settings, including its degree, causes, and impacts. Drawing on 49 independent samples with matched FC and single‐stimulus (SS) measures, we operationally defined and assessed ipsativity meta‐analytically. Comparing normative SS measures to FC scores, we found that FC intercorrelations are meaningfully lower, though ipsativity varies considerably, with most measures being partially ipsative. Item desirability balance within blocks emerged as a critical factor influencing ipsativity, with balanced blocks (i.e., equal statement desirability) more likely to produce ipsativity. Furthermore, summative scoring exhibited stronger ipsative effects than item‐response‐theory (IRT) scoring, yet IRT scoring did not fully alleviate ipsativity unless some item blocks were unbalanced in desirability. Importantly, ipsativity was tied to diminished construct validity but also more resistance to mean shifts in scores due to faking. These results demonstrate that more normative FC measures exhibit more favorable validity but may be susceptible to faking. Thus, thoughtful FC design is required to balance FC goals.
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.50 × 0.4 = 0.20 |
| M · momentum | 0.50 × 0.15 = 0.07 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.