Essential Validation Criteria for Rigorous Covariance‐Based Structural Equation Modelling

James Gaskin et al.

Information Systems Journal2025https://doi.org/10.1111/isj.12598article
AJG 4ABDC A*
Weight
0.67

Abstract

Covariance‐based structural equation modelling (CB‐SEM) is a robust analytical technique for validating complex measurements and theoretical models. Despite criticisms regarding overfitting, misspecification and sample size limitations, SEM remains invaluable for rigorous theoretical model testing when applied correctly. This Methods Article aims to streamline the extensive SEM criteria into essential considerations segmented across three critical stages: data preparation, measurement validation and structural modelling. This provides scholars with a comprehensive guide tailored to meet the stringent requirements of top‐tier scientific journals. We outline data design considerations, progress through key SEM processes, and conclude with guidelines for testing specific hypotheses. We also illuminate relevant validation criteria for each stage, forming a foundational framework for rigorous SEM analysis. Neglecting any of these criteria can trigger irreversible analytical errors. We provide examples of how missing some criteria can drastically change results. We also demonstrate an ongoing issue with inadequate reporting of these criteria in IS journals, exacerbating these issues. Currently, SEM instruction is dispersed across numerous books and articles across different fields and decades, often with complex explanations. Our principal contribution is consolidating a comprehensive set of validation criteria into an articulated guide for scholars not yet proficient in SEM. However, this is not a step‐by‐step walkthrough for advanced SEM users. We advocate for a structured, transparent reporting system for these criteria, shifting the responsibility for methodological clarity onto the author and facilitating a more precise understanding for readers. Our recommendations aim to enhance the integrity of SEM applications in research by elevating reporting standards.

25 citations

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.1111/isj.12598

Or copy a formatted citation

@article{james2025,
  title        = {{Essential Validation Criteria for Rigorous Covariance‐Based Structural Equation Modelling}},
  author       = {James Gaskin et al.},
  journal      = {Information Systems Journal},
  year         = {2025},
  doi          = {https://doi.org/https://doi.org/10.1111/isj.12598},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Essential Validation Criteria for Rigorous Covariance‐Based Structural Equation Modelling

Flags are reviewed by the Arbiter methodology team within 5 business days.


Evidence weight

0.67

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.74 × 0.4 = 0.30
M · momentum1.00 × 0.15 = 0.15
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.