arbiter
JournalsPricingAccount

Weighting in-text citation location and context meanings for proposing citation quality score metric

Yaniasih Yaniasih & Indra Budi

Performance Measurement and Metrics2025https://doi.org/10.1108/pmm-04-2024-0025article
ABDC C
Weight
0.41

What the paper says

Purpose The assessment of citation value necessitates considering the number of citations and the specific characteristics of in-text citations. This article establishes the significance of location and contextual meaning attributes in determining the citation value. It also aims to create a framework for assessing the quality score metric of citations. Design/methodology/approach The ground truth weights are created using expert opinion through the best-worst method (BWM). Automatic weighting is required for future metric development. Therefore, ground truth weights are compared to five objective multi-criteria decision-making (MCDM) methods: (1) standard deviation, (2) Gini coefficient, (3) entropy, (4) criteria importance through inter-criteria correlation (CRITIC) and (5) method based on criteria removal effects (MEREC). The selected weights are then utilized to create the metric framework. Findings The highest ground truth weight for the citation attributes is in the method section location (0.2176), positive sentiment (0.4455), role source from the method (0.3537) and function as a comparison (0.2554). The objective method closest to the ground truth is MEREC. Three types of citation quality score (CQS) metrics are developed to assess the significance of citation in a single appearance in a text, within a citing document and across all available data. Notably, a significant correlation exists between proposed metrics and expert judgment. Originality/value This article presents a novel citation metric that prioritizes quality factors over traditional metrics, focusing solely on numbers. Comparing various MCDM approaches is a novel approach to scientific measurement research.

2 citations

Open paper page →

Cite this paper

https://doi.org/https://doi.org/10.1108/pmm-04-2024-0025

Or copy a formatted citation

@article{yaniasih2025,
  title        = {{Weighting in-text citation location and context meanings for proposing citation quality score metric}},
  author       = {Yaniasih Yaniasih & Indra Budi},
  journal      = {Performance Measurement and Metrics},
  year         = {2025},
  doi          = {https://doi.org/https://doi.org/10.1108/pmm-04-2024-0025},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Weighting in-text citation location and context meanings for proposing citation quality score metric

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.41

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.25 × 0.4 = 0.10
M · momentum0.55 × 0.15 = 0.08
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.