2023
Evaluating the Accuracy of scite, a Smart Citation Index
Abstract: Objectives: Citations do not always equate endorsement, therefore it is important to understand the context of a citation. Researchers may heavily rely on a paper they cite, they may refute it entirely, or they may mention it only in passing, so an accurate classification of a citation is valuable for researchers and users. While AI solutions have emerged to provide a more nuanced meaning, the accuracy of these tools has yet to be determined. This project seeks to assess the accuracy of scite in assessing the …
Search citation statements
Paper Sections
Select...
8
1
0
0
Citation Types
0
4
0
0
Year Published
2023
2025
Publication Types
Select...
7
2
Relationship
1
8
Authors
Journals
Cited by 9 publications
(4 citation statements)
References 21 publications
0
4
0
0
“…39 Automated checkers help inconsistently, and AI-text detectors are unreliable and biased against non-native English writing. 40 41 The practical rule is simple: generate prose if useful, but collect citations from authoritative databases and verify every reference.…”
Section: Resultsmentioning
confidence: 99%
“…39 Automated checkers help inconsistently, and AI-text detectors are unreliable and biased against non-native English writing. 40 41 The practical rule is simple: generate prose if useful, but collect citations from authoritative databases and verify every reference.…”
Section: Resultsmentioning
confidence: 99%
“…- Good publishers: articles in journals and conferences.
- Total Smart Citations: provides a granular perspective on the impact of individual references within the text, without grouping them at the citation publication level ( Nicholson et al, 2021 ; Bakker, Theis-Mahon & Brown, 2023 ). By using Total Smart Citations, we aim to ensure a comprehensive assessment of the relevance of each reference cited within the articles we considered in the review.
…”
Section: Survey Methodologymentioning
confidence: 99%
“…During the regulatory research literature review process, additional sources of information may be gleamed from within the reference lists of identified documents ( 42 ). But identifying and evaluating these citations can be time consuming and existing technology approaches have demonstrated suboptimal performance ( 38 , 43 , 44 ). GenAI tools can be developed to scan through research documents to identify and extract potentially relevant citations from a document's reference section for further review ( 43 ).…”
Section: A Role For Technological Innovationmentioning
confidence: 99%
“…But identifying and evaluating these citations can be time consuming and existing technology approaches have demonstrated suboptimal performance ( 38 , 43 , 44 ). GenAI tools can be developed to scan through research documents to identify and extract potentially relevant citations from a document's reference section for further review ( 43 ). Furthermore, the summarization capabilities of GenAI can reduce the burden of the screening process.…”
Section: A Role For Technological Innovationmentioning
confidence: 99%
