The citation trap: Papers published at year-end receive systematically fewer citations

Chao MA, Yiwei LI, Feng GUO, Kao SI

Research output: Journal PublicationsJournal Article (refereed)

Abstract

The present research reveals that academic papers published at year-end on average receive systematically fewer citations than papers published at other times in the year. Using more than 200,000 papers in economics published between 1956 and 2010, the results of our analysis show that papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year. We refer to this phenomenon as the citation trap as there is no evidence that papers published at different times in the year differ in their academic quality. We propose that the current effect could arise because of the time window options in most online academic search engines: the specific setting of those options leads papers published at year-end to appear in the engines’ search results for a systematically shorter period of time as compared to papers published at other months in the year. Our analysis reveals evidence that is consistent with the proposed mechanism and that rules out several alternative explanations. Implications of the current research for academia and possible solutions to mitigate the citation trap are discussed.
Original languageEnglish
Pages (from-to)667-687
Number of pages21
JournalJournal of Economic Behavior and Organization
Volume166
Early online date17 Aug 2019
DOIs
Publication statusPublished - Oct 2019

Fingerprint

Trap
Citations
Search engine
Economics
Time windows

Bibliographical note

This work was supported by the National Natural Science Foundation of China under grant no. 71603046.

This paper has benefited from discussions with Peter Aronow and Winston Lin in the course Research Design and Causal Inference at Yale University. We also would like to thank Xi Chen, Jiacheng Liu and other participants in seminar at Yale University for helpful comments. James Tierney and Rachel Koh provided excellent assistance.

Keywords

  • Citation
  • Publication timing
  • Search engine
  • Year-end

Cite this

@article{3733717c7c8c4aa3b6fa7f5181087e3a,
title = "The citation trap: Papers published at year-end receive systematically fewer citations",
abstract = "The present research reveals that academic papers published at year-end on average receive systematically fewer citations than papers published at other times in the year. Using more than 200,000 papers in economics published between 1956 and 2010, the results of our analysis show that papers published between October and December on average get as much as 18.5{\%} fewer citations than those published in the other months in the year. We refer to this phenomenon as the citation trap as there is no evidence that papers published at different times in the year differ in their academic quality. We propose that the current effect could arise because of the time window options in most online academic search engines: the specific setting of those options leads papers published at year-end to appear in the engines’ search results for a systematically shorter period of time as compared to papers published at other months in the year. Our analysis reveals evidence that is consistent with the proposed mechanism and that rules out several alternative explanations. Implications of the current research for academia and possible solutions to mitigate the citation trap are discussed.",
keywords = "Citation, Publication timing, Search engine, Year-end",
author = "Chao MA and Yiwei LI and Feng GUO and Kao SI",
note = "This work was supported by the National Natural Science Foundation of China under grant no. 71603046. This paper has benefited from discussions with Peter Aronow and Winston Lin in the course Research Design and Causal Inference at Yale University. We also would like to thank Xi Chen, Jiacheng Liu and other participants in seminar at Yale University for helpful comments. James Tierney and Rachel Koh provided excellent assistance.",
year = "2019",
month = "10",
doi = "10.1016/j.jebo.2019.08.007",
language = "English",
volume = "166",
pages = "667--687",
journal = "Journal of Economic Behavior and Organization",
issn = "0167-2681",
publisher = "Elsevier",

}

The citation trap: Papers published at year-end receive systematically fewer citations. / MA, Chao; LI, Yiwei; GUO, Feng; SI, Kao.

In: Journal of Economic Behavior and Organization, Vol. 166, 10.2019, p. 667-687.

Research output: Journal PublicationsJournal Article (refereed)

TY - JOUR

T1 - The citation trap: Papers published at year-end receive systematically fewer citations

AU - MA, Chao

AU - LI, Yiwei

AU - GUO, Feng

AU - SI, Kao

N1 - This work was supported by the National Natural Science Foundation of China under grant no. 71603046. This paper has benefited from discussions with Peter Aronow and Winston Lin in the course Research Design and Causal Inference at Yale University. We also would like to thank Xi Chen, Jiacheng Liu and other participants in seminar at Yale University for helpful comments. James Tierney and Rachel Koh provided excellent assistance.

PY - 2019/10

Y1 - 2019/10

N2 - The present research reveals that academic papers published at year-end on average receive systematically fewer citations than papers published at other times in the year. Using more than 200,000 papers in economics published between 1956 and 2010, the results of our analysis show that papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year. We refer to this phenomenon as the citation trap as there is no evidence that papers published at different times in the year differ in their academic quality. We propose that the current effect could arise because of the time window options in most online academic search engines: the specific setting of those options leads papers published at year-end to appear in the engines’ search results for a systematically shorter period of time as compared to papers published at other months in the year. Our analysis reveals evidence that is consistent with the proposed mechanism and that rules out several alternative explanations. Implications of the current research for academia and possible solutions to mitigate the citation trap are discussed.

AB - The present research reveals that academic papers published at year-end on average receive systematically fewer citations than papers published at other times in the year. Using more than 200,000 papers in economics published between 1956 and 2010, the results of our analysis show that papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year. We refer to this phenomenon as the citation trap as there is no evidence that papers published at different times in the year differ in their academic quality. We propose that the current effect could arise because of the time window options in most online academic search engines: the specific setting of those options leads papers published at year-end to appear in the engines’ search results for a systematically shorter period of time as compared to papers published at other months in the year. Our analysis reveals evidence that is consistent with the proposed mechanism and that rules out several alternative explanations. Implications of the current research for academia and possible solutions to mitigate the citation trap are discussed.

KW - Citation

KW - Publication timing

KW - Search engine

KW - Year-end

UR - http://www.scopus.com/inward/record.url?scp=85070724602&partnerID=8YFLogxK

U2 - 10.1016/j.jebo.2019.08.007

DO - 10.1016/j.jebo.2019.08.007

M3 - Journal Article (refereed)

VL - 166

SP - 667

EP - 687

JO - Journal of Economic Behavior and Organization

JF - Journal of Economic Behavior and Organization

SN - 0167-2681

ER -