TY - GEN
T1 - The citations of papers with conflicting reviews and confident reviewers
AU - He, Jiangen
AU - Chen, Chaomei
PY - 2019/1/1
Y1 - 2019/1/1
N2 - Disagreement is essential for knowledge growth in science. However, disagreement in peer review is usually regarded as a sign of unreliability in existing studies. The predictive role of disagreement for potentially impact ful discoveries was rarely explored. Reviewer expertise has been proved to have effects on review strictness and outcomes, but reviewers' added-value on paper quality remains unclear. In this paper, we examined the predictive effects of disagreement and confidence of reviewers on citations of reviewed papers. Using a dataset of 489 papers submitted ICRL 2017, we found that predictive effects of disagreement and confidence on citations. Among accepted papers, the papers with higher review ratings tend to receive more citations and the disagreement cannot predict citations. However, among rejected papers with more than ten citations, the ratings they received cannot predict their citations, but the disagreement level of their reviewers does. Similar opposite findings were also seen regarding confidence. Accepted papers reviewed by confident reviewer tend to have more citations but rejected papers might not benefit from confident reviewers.
AB - Disagreement is essential for knowledge growth in science. However, disagreement in peer review is usually regarded as a sign of unreliability in existing studies. The predictive role of disagreement for potentially impact ful discoveries was rarely explored. Reviewer expertise has been proved to have effects on review strictness and outcomes, but reviewers' added-value on paper quality remains unclear. In this paper, we examined the predictive effects of disagreement and confidence of reviewers on citations of reviewed papers. Using a dataset of 489 papers submitted ICRL 2017, we found that predictive effects of disagreement and confidence on citations. Among accepted papers, the papers with higher review ratings tend to receive more citations and the disagreement cannot predict citations. However, among rejected papers with more than ten citations, the ratings they received cannot predict their citations, but the disagreement level of their reviewers does. Similar opposite findings were also seen regarding confidence. Accepted papers reviewed by confident reviewer tend to have more citations but rejected papers might not benefit from confident reviewers.
UR - http://www.scopus.com/inward/record.url?scp=85073877844&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85073877844&partnerID=8YFLogxK
M3 - Conference contribution
T3 - 17th International Conference on Scientometrics and Informetrics, ISSI 2019 - Proceedings
SP - 2411
EP - 2417
BT - 17th International Conference on Scientometrics and Informetrics, ISSI 2019 - Proceedings
A2 - Catalano, Giuseppe
A2 - Daraio, Cinzia
A2 - Gregori, Martina
A2 - Moed, Henk F.
A2 - Ruocco, Giancarlo
PB - International Society for Scientometrics and Informetrics
T2 - 17th International Conference on Scientometrics and Informetrics, ISSI 2019
Y2 - 2 September 2019 through 5 September 2019
ER -