Identifying and quantifying coordinated manipulation of upvotes and downvotes in naver news comments

Today, many news sites let users write comments on news articles, rate others' comments by upvoting and downvoting, and order the comments by the rating. Top-rated comments are placed right below the news article and read widely, reaching a large audience and wielding great influence. As their importance grew, upvotes and downvotes are increasingly manipulated by coordinated efforts to hide existing top comments and push certain comments to the top. In this paper, we analyze comment sections of articles targeted by coordinated efforts and identify a trace of vote manipulation. Based on the findings, we propose a parameterized classifier that distinguishes comment threads affected by coordinated voting. The classifier only uses the number of upvotes and downvotes of comments. Therefore it is widely applicable to general vote-based curation systems where contents are sorted by the difference of upvotes and downvotes. Using the classifier and our choice of parameters, we have examined six years of the entire commenting history on a leading news portal in South Korea. Manual inspection in partisan online communities could only identify a few hundreds of targeted articles. With our classifier, we have identified more than ten thousand comment threads with a high likelihood of manipulation. We also observe a significant increase in coordinated manipulation in recent years.