Understanding User Perception of Automated News Generation System

Changhoon Oh; Jinhan Choi; Sungwoo Lee; So Hyun Park; Daeryong Kim; Jungwoo Song; Dongwhan Kim; Joonhwan Lee; Bongwon Suh

doi:10.1145/3313831.3376811

Understanding User Perception of Automated News Generation System

Changhoon Oh, Jinhan Choi, Sungwoo Lee, So Hyun Park, Daeryong Kim, Jungwoo Song, Dongwhan Kim, Joonhwan Lee, Bongwon Suh

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

10 Citations (Scopus)

Abstract

Automated journalism refers to the generation of news articles using computer programs. Although it is widely used in practice, its user experience and interface design remain largely unexplored. To understand the user perception of an automated news system, we designed NewsRobot, a research prototype that automatically generated news on major events of the PyeongChang 2018 Winter Olympic Games in real-time. It produces six types of news by combining two kinds of content (general/individualized) and three styles (text, text+image, text+image+sound). A total of 30 users participated in using NewsRobot, completing surveys and interviews on their experience. Our findings are as follows: (1) Users preferred individualized news yet considered it less credible, (2) more presentation elements were appreciated but only if their quality was assured, and (3) NewsRobot was considered factual and accurate yet shallow in depth. Based on our findings, we discuss implications for designing automated journalism user interfaces.

Original language	English
Title of host publication	CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450367080
DOIs	https://doi.org/10.1145/3313831.3376811
Publication status	Published - 2020 Apr 21
Event	2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 - Honolulu, United States Duration: 2020 Apr 25 → 2020 Apr 30

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020
Country/Territory	United States
City	Honolulu
Period	20/4/25 → 20/4/30

Bibliographical note

Funding Information:
This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No.2017-0-00693, Broadcasting News Contents Generation based on Robot Journalism Technology).

Publisher Copyright:
© 2020 Owner/Author.

All Science Journal Classification (ASJC) codes

Computer Graphics and Computer-Aided Design
Human-Computer Interaction
Software

Access to Document

10.1145/3313831.3376811

Cite this

Oh, C., Choi, J., Lee, S., Park, S. H., Kim, D., Song, J., Kim, D., Lee, J., & Suh, B. (2020). Understanding User Perception of Automated News Generation System. In CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems Article 3376811 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3313831.3376811

@inproceedings{d12f3a3e8c834eae966ed2029d3f236a,

title = "Understanding User Perception of Automated News Generation System",

abstract = "Automated journalism refers to the generation of news articles using computer programs. Although it is widely used in practice, its user experience and interface design remain largely unexplored. To understand the user perception of an automated news system, we designed NewsRobot, a research prototype that automatically generated news on major events of the PyeongChang 2018 Winter Olympic Games in real-time. It produces six types of news by combining two kinds of content (general/individualized) and three styles (text, text+image, text+image+sound). A total of 30 users participated in using NewsRobot, completing surveys and interviews on their experience. Our findings are as follows: (1) Users preferred individualized news yet considered it less credible, (2) more presentation elements were appreciated but only if their quality was assured, and (3) NewsRobot was considered factual and accurate yet shallow in depth. Based on our findings, we discuss implications for designing automated journalism user interfaces.",

author = "Changhoon Oh and Jinhan Choi and Sungwoo Lee and Park, {So Hyun} and Daeryong Kim and Jungwoo Song and Dongwhan Kim and Joonhwan Lee and Bongwon Suh",

note = "Funding Information: This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No.2017-0-00693, Broadcasting News Contents Generation based on Robot Journalism Technology). Publisher Copyright: {\textcopyright} 2020 Owner/Author.; 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 ; Conference date: 25-04-2020 Through 30-04-2020",

year = "2020",

month = apr,

day = "21",

doi = "10.1145/3313831.3376811",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems",

}

Oh, C, Choi, J, Lee, S, Park, SH, Kim, D, Song, J, Kim, D, Lee, J & Suh, B 2020, Understanding User Perception of Automated News Generation System. in CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems., 3376811, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020, Honolulu, United States, 20/4/25. https://doi.org/10.1145/3313831.3376811

Understanding User Perception of Automated News Generation System. / Oh, Changhoon; Choi, Jinhan; Lee, Sungwoo et al.
CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2020. 3376811 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Understanding User Perception of Automated News Generation System

AU - Oh, Changhoon

AU - Choi, Jinhan

AU - Lee, Sungwoo

AU - Park, So Hyun

AU - Kim, Daeryong

AU - Song, Jungwoo

AU - Kim, Dongwhan

AU - Lee, Joonhwan

AU - Suh, Bongwon

N1 - Funding Information: This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No.2017-0-00693, Broadcasting News Contents Generation based on Robot Journalism Technology). Publisher Copyright: © 2020 Owner/Author.

PY - 2020/4/21

Y1 - 2020/4/21

N2 - Automated journalism refers to the generation of news articles using computer programs. Although it is widely used in practice, its user experience and interface design remain largely unexplored. To understand the user perception of an automated news system, we designed NewsRobot, a research prototype that automatically generated news on major events of the PyeongChang 2018 Winter Olympic Games in real-time. It produces six types of news by combining two kinds of content (general/individualized) and three styles (text, text+image, text+image+sound). A total of 30 users participated in using NewsRobot, completing surveys and interviews on their experience. Our findings are as follows: (1) Users preferred individualized news yet considered it less credible, (2) more presentation elements were appreciated but only if their quality was assured, and (3) NewsRobot was considered factual and accurate yet shallow in depth. Based on our findings, we discuss implications for designing automated journalism user interfaces.

AB - Automated journalism refers to the generation of news articles using computer programs. Although it is widely used in practice, its user experience and interface design remain largely unexplored. To understand the user perception of an automated news system, we designed NewsRobot, a research prototype that automatically generated news on major events of the PyeongChang 2018 Winter Olympic Games in real-time. It produces six types of news by combining two kinds of content (general/individualized) and three styles (text, text+image, text+image+sound). A total of 30 users participated in using NewsRobot, completing surveys and interviews on their experience. Our findings are as follows: (1) Users preferred individualized news yet considered it less credible, (2) more presentation elements were appreciated but only if their quality was assured, and (3) NewsRobot was considered factual and accurate yet shallow in depth. Based on our findings, we discuss implications for designing automated journalism user interfaces.

UR - http://www.scopus.com/inward/record.url?scp=85091318826&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85091318826&partnerID=8YFLogxK

U2 - 10.1145/3313831.3376811

DO - 10.1145/3313831.3376811

M3 - Conference contribution

AN - SCOPUS:85091318826

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

T2 - 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020

Y2 - 25 April 2020 through 30 April 2020

ER -

Understanding User Perception of Automated News Generation System

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this