TY - JOUR
T1 - From helping hand to stumbling block
T2 - the ChatGPT paradox in competency experiment
AU - Kim, Duk Gyoo
AU - Moon, Ahram
N1 - Publisher Copyright:
© 2024 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2024
Y1 - 2024
N2 - We ran a controlled laboratory experiment to examine whether ChatGPT’s aid can increase the participants’ performance in three different–reading and writing, mathematical problem-solving, and computational thinking–tasks. We find that the maths score significantly decreases with ChatGPT’s assistance. This result is mainly because the low-ability subjects couldn’t discern the hallucinated answers with the correct ones, and it contests the general idea that ChatGPT can complement the workers with less expertise.
AB - We ran a controlled laboratory experiment to examine whether ChatGPT’s aid can increase the participants’ performance in three different–reading and writing, mathematical problem-solving, and computational thinking–tasks. We find that the maths score significantly decreases with ChatGPT’s assistance. This result is mainly because the low-ability subjects couldn’t discern the hallucinated answers with the correct ones, and it contests the general idea that ChatGPT can complement the workers with less expertise.
KW - ChatGPT
KW - Laboratory experiment
KW - competencies
KW - labor productivity
UR - http://www.scopus.com/inward/record.url?scp=85189835384&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85189835384&partnerID=8YFLogxK
U2 - 10.1080/13504851.2024.2337330
DO - 10.1080/13504851.2024.2337330
M3 - Article
AN - SCOPUS:85189835384
SN - 1350-4851
JO - Applied Economics Letters
JF - Applied Economics Letters
ER -