ChatGPT: More Human-Like Than Computer-Like, but Not Necessarily in a Good Way

Large language models have been shown to be useful in multiple domains including conversational agents, education, and explainable AI. ChatGPT is a large language model developed by OpenAI as a conversational agent. ChatGPT was trained on data generated by humans and by receiving human feedback. This training process results in a bias toward humans’ traits and preferences. In this paper, we stress multiple biases of ChatGPT, and show that its responses demonstrate many human traits. We begin by showing a very high correlation between the frequency of digits generated by ChatGPT and humans’ favorite numbers, with the most frequent digit generated by ChatGPT, matching humans’ most favorable number, 7. We continue by showing that ChatGPT’s responses in several social experiments are much closer to those of humans’ than to those of fully rational agents. Finally, we show that several cognitive biases, known in humans, are also present in ChatGPT’s responses.