
handle: 1959.4/103732
Drawing on construal level theory, recent studies have demonstrated that ChatGPT interprets text inputs from an abstract perspective. However, as ChatGPT has evolved into a multimodal tool, this research examines whether ChatGPT's abstraction bias extends to image-based prompts. In a pre-registered study utilising hierarchical letters, ChatGPT predominantly associated these images with local rather than global letters, suggesting a concrete bias when analysing images. This starkly contrasts human participants who predominantly identified the same images with the global letters, indicating that humans and ChatGPT significantly diverge in image interpretations. Furthermore, while humans generally perceive ChatGPT to be more concrete in image processing, there is a notable discrepancy between this perception and the actual level of concreteness exhibited by ChatGPT in handling image-based tasks. These findings provide insights into the distinct cognitive behaviours of LLMs compared to humans, contributing to an emerging understanding of LLM cognition in the context of multimodal inputs.
5202 Biological Psychology, Social Sciences, QA75.5-76.95, anzsrc-for: 52 Psychology, H, ChatGPT, Economics as a science, Clinical Research, 52 Psychology, Electronic computers. Computer science, anzsrc-for: 5202 Biological Psychology, AI cognition, Construal level theory, HB71-74
5202 Biological Psychology, Social Sciences, QA75.5-76.95, anzsrc-for: 52 Psychology, H, ChatGPT, Economics as a science, Clinical Research, 52 Psychology, Electronic computers. Computer science, anzsrc-for: 5202 Biological Psychology, AI cognition, Construal level theory, HB71-74
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 1 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
