Ke, L., Tong, S., Cheng, P., & Peng, K. (2025).
Artificial Intelligence Review, 58(10).
Abstract
This review explores the frontiers of large language models (LLMs) in psychological applications. Psychology has undergone several theoretical changes, and the current use of artificial intelligence (AI) and machine learning, particularly LLMs, promises to open up new research directions. We aim to provide a detailed exploration of how LLMs are transforming psychological research. We discuss the impact of LLMs across various branches of psychology—including cognitive and behavioral, clinical and counseling, educational and developmental, and social and cultural psychology—highlighting their ability to model patterns, cognition, and behavior similar to those observed in humans. Furthermore, we explore the ability of such models to generate coherent, contextually relevant text, offering innovative tools for literature reviews, hypothesis generation, experimental designs, experimental subjects, and data analysis in psychology. We emphasize the importance of addressing technical and ethical challenges, including data privacy, the ethics of using LLMs in psychological research, and the need for a deeper understanding of these models’ limitations. Researchers should use LLMs responsibly in psychological studies, adhering to ethical standards and considering the potential consequences of deploying these technologies in sensitive areas. Overall, this review provides a comprehensive overview of the current state of LLMs in psychology, exploring the potential benefits and challenges. We hope it can serve as a call to action for researchers to responsibly leverage LLMs’ advantages while addressing the associated risks.
Here is a great quote from the article: “LLM output should not be mistaken for the presence of thought but instead viewed as complex pattern matching based on probabilistic modeling.”
Here are some thoughts:
This review provides a timely and comprehensive framework for understanding how LLMs are transforming psychological research, organized around Newell's hierarchical timescales of human behavior. The authors strike an excellent balance between enthusiasm for LLMs' emergent abilities, such as analogical reasoning and emotion recognition, and a critical awareness of their fundamental limitations, including the lack of genuine understanding, persistent biases toward WEIRD populations, and risks in clinical applications like suicide risk assessment. The paper is particularly strong in its systematic presentation of empirical findings across cognitive, clinical, educational, and social psychology, supported by clear tables that make specific applications and results easily accessible to researchers.
While the review covers LLMs as both research tools and simulated subjects, it could further explore the epistemological risks of circular validation where LLMs are used to study behaviors they merely replicate from training data. Additionally, greater attention to open source models and the inherent constraints of transformer architectures for real time or developmental processes would strengthen future work. Overall, this article serves as an essential resource for psychologists seeking to responsibly integrate LLMs into their research, offering both practical guidance and ethical guardrails without succumbing to technological hype.
