Artificial social research? AI’s capabilities and risks in predicting values and attitudes

Abstract

This study explores the potential and limitations of generative artificial intelligence, with a particular focus on ChatGPT-4, in reproducing human values and attitudes based on socio-demographic profiles. By comparing real data from the European Social Survey (ESS) with AI-generated data, the study assesses the ability of AI to reflect public opinion trends. While AI-generated responses exhibit a general alignment with survey data, they show limited variability and some inconsistencies in group-level analyses. In conclusion, despite its promising aspects, the findings suggest that AI cannot replace empirical research.