Large Language Models in Survey Research: Generating Synthetic Data and Unlocking New Possibilities

Motoki, Fabio Yoshio Suguri, Monteiro, Januario, Malagueño, Ricardo and Rodrigues, Victor (2023) Large Language Models in Survey Research: Generating Synthetic Data and Unlocking New Possibilities.

Full text not available from this repository. (Request a copy)

Abstract

This study examines the potential of large language models (LLMs) to generate synthetic survey data for organizational research. We propose a structured framework for prompting LLMs to simulate human-like responses, incorporating persona creation and impulse variables to enhance variability. Using previously validated constructs in the organizational deviance literature, we assess whether synthetic data exhibits response patterns aligned with theoretical expectations. Our findings suggest that LLMs can produce structured data that approximates real-world constructs, paving the way for more efficient pre-testing and refinement of survey instruments. While our results highlight promising potential, they also reveal key challenges, including response homogeneity, overestimated reliability, and model-specific biases. Ethical considerations, such as bias propagation and transparency, further emphasize the need for careful application. As LLMs continue to advance, their role in methodological innovation may expand, enabling researchers to explore new avenues in survey-based studies. This study represents a foundational step in integrating synthetic data into organizational research, broadening methodological possibilities while acknowledging current limitations.

Item Type:	Article
Uncontrolled Keywords:	4* ,/dk/atira/pure/researchoutput/REFrank/4_
Faculty \ School:	Faculty of Social Sciences > Norwich Business School
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Accounting & Quantitative Methods
Related URLs:	https://papers.ssrn.com/sol3/papers.cfm?...
Depositing User:	LivePure Connector
Date Deposited:	10 Nov 2023 01:36
Last Modified:	28 Mar 2025 01:01
URI:	https://ueaeprints.uea.ac.uk/id/eprint/93615
DOI:	10.2139/ssrn.4595896

Actions (login required)

View Item