From Synthetic to Human: The Gap Between AI-Predicted and Actual Pro-Environmental Behavior Change After Chatbot Persuasion
Name
3719160.3736610.pdf
Size
2.11 MB
Format
Adobe PDF
Checksum (MD5)
a4dd616b34f572c848247b941fa5d68a
Author(s)
Doudkin, Alexander
Pataranutaporn, Pat
Maes, Pattie
Date Issued
July 7, 2025
Publisher
ACM|Proceedings of the 7th ACM Conference on Conversational User Interfaces
Citation
Alexander Doudkin, Pat Pataranutaporn, and Pattie Maes. 2025. From Synthetic to Human: The Gap Between AI-Predicted and Actual Pro-Environmental Behavior Change After Chatbot Persuasion. In Proceedings of the 7th ACM Conference on Conversational User Interfaces (CUI '25). Association for Computing Machinery, New York, NY, USA, Article 71, 1–18.
Version
Final published version
Abstract
Pro-environmental behavior (PEB) is vital to combat climate change, yet turning awareness into intention and action remains elusive. We explore large language models (LLMs) as tools to promote PEB, comparing their impact across 3,600 participants: real humans (n=1,200), simulated humans based on actual participant data (n=1,200), and fully synthetic personas (n=1,200). All three participant groups faced either personalized chatbots, standard chatbots, or static statements, employing four persuasion strategies (moral foundations, future self-continuity, action orientation, or ”freestyle” chosen by the LLM). Results reveal a ”synthetic persuasion paradox”: synthetic and simulated participants significantly change their post-intervention PEB stance, while human attitudes barely shift. Simulated participants better approximate human behavior but still overestimate effects. This disconnect underscores LLM’s potential for pre-evaluating PEB interventions but warns of its limits in predicting human responses. We call for refined synthetic modeling and sustained and extended human trials to align conversational AI’s promise with tangible sustainability outcomes.
Description
CUI ’25, Waterloo, ON, Canada
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3719160.3736610
