AI and My Values: User Perceptions of LLMs' Ability to Extract, Embody, and Explain Human Values from Casual Conversations
arXiv:2601.22440v2 Announce Type: replace-cross Abstract: Does AI understand human values? While this remains an open philosophical question, we take a pragmatic stance by introducing VAPT, the Value-Alignment Perception Toolkit, for studying how LLMs reflect people's values and how people judge those reflections. 20 participants texted a chatbot over a month, then completed a 2-hour interview with our toolkit evaluating AI's ability to extract (pull details regarding), embody (make decisions guided by), and explain (provide proof of) their values. 13 participants ultimately left our study con — Bhada Yun, Renn Su, April Yi Wang
View PDF HTML (experimental)
Abstract:Does AI understand human values? While this remains an open philosophical question, we take a pragmatic stance by introducing VAPT, the Value-Alignment Perception Toolkit, for studying how LLMs reflect people's values and how people judge those reflections. 20 participants texted a chatbot over a month, then completed a 2-hour interview with our toolkit evaluating AI's ability to extract (pull details regarding), embody (make decisions guided by), and explain (provide proof of) their values. 13 participants ultimately left our study convinced that AI can understand human values. Thus, we warn about "weaponized empathy": a design pattern that may arise in interactions with value-aware, yet welfare-misaligned conversational agents. VAPT offers a new way to evaluate value-alignment in AI systems. We also offer design implications to evaluate and responsibly build AI systems with transparency and safeguards as AI capabilities grow more inscrutable, ubiquitous, and posthuman into the future.
Comments: To appear in CHI '26
Subjects:
Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
ACM classes: H.5.2; I.2.0; I.2.1; I.2.7; K.4.1
Cite as: arXiv:2601.22440 [cs.HC]
(or arXiv:2601.22440v2 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2601.22440
arXiv-issued DOI via DataCite
Related DOI:
https://doi.org/10.1145/3772318.3790566
DOI(s) linking to related resources
Submission history
From: Bhada Yun [view email] [v1] Fri, 30 Jan 2026 01:19:54 UTC (11,189 KB) [v2] Fri, 27 Mar 2026 17:14:34 UTC (11,189 KB)
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
researchpaperarxiv
AI Regulation Insights
As Canada s trusted partner in AI advancement, Vector Institute continues to bridge cutting-edge research with practical industry applications through strategic initiatives. In response to the rapidly evolving AI regulatory landscape, [ ] The post AI Regulation Insights appeared first on Vector Institute for Artificial Intelligence .
Thought Cloning: Teaching AI to Think Like Humans for Better Decision-Making
New research from Vector Faculty Member Jeff Clune and Vector Graduate Student Shengran Hu introduces a groundbreaking approach to imitation learning that could potentially revolutionize how we train AI agents. [ ] The post Thought Cloning: Teaching AI to Think Like Humans for Better Decision-Making appeared first on Vector Institute for Artificial Intelligence .
Recommender Systems: Where Academia Meets Industry
Authors: Shaina Raza, Amirmohammad Kazemeini This blog is based on the survey paper “A Comprehensive Review of Recommender Systems.” Recommender Systems (RS) blend artificial intelligence (AI) and personalization in a [ ] The post Recommender Systems: Where Academia Meets Industry appeared first on Vector Institute for Artificial Intelligence .
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Research Papers
Quantum computers might crack today's encryption far sooner than we thought
According to a study by engineers at Caltech and the UC Department of Physics, quantum computers do not need to be nearly as powerful as previously believed to crack the most advanced cryptographic technologies. The research claims that Shor's algorithm could break RSA public-key encryption using quantum computers with just... Read Entire Article
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!