Understanding Human–AI Workflows for Generating Personas
Loading...
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2024-07-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
25
Series
Proceedings of the 2024 ACM Designing Interactive Systems Conference, DIS 2024
Abstract
One barrier to deeper adoption of user-research methods is the amount of labor required to create high-quality representations of collected data. Trained user researchers need to analyze datasets and produce informative summaries pertaining to the original data. While Large Language Models (LLMs) could assist in generating summaries, they are known to hallucinate and produce biased responses. In this paper, we study human–AI workfows that diferently delegate subtasks in user research between human experts and LLMs. Studying persona generation as our case, we found that LLMs are not good at capturing key characteristics of user data on their own. Better results are achieved when we leverage human skill in grouping user data by their key characteristics and exploit LLMs for summarizing pre-grouped data into personas. Personas generated via this collaborative approach can be more representative and empathy-evoking than ones generated by human experts or LLMs alone. We also found that LLMs could mimic generated personas and enable interaction with personas, thereby helping user researchers empathize with them. We conclude that LLMs, by facilitating the analysis of user data, may promote widespread application of qualitative methods in user research.Description
Publisher Copyright: © 2024 Copyright held by the owner/author(s).
Keywords
LLM, persona generation, User research
Other note
Citation
Shin, J, Hedderich, M A, Rey, B, Lucero, A & Oulasvirta, A 2024, Understanding Human–AI Workflows for Generating Personas . in A Vallgarda, L Jonsson, J Fritsch, S F Alaoui & C A Le Dantec (eds), Proceedings of the 2024 ACM Designing Interactive Systems Conference, DIS 2024 . Proceedings of the 2024 ACM Designing Interactive Systems Conference, DIS 2024, ACM, pp. 757-781, ACM Conference on Designing Interactive Systems, Copenhagen, Denmark, 01/07/2024 . https://doi.org/10.1145/3643834.3660729