Human-AI Collaboration

Analyzing the Presentation, Content, and Utilization of References in LLM-powered Conversational AI Systems

Jianheng Ouyang, Arpit Narechania

ACM CHI (LBW) · 2026

Teaser for Analyzing the Presentation, Content, and Utilization of References in LLM-powered Conversational AI Systems

Abstract

As conversational AI systems become popular for information retrieval and question-answering, the references they cite are key to ensuring their answers are reliable and trustworthy. We examine 1,517 references from 30 question–answer pairs across nine systems, focusing on their presentation in the user interface and quality using the CRAAP criteria.

Citation

@inproceedings{ouyang2026references,
  author = {Ouyang, Jianheng and Narechania, Arpit},
  title = {{Analyzing the Presentation, Content, and Utilization of References in LLM-powered Conversational AI Systems}},
  booktitle = {Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems},
  year = {2026},
  publisher = {ACM},
  pages = {1--8},
  doi = {10.1145/3772363.3798415}
}