Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Delivery
Journal:
arXiv
Published Date:
Apr 1, 2025
Abstract
LLMs increasingly serve as tools for knowledge acquisition, yet users cannot
effectively specify how they want information presented. When users request
that LLMs "cite reputable sources," "express appropriate uncertainty," or
"include multiple perspectives," they discover that current interfaces provide
no structured way to articulate these preferences. The result is prompt sharing
folklore: community-specific copied prompts passed through trust relationships
rather than based on measured efficacy. We propose the Epistemic Alignment
Framework, a set of ten challenges in knowledge transmission derived from the
philosophical literature of epistemology, concerning issues such as evidence
quality assessment and calibration of testimonial reliance. The framework
serves as a structured intermediary between user needs and system capabilities,
creating a common vocabulary to bridge the gap between what users want and what
systems deliver. Through a thematic analysis of custom prompts and
personalization strategies shared on online communities where these issues are
actively discussed, we find users develop elaborate workarounds to address each
of the challenges. We then apply our framework to two prominent model
providers, OpenAI and Anthropic, through content analysis of their documented
policies and product features. Our analysis shows that while these providers
have partially addressed the challenges we identified, they fail to establish
adequate mechanisms for specifying epistemic preferences, lack transparency
about how preferences are implemented, and offer no verification tools to
confirm whether preferences were followed. For AI developers, the Epistemic
Alignment Framework offers concrete guidance for supporting diverse approaches
to knowledge; for users, it works toward information delivery that aligns with
their specific needs rather than defaulting to one-size-fits-all approaches.