Skip to main navigation Skip to search Skip to main content

Does word knowledge account for the effect of world knowledge on pronoun interpretation?

  • University of California at San Diego

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

To what extent can statistical language knowledge account for the effects of world knowledge in language comprehension? We address this question by focusing on a core aspect of language understanding: pronoun resolution. While existing studies suggest that comprehenders use world knowledge to resolve pronouns, the distributional hypothesis and its operationalization in large language models (LLMs) provide an alternative account of how purely linguistic information could drive apparent world knowledge effects. We addressed these confounds in two experiments. In Experiment 1, we found a strong effect of world knowledge plausibility (measured using a norming study) on responses to comprehension questions that probed pronoun interpretation. In experiment 2, participants were slower to read continuations that contradicted world knowledge-consistent interpretations of a pronoun, implying that comprehenders deploy world knowledge spontaneously. Both effects persisted when controlling for the predictions of GPT-3, an LLM, suggesting that pronoun interpretation is at least partly driven by knowledge about the world and not the word. We propose two potential mechanisms by which knowledge-driven pronoun resolution occurs, based on validation- and expectation-driven discourse processes. The results suggest that while distributional information may capture some aspects of world knowledge, human comprehenders likely draw on other sources unavailable to LLMs.

Original languageEnglish
Pages (from-to)1182-1213
Number of pages32
JournalLanguage and Cognition
Volume16
Issue number4
DOIs
StatePublished - Dec 1 2024

Keywords

  • distributional baseline
  • distributional hypothesis
  • large language models
  • pronoun resolution
  • world knowledge

Fingerprint

Dive into the research topics of 'Does word knowledge account for the effect of world knowledge on pronoun interpretation?'. Together they form a unique fingerprint.

Cite this