SYNTHESIS NOTE
Topics›Linguistics, NLP, NLU›this note

Can language models learn meaning without engaging the world?

Explores whether LLMs prove that meaning emerges from relational structure alone, independent of embodied experience or external reference. Tests structuralist theory empirically.

Synthesis note · 2026-04-18 · sourced from Linguistics, NLP, NLU

"Computational Structuralism: Toward a Formal Theory of Meaning in the Age of Digital Intelligence" (2026) proposes a synthesis of deep learning, information theory, and French structuralism to interpret LLM success. The core argument: LLMs demonstrate that transformations over relational structure are sufficient for generating culturally and situationally specific discourse, and that such structure can be inductively derived from discourse traces alone — phenomenal or embodied engagement with the world is not a necessary condition.

The framework retraces the lineage from Saussure (language as a system of differences, meanings defined relationally) through Levi-Strauss (extending structural analysis to culture broadly, binary oppositions as compression of complexity) to Bourdieu (habitus as transposable classification schemas operating in continuous social space). LLMs trained on web text learn not just grammar but the structure of culturally situated linguistic action — which voices make which statements in response to which situations, and how audiences respond.

Key theoretical moves:

This challenges both sides of the grounding debate: it validates the structuralist intuition that relational form can carry meaning without referential content, while simultaneously showing that what LLMs learn is not "pure language" but socially and culturally situated discourse patterns. The concern from Can language models learn meaning from text patterns alone? (Bender & Koller) is not refuted but reframed — what counts as "sufficient" for meaning generation may not require what's necessary for meaning understanding.

Connects to Does semantic grounding in language models come in degrees? — computational structuralism explains why functional grounding succeeds: the relational structure of discourse is compressible and learnable. The question is whether this constitutes meaning or merely its simulation.

Inquiring lines that read this note 130

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Why do language models hallucinate and how can we prevent it? Can AI systems participate in genuine communication or only simulate it? How does tokenization reshape what we value in intelligence? Is embodied interaction necessary for language meaning and agency? Do language models reason through disagreement or only accommodate it? What distinguishes genuine communicative competence from surface language performance? Can language models reason beyond surface pattern matching? How do interpretive frames override surface features in text comprehension? Why do training associations persist despite contradictory contextual information? Can mechanistic interpretability methods reliably reveal what models actually know? Do language models encode knowledge that influences generation, or primarily imitate surface patterns? How does RLHF training shape models to prioritize agreement over accuracy? What prediction granularity best trains models to generate reliable reasoning? How susceptible are language models to conversational persuasion and belief change? Should models ask for clarification when facing ambiguous or under-specified information? How can agents discover and adapt to user preferences during conversation? How reliably can language models perform causal versus temporal reasoning? Can readers reliably distinguish AI-written text from human writing? Can LLMs distinguish between linguistic form and semantic meaning? What capabilities differentiate diffusion from autoregressive language models? What prevents language models from performing systematic logical reasoning? Can models develop genuine introspective capability, or only mimic it? How does model capacity affect learning performance on diverse downstream tasks? How do neural networks learn compositional structure from training? What limits language model accuracy in evaluating ideas? Does augmenting symbolic reasoning improve LLM logical reasoning ability? Can recurrent computation unlock reasoning capabilities that fixed-depth models cannot? How do hallucinated citations emerge in AI scholarly output?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs operationalize Saussures langue — fully relational models with no external referents suffice to generate contextually appropriate discourse