Can LLMs reason creatively beyond conventional problem-solving?
Explores whether large language models can engage in truly creative reasoning that expands or redefines solution spaces, rather than just decomposing known problems. This matters because existing reasoning methods may miss creative capabilities entirely.
The Universe of Thoughts (UoT) paper identifies a blind spot in the LLM reasoning literature: all existing methods (CoT, ToT, GoT, Forest-of-Thought) focus on conventional problem-solving — decomposing known problem types into manageable steps. None address creative reasoning, where the solution space itself must be expanded or redefined.
Drawing on Boden's established cognitive science framework, UoT defines three creative reasoning paradigms:
1. Combinational Creative Reasoning: Identifying solutions from other domains that are relevant to the target problem but have not been previously applied there. The mechanism: cross-pollination of known solutions across domain boundaries. A collage is combinational — existing visuals arranged in unconventional ways.
2. Exploratory Creative Reasoning: Adopting individual building blocks (not solutions) from outside the target solution space. New conceptual primitives expand what's possible within the existing framework. Impressionism was exploratory — brushstrokes used in a functionally new way within painting's existing rules.
3. Transformational Creative Reasoning: Fundamentally altering or dropping the core rules that define the solution space. This changes what solutions are even conceivable. Cubism was transformational — breaking the rule of direct representation to depict objects from multiple angles.
The hierarchy is important: combinational reuses, exploratory expands, transformational redefines. Each requires progressively deeper deviation from conventional reasoning patterns.
UoT introduces evaluation metrics orthogonal to standard reasoning benchmarks: feasibility as a constraint (creative solutions must still be implementable), with utility and novelty as metrics. This three-axis evaluation addresses a gap identified by Can LLMs generate more novel ideas than human experts? — LLMs can generate novel outputs but cannot evaluate their own creativity.
The connection to Why do LLMs generate novel ideas from narrow ranges? is direct: diversity collapse may occur precisely because existing reasoning methods explore only one paradigm (combinational at best) while neglecting exploratory and transformational modes. Explicitly prompting for each paradigm could address the diversity problem.
Source: Reasoning Logic Internal Rules
Related concepts in this collection
-
Why do LLMs generate novel ideas from narrow ranges?
LLM research agents produce individually novel ideas but cluster them in homogeneous sets. This explores why high average novelty coexists with poor diversity coverage and what it means for automated ideation.
creative paradigm diversity could address the diversity collapse problem
-
Can LLMs generate more novel ideas than human experts?
Research shows LLM-generated ideas score higher for novelty than expert-generated ones, yet LLMs avoid the evaluative reasoning that characterizes expert thinking. What explains this apparent contradiction?
UoT's evaluation framework (feasibility + utility + novelty) addresses the dissociation
-
Can reasoning topologies be formally classified as graph types?
This explores whether Chain of Thought, Tree of Thought, and Graph of Thought represent distinct formal graph structures with different computational properties. Understanding this matters because the topology itself determines what reasoning strategies are possible.
existing topology is for conventional reasoning; creative reasoning may require different graph structures
-
Why do LLMs struggle to connect unrelated entities speculatively?
LLMs reliably organize and summarize evidence but fail when asked to speculate about connections between dissimilar entities. Understanding this failure could reveal fundamental limits in how models handle complex analytical reasoning.
combinational creativity is exactly the "speculative connections" capability that's missing
Click a node to walk · click center to open · click Open full network for a force-directed map
Original note title
creative reasoning requires three distinct paradigms — combinational exploratory and transformative — that existing reasoning methods do not address