PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 9, 20250 citationsOpen Access

Intuition emerges in Maximum Caliber models at criticality

View Full Paper
LALluís Arola-Fernández

Key Points

  • Intuition emerges as a metastable phase of learning, balancing prediction and entropy.
  • The study identifies distinct phases: imitation, rule-breaking hallucination, and a fragile in-between state.
  • Training with random walks in deterministic mazes unveils a complex phase diagram showcasing hysteresis.
  • Effective low-dimensional theory captures intuition as an emergent property at critical balancing points.

Abstract

Whether large predictive models merely parrot their training data or produce genuine insight lacks a physical explanation. This work reports a primitive form of intuition that emerges as a metastable phase of learning that critically balances next-token prediction against future path-entropy. The intuition mechanism is discovered via mind-tuning, the minimal principle that imposes Maximum Caliber in predictive models with a control temperature-like parameter λ. Training on random walks in deterministic mazes reveals a rich phase diagram: imitation (low λ), rule-breaking hallucination (high λ), and a fragile in-between window exhibiting strong protocol-dependence (hysteresis) and multistability, where models spontaneously discover novel goal-directed strategies. These results are captured by an effective low-dimensional theory and frame intuition as an emergent property at the critical balance between memorizing what is and wondering what could be.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Lluís Arola-Fernández (2025) studied this question.

synapsesocial.com/papers/68e80eb363e2e2f707877c18https://doi.org/10.48550/arxiv.2508.06477
Ask AI
Helpful
Bookmark
Share
View Full Paper