PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 27, 20260 citationsOpen Access

Internal Noise as an Anti-Collapse Resource: Preliminary Evidence for a Safe Edge Band in a Transformer-Based Dynamical System

View Full Paper
JSJun Sakai

Key Points

  • The research aims to explore whether controlled internal noise can prevent representational collapse in dynamical systems.
  • Utilized a Fitzhugh-Nagumo driven transformer to analyze internal Gaussian noise across multiple frameworks.
  • Conducted assessments with hidden geometry metrics and phase energy metrics.
  • Identified noise thresholds correlated with performance metrics.
  • Found a safe edge band of internal noise at σ = 0.10–0.20 where effective rank is elevated and collapse index is reduced.
  • Observed that below this band (σ ≈ 0.00), the system is fully collapse-dominated.
  • Noted a rapid increase in chaos-state proportion above σ = 0.30, while geometric benefits plateau.

Abstract

Internal noise in neural systems is typically treated as a source of performancedegradation. We investigate whether controlled internal micro-variability can insteadprevent representational collapse in a transformer-based dynamical system.Using a Fitzhugh-Nagumo (FHN)-driven transformer as a testbed, we conduct asystematic sweep of internal Gaussian noise σ across three complementary measurementframeworks: (A-1/A-2) hidden geometry metrics (effective rank, collapseindex), (A-3) upper-bound sweep with MSE acceleration analysis, and (B) phaseenergymetrics (Δθ, R(t), phase-state classification).Across all frameworks, we identify a consistent safe edge band at σ = 0.10–0.20 (peak σ ≈ 0.15) in which effective rank is elevated, collapse index is reduced,edge-state proportion is maximized, and prediction error remains bounded. Belowthis band (σ ≈ 0.00), the system is fully collapse-dominated; above it (σ > 0.30),chaos-state proportion increases rapidly while geometric benefit saturates.These findings provide preliminary evidence that internal noise can function asan anti-collapse resource within a measurable band, consistent with the Layer-9Natural Fuzzy Immunity hypothesis in Safe Attractor Architecture (SAA). We donot claim direct proof of edge-of-chaos dynamics; the results are characterized aspreliminary evidence for a safe-edge-like regime.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Jun Sakai (2026) studied this question.

synapsesocial.com/papers/69eefdd1fede9185760d48edhttps://doi.org/10.5281/zenodo.19758659
Ask AI
Helpful
Bookmark
Share
View Full Paper