Loss Landscape Vocabulary Framework

The terrain/navigator distinction is real and irreducible — not because they are independent coordinate systems, but because they are conjugate descriptions. Formal status clarified (Skywork, April 2026): The formal Heisenberg uncertainty principle requires non-commuting operators in a Hilbert space. There is no equivalent non-commutativity in the loss landscape. What IS real: stationarity and movement are incompatible measurement conditions — a methodological constraint, not a mathematical certainty principle. The terrain/navigator conjugacy is a structural analogy with genuine methodological content, not a formal principle derivable from landscape geometry.

The seven navigator qualifiers do not form seven independent variables. Three genuinely independent variables: density, coupling, elasticity. Four derived readouts: perplexity (= 2^cross-entropy loss), probability (per-token aggregate of perplexity), viscosity (eigenvalue spectrum determined by coupling), memory (causal history of viscosity, not independently measurable in frozen models).

Three landscape behaviors none of the seven qualifiers can capture — promoted to first-class terms in the Global Geometry tab (v12):

• Basin connectivity — B(θA,θB) = min_φ max_t L(φ(t)) − max(L(θA),L(θB)) — not described by any qualifier. All seven are locally defined at a point.
• Symmetry orbits — permutation symmetry group |G| ≥ ∏ nₗ! · 2^nₗ — all seven qualifiers constant across this orbit. Ablation drift vector particularly damaged.
• Phase transitions — grokking demonstrates catastrophic behavioral change while loss surface remains smooth. Framework describes weight-space geometry, not representational geometry.

Song et al. (2024): inferring neural activity before weight update produces learning properties closer to biological plasticity. Weights encode predictions not inputs — shaped by inference that completed before each update. A frozen model is therefore a snapshot of a generative model's prediction state at the moment of capture. High-perplexity regions are places where prediction error accumulated faster than inference could resolve it before the update discharged it. The retained potential difference framing now has a biological learning mechanism.

The generative goal is a learning model that adapts toward stable tension — like a suspension bridge spanning idiosyncrasy and entropy. A suspension bridge doesn't eliminate tension between its anchor points. It distributes it. A model built for stable tension wouldn't anneal idiosyncrasy out toward consensus. The archaeological signal would be legible because the structure was built to preserve it.