2025/04/18 by Karl Svozil, Svozil, Karl
Computer Science · #FOS: Physical sciences #Quantum Physics (quant-ph) #Topic Modeling
paper · pdf · doi:10.48550/arxiv.2504.13824
openalex publication_date 2025/04/18 · openalex created_date 2025/10/19 · openalex updated_date 2026/07/28
High-dimensional embedding spaces can host many semantic directions with small mutual overlap. But small overlaps are not zero: when many directions are jointly active, their residual interference accumulates and limits what a finite readout channel can recover. We formulate this as a distinction between kinetic capacity -- what the geometry can host -- and epistemic accessibility -- what readout can recover. The two sides are summarized by N < exp(c deff ε2) for coexistence and σint ∼ √k/deff for simultaneous readout. Thus dimension acts not merely as storage capacity but as semantic concurrency bandwidth. On this geometric foundation we propose a separate hypothesis: some polysemous tokens may be organized around stable token-associated hinge directions, with sense information carried by low-dimensional subspaces in the hinge-perpendicular carrier. The capacity/accessibility distinction is the main claim; the hinge hypothesis is a stronger, separately falsifiable empirical proposal.