Gabriel's Horn
The fixed horn added no parameters and improved 5.5M TinyStories perplexity slightly. Gabriel's horn is injected by replacing the cross-phase mean with the fixed profile r(t)=1/(t+1). Horn injection moves only the DC component and leaves o…
1 sources - 4 claims
The fixed horn added no parameters and improved 5.5M TinyStories perplexity slightly. Gabriel's horn is injected by replacing the cross-phase mean with the fixed profile r(t)=1/(t+1). Horn injection moves only the DC component and leaves orthogonal phase content unchanged. Gabriel's horn is interpreted as an absolute-position signal that complements RoPE's relative-position structure.