Current Token Position (t)
Position:
100
Number of Layers (L)
Layers:
10
Window Size (W)
Window:
10
Residual Strength (α)
α:
0.95
Attention weight:
5
%
Display Range
Range:
100
tokens back
Y-axis Scale
Linear
Logarithmic
Effective Horizon (1% threshold)
-
Decay Rate (λ)
-
Min Hops to Horizon
-