Volatility Coupling
Value coupling alone makes precision accumulate passively rather than respond to surprising observations. Volatility coupling lets a parent node modulate a child's log-variance or step size. Volatility coupling enables precision updates to…
1 sources - 4 claims
Value coupling alone makes precision accumulate passively rather than respond to surprising observations. Volatility coupling lets a parent node modulate a child's log-variance or step size. Volatility coupling enables precision updates to depend explicitly on squared prediction errors. Volatility coupling stabilises prediction-error magnitudes but can destabilise weight-update dynamics.