Dynamic Precision Scheduling
On challenging subsets, DPS improved rho while maintaining average encoder-plus-state latency of 4.8 ms. DPS triggered INT6 computation for 12.3% of validation inputs. Removing DPS reduced rho by 0.028 to 0.089 in ablation testing. Dynamic…
1 sources - 5 claims
On challenging subsets, DPS improved rho while maintaining average encoder-plus-state latency of 4.8 ms. DPS triggered INT6 computation for 12.3% of validation inputs. Removing DPS reduced rho by 0.028 to 0.089 in ablation testing. Dynamic Precision Scheduling adjusts the state-head precision based on uncertainty estimated through dropout variance. The system amortizes uncertainty estimation over 5-second windows and caches it for 100 ms sub-windows to reduce overhead.