CTRL-GT-ORDER-2-QA
CTRL-GT-ORDER-2-QA is the quantization-aware second-order global throttle. It tries to keep inside the interval where learning is both stable and representable.
Feasible Alpha Interval
Stability imposes an upper bound:
Fixed-point usefulness imposes a lower bound:
Useful stable fixed-point learning requires:
Controller Dynamics
The nominal second-order update is:
Then project into the feasible interval:
Inputs
| Input | Meaning |
|---|---|
| raw optimizer update | |
| base learning rate | |
| curvature / sensitivity proxy | |
| target stability margin | |
| gradient norm | |
| update quantum | |
| second-order controller parameters |
State
| State | Meaning |
|---|---|
| throttle scalar | |
| throttle velocity |
Failure Detection
If:
then the selected fixed-point update format cannot simultaneously provide stable and useful learning at that step.
When the feasible interval is empty, the controller should report infeasibility. The solution is not another alpha value; the precision map, learning rate, update format, or data scaling must change.
Implementation Status
Planned. This is the likely long-term controller for hardware-realistic fixed-point experiments.