Skip to main content

CTRL-GT-ORDER-2-QA

Status:Planned
Tags:ControllerGlobal ThrottleQuantization
Last modified:

Purpose

CTRL-GT-ORDER-2-QA is the quantization-aware second-order global throttle. It tries to keep αt\alpha_t inside the interval where learning is both stable and representable.

Feasible Alpha Interval​

Stability imposes an upper bound:

αmax⁡,t=χηCtctrl+ϵ.\alpha_{\max,t} = \frac{\chi} {\eta C_t^{\mathrm{ctrl}}+\epsilon}.

Fixed-point usefulness imposes a lower bound:

αmin⁡,t=qΔη∥Gt∥2+ϵ.\alpha_{\min,t} = \frac{q_\Delta} {\eta\|G_t\|_2+\epsilon}.

Useful stable fixed-point learning requires:

αmin⁡,t≤αt≤αmax⁡,t.\boxed{ \alpha_{\min,t} \leq \alpha_t \leq \alpha_{\max,t}. }

Controller Dynamics​

The nominal second-order update is:

vα,t+1=βvα,t+kα(χ−ηαtCtctrl),α~t+1=αt+vα,t+1.\begin{aligned} v_{\alpha,t+1} &= \beta v_{\alpha,t} + k_\alpha \left( \chi-\eta\alpha_t C_t^{\mathrm{ctrl}} \right), \\ \tilde{\alpha}_{t+1} &= \alpha_t+v_{\alpha,t+1}. \end{aligned}

Then project into the feasible interval:

αt+1=clip⁡(α~t+1,αmin⁡,t,min⁡(1,αmax⁡,t)).\boxed{ \alpha_{t+1} = \operatorname{clip} \left( \tilde{\alpha}_{t+1}, \alpha_{\min,t}, \min(1,\alpha_{\max,t}) \right). }

Inputs​

InputMeaning
Δθtraw\Delta\theta_t^{\mathrm{raw}}raw optimizer update
η\etabase learning rate
CtctrlC_t^{\mathrm{ctrl}}curvature / sensitivity proxy
χ\chitarget stability margin
∥Gt∥2\|G_t\|_2gradient norm
qΔq_\Deltaupdate quantum
kα,βk_\alpha,\betasecond-order controller parameters

State​

StateMeaning
αt\alpha_tthrottle scalar
vα,tv_{\alpha,t}throttle velocity

Failure Detection​

If:

αmin⁡,t>αmax⁡,t,\alpha_{\min,t} > \alpha_{\max,t},

then the selected fixed-point update format cannot simultaneously provide stable and useful learning at that step.

Controller limitation

When the feasible interval is empty, the controller should report infeasibility. The solution is not another alpha value; the precision map, learning rate, update format, or data scaling must change.

Implementation Status​

Planned. This is the likely long-term controller for hardware-realistic fixed-point experiments.