ST-003: Rail Saturation / Overflow
Purpose
This is the core fixed-point hardware failure family. It tests what happens when activations, gradients, weights, updates, or accumulators approach the representable rails.
Mechanismβ
Fixed-point quantization clips values to the representable range:
Objects to test separately:
| Object | Failure symptom |
|---|---|
| activations | forward information clips |
| gradients | backpropagated learning signal clips |
| weights | stored model state clips |
| updates | parameter increments clip |
| accumulators | batch sums clip before averaging |
Rail Pressureβ
Log rail pressure per object:
where is a near-rail threshold such as .
Controller Hypothesisβ
The throttle should reduce update pressure before the system repeatedly hits rails:
Information loss
If the input itself is irreversibly clipped before the model sees it, the throttle cannot recover the lost information. A wider input dtype or input cap may still be required.