Skip to main content

Experiment Template

Status:Draft
Tags:ExperimentTemplate
Last modified:

Copy this structure when documenting an ablation experiment.

Experiment Title​

Use this ID format:

EXP-<number><variant>-<method>-<precision>-<model>

Examples:

EXP-000A-GLTHR-FLOAT-LIN1
EXP-000B-GLTHR-QFX-LIN1

Date: YYYY-MM-DD
Owner: NAME
Status: Planned / Running / Done / Failed / Deprecated

Goal​

What question are we trying to answer?

Hypothesis​

What do we expect to happen?

Setup​

FieldValue
Experiment IDEXP-...
Branchbranch-name
Commitcommit-hash
Dataset IDDS-...
Model IDMDL-...
Precision mapPrecision map / dtype registry entry
Drift(alpha, beta) range
Budgeting variantVariant
OptimizerOptimizer
EnvironmentEnvironment

Dataset And Model References​

Link to the dataset and model registry pages. Only restate equations here if the experiment changes or specializes them.

Model Math​

Add the forward equations and loss only when they are specific to this experiment.

z1 = W1 x + b1
a1 = relu(z1)
y_hat = W2 a1 + b2
L = ...

Diagram​

Use Mermaid for the forward and backward paths.

Procedure​

  1. Step 1
  2. Step 2
  3. Step 3

Results​

Add tables, plots, screenshots, or links to raw logs.

MetricBaselineBudgeted
Final lossTBDTBD
Saturation eventsTBDTBD
Max throttle shiftTBDTBD
Mean update cosineTBDTBD

Interpretation​

What do the results mean?

Failure modes / caveats​

  • Caveat 1
  • Caveat 2

Next steps​

  • Next action
  • Next action
  • Issue:
  • Pull request:
  • Lab log:
  • Notebook:
  • Data: