RealErrorComposer
RealErrorComposer is reliable only when engineered badness scores coherently track the latent objective. RealErrorComposer converts heterogeneous deployment metrics into a scalar error in the interval [0,1]. The final scalar error is a wei…
1 sources - 5 claims
RealErrorComposer is reliable only when engineered badness scores coherently track the latent objective. RealErrorComposer converts heterogeneous deployment metrics into a scalar error in the interval [0,1]. The final scalar error is a weighted average of metric badness scores using positive user-specified or uniform weights. RealErrorComposer standardizes each metric using exponential moving averages of mean and variance before applying a logistic mapping. If metrics are constrained, conflicting, or non-monotone relative to true loss, the convex ordering property may not make the scalar error faithful.