bench/dev.gmitch215.drift.bench/EvidenceEval/run

run

fun run(lab: Lab, ids: List<String>, result: (String) -> String, seed: Long): JsonObject(source)

Scores ids of lab (dev ids only); result reads <id>.json from data/results. The weights are hand-set and nothing is fit, so in-sample is the whole result. A subset of the dev ids is labelled partial.