bench/dev.gmitch215.drift.bench/SolveBench

SolveBench

object SolveBench(source)

Properties

CLASSES

val CLASSES: List<String>

KINDS

val KINDS: List<String>

NEEDS

const val NEEDS: String

Functions

ranks

fun ranks(evaluation: String): Map<String, SolveRanks>

The rank of each cause in the ranker's order and in the dimension-prior order, read from the probed section of evaluation.json.

score

fun score(dev: Set<String>, truths: List<SolveTruth>, cases: List<SolvedCase>, ranks: Map<String, SolveRanks> = emptyMap()): SolveScore

Scores cases against truths. A case outside dev is refused, as is an id that appears twice; a case whose certificate cannot be read counts as unreadable.