bench/dev.gmitch215.drift.bench/UpgradeBench

UpgradeBench

Upgrade-check scoring over the migration scenarios; a separate category that never enters the environment tables. Dev items read the committed capsules through a Lab; test items need the Unsealed proof.

Properties

ANY

const val ANY: String

FLAGS

val FLAGS: List<String>

PREFIX

const val PREFIX: String

Functions

counts

fun counts(lab: Lab): Map<String, Int>

Scenario counts by split, from the committed scenario list and split only.

explained

fun explained(signature: String, rules: List<Rule> = Rules.all): Boolean

items

fun items(lab: Lab, ids: List<String>, rules: List<Rule> = Rules.all): List<UpgradeItem>

names

fun names(rule: Rule, signature: String): Boolean

A rule names a failure when one of its symptoms contains the signature text.

run

fun run(items: List<UpgradeItem>, rules: List<Rule> = Rules.all): List<UpgradeResult>

runDev

fun runDev(lab: Lab, rules: List<Rule> = Rules.all): List<UpgradeResult>

runTest

fun runTest(lab: Lab, unsealed: Unsealed, rules: List<Rule> = Rules.all): List<UpgradeResult>

scenarios

fun scenarios(lab: Lab): List<Scenario>

score

fun score(results: List<UpgradeResult>): UpgradeScore

toJson

fun toJson(lab: Lab, results: List<UpgradeResult>): String

The generated record of the dev items and what upgrade-check reported for each.