categorical_score

Score a categorical distribution using categorical Brier and the ordered ranked rule.

Contract

Probabilities must sum to one; outcome is a zero-based index. Brier is on [0,2]. Use the unnormalized ranked score only when category order has meaning.

Fields

This operation needs no existing question or forecast. Use --memory for a calculation-only session.

Request

Send this object on one line. It is expanded below for readability.

{
  "version": 1,
  "id": "example",
  "command": {
    "op": "categorical_score",
    "probabilities": [
      0.3,
      0.7
    ],
    "outcome": 0
  }
}

Response

This response is generated by executing the example against the current binary. Commit timestamps, when present, are shown as <runtime UTC seconds>; the actual protocol returns integer UTC seconds.

{
  "version": 1,
  "id": "example",
  "result": {
    "categorical_brier": 0.9799999999999999,
    "ranked_probability_unnormalized": 0.48999999999999994
  }
}

Verification

The documentation gate executes the setup and request, then checks the following result fields against independently specified expectations:

Float comparisons use a 1e-12 tolerance. Request schema validation and cross-record validation still apply. See errors and recovery for failure handling.