← DecisionOS

DecisionOS — Control · module

Risk

Which of the things that could go wrong we would find out about in time to do something, and which control would change the most of the ones we would not.

When you reach for it

Alongside Governance, quarterly or before a risk committee. After a near miss. When a regulator asks.

What it asks you

5 blocks, in this order. Each one exists for a stated reason, and the run tells you that reason as you answer it.

  1. 01

    The scenarios

    One row per way something could go wrong. Assume it has already happened — the premortem framing is what licenses the pessimism that 'what could go wrong' does not.

  2. 02

    What kind of scenario this is

    The capability tag and the library class. Both are asked so the report can tell you which classes typical for your capabilities your register left out — the one completeness check available from inside a self-declared register.

  3. 03

    Four facts and a history

    No probabilities, anywhere. Nobody can estimate the annual chance of an AI incident, and a number invented here would be multiplied by another invented number to produce a score with two significant figures. These are facts about your organisation instead: how you would find out, how long that takes, how long stopping takes, and how long you have.

  4. 04

    The controls

    From the same list of fifteen the Governance module uses, so the two cannot disagree about what a control is. Asked after the timings deliberately: a respondent who lists their controls first anchors every timing to the controls they have, and the timings are the part of this instrument that has to be honest.

  5. 05

    Who has accepted this

    Proceeding is legitimate. Proceeding with a named executive and a date recorded is a different act from proceeding quietly, and this module only supports the first.

The method

How the result is produced

Every scenario is classified by one comparison: the time it would take you to find out, plus the time it would then take you to stop it, against the time you have before the harm cannot be undone. Inside the window is bounded; outside it is unbounded; no detection route at all is blind, because the sum has a term that does not exist; and inside the window on a stop nobody has exercised in six months is untested, because the figure it rests on is an estimate. Nothing is multiplied by anything and no likelihood is estimated anywhere. Controls are then ranked not by how important they sound but by how many blind or unbounded scenarios each would address, taking the binding delay — whichever of detect and stop is the larger — as the thing a control has to move. Scenarios rated C1 or C2 are collected into one summary line, because the register is not trying to be complete; it is trying to be right about the top of the list.

What this is not
This module does not estimate likelihood, anywhere, and that is deliberate. Nobody can put an annual probability on an AI incident; asked to, people invent one, and it is then multiplied by an invented impact to produce a score with two significant figures that nothing in the world produced. Every number here is a duration you gave us.
This is a structured self-attestation, not an audit. Nothing here was inspected, tested or verified by anyone outside your organisation.
Nothing is benchmarked against industry incident data, because none that is both credible and applicable to your systems exists. If we ever show you a comparison, it will have an n beside it.
This is not a complete register and does not try to be. It is ordered by consequence and built to be right about the top of the list.
A control that is in place is not a control that works. Only a drill establishes the difference, which is why the untested list is an output rather than a caveat.
Where it stops
Everything here is what you told us. Nothing was read, inspected, profiled or connected to.
There is no peer comparison behind any statement in this report, and none is implied. We will not show one until there is enough real data to state an n.
This run reflects the answers of whoever completed it. A second respondent answering the same questions frequently disagrees, and that disagreement is usually the finding.
All timings are your own estimates unless a drill date is present. Optimistic detect and stop times produce a bounded classification, which is why both are printed beside it — 'unbounded' is often one honest answer away.
Durations were given as bands, so the comparison uses a point inside each band. Two scenarios a few hours either side of the window will classify differently on the strength of that point, and the arithmetic is printed so you can see when a row is close.
The control exercise date is asked once per scenario, for the most recent of the controls in place, rather than once per control. It is enough to tell a register with drill history from one without, and it is not enough to say which specific control was last exercised.
Completeness cannot be established from inside this run. Coverage against the library is the only automatic check, and the library is ours.