black O2, inc.
ACTIVE
    FOR-001 / ConceptsCON-012

    AI Control

    Active concept

    title
    AI Control
    Type
    concept
    Identifier
    CON-012
    Status
    Active
    Tags
    • literature
    • control
    • security
    • session-2
    Aliases
    • control agenda
    • AI control research
    connections
    • [[LIT-001]]
    • [[SYS-001]]
    • [[CNF-001]]
    • [[CON-002]]
    source path
    70_Literature/LIT-001.md

    AI Control

    A research programme that treats a capable model as a potential adversary rather than a tool, and asks what a deployer can guarantee about a system it cannot inspect. The unit of analysis is the protocol — the arrangement of trusted and untrusted models, monitors, audits and access rules — not the model's weights. Its defining move is to assume the model may be actively trying to defeat the protocol and then measure how much damage it can do anyway.

    Why It Matters Here

    This is the field's name for what the corpus argued from fiction. The Operator's central claim — that reachability, not strength, is the design variable of a binding — is the control agenda's premise, reached independently and stated in different vocabulary. See CNF-001.

    The difference is that control research measures the assumption. It reports which protocols hold at which capability ratios, using red-team games where a model is instructed to attack the protocol and its success rate is counted. The corpus asserts the ordering; control research prices it.

    What It Adds to the Corpus

    • A capability differential as an explicit design variable. The corpus's layers have no column for the relationship between binder and bound; control research makes that relationship the whole question.
    • Trusted editing and untrusted monitoring as named protocol elements, which are more specific than the corpus's "oversight" layer.
    • An admission that the protocol can be defeated and a method for finding out how — which the corpus's design rules do not have.

    Connections

    • LIT-001 — the source record.
    • CON-002 — the corpus's equivalent principle, stated as a property rather than a protocol.
    • SYS-001 — the system this concept corroborates.
    • CNF-001 — the confrontation where the two are set against each other.

    Back to Shackled AIForests