operations
How a data platform is run and shown to be run
Applies to: Operations and proof. How a data platform is run and shown to be run: what it waits on, its releases and signals, its drills, calculations and lineage.
Written in commons/data/models/operations/mod.ts:175. Requires nothing. 11 concepts, 5 code lists.
Diagram source
flowchart LR
decision -->|supersedes| decision
promotion -->|release| release
promotion -->|target| runtimeEnvironment
workload_statement -->|workload| workloadConcepts
| Concept | Definition | Attributes | Written in |
|---|---|---|---|
dataCopy | A copy of a dataset in a place, with why it exists, who answers for it and when it was last refreshed: what makes the copies of the data known and not only the original | 7 | commons/data/models/operations/mod.ts:103 |
decision | A decision that shaped the platform, with its context, what was decided and what follows from it, so that a later person finds out why and not only what | 8 | commons/data/models/operations/mod.ts:76 |
freshnessRule | How old the latest load of a source may be before it is stale: the expectation that source freshness is held to | 4 | commons/data/models/operations/mod.ts:166 |
limit | A certificate, key, quota, licence or agreement that runs out or fills, with when and who renews it: the inventory of what will stop the platform if nobody acts | 6 | commons/data/models/operations/mod.ts:94 |
promotion | A release arriving in an environment, with who promoted it, when and the evidence: the promotion log, only ever added to | 4 | commons/data/models/operations/mod.ts:130 |
release | One version of an artifact (a pipeline, a model, a schema) that was cut for release, with when and what evidence it carries | 5 | commons/data/models/operations/mod.ts:121 |
runtimeEnvironment | An environment a release is promoted through, what it is for, whether it holds real data and who answers for it | 5 | commons/data/models/operations/mod.ts:112 |
signal | A measurement the platform emits: its name, its kind, its unit and the attributes it carries, so that every emitter and every alert agree on what it is | 6 | commons/data/models/operations/mod.ts:157 |
waiting | A precondition the work waits on, from whom, since when and by when it is needed: the waiting-on ledger, whose status is computed from its dates | 7 | commons/data/models/operations/mod.ts:59 |
workload | A job, query set or service the platform runs, with who owns it, how often it runs and how critical it is: the register that capacity, cost and recovery are planned from | 5 | commons/data/models/operations/mod.ts:139 |
workloadStatement | A read-only statement of a workload with the number of rows and the hash of the rows it gave when it was recorded, to be replayed and compared | 4 | commons/data/models/operations/mod.ts:148 |
Code lists
| Code list | Definition | Codes |
|---|---|---|
decisionStatus | Where a decision record is | 4 |
environmentKind | What an environment is for, in the order a release is promoted through them | 4 |
limitKind | What kind of thing has a limit or an expiry | 5 |
signalKind | What kind of measurement a signal is | 4 |
waitingStatus | Where a thing the work waits on is | 3 |