IF Commons GitHub

operations

How a data platform is run and shown to be run

Applies to: Operations and proof. How a data platform is run and shown to be run: what it waits on, its releases and signals, its drills, calculations and lineage.

Written in commons/data/models/operations/mod.ts:175. Requires nothing. 11 concepts, 5 code lists.

supersedes release target workload decision promotion release runtimeEnvironment workload_statement workload
How the concepts of operations relate
Diagram source
flowchart LR
  decision -->|supersedes| decision
  promotion -->|release| release
  promotion -->|target| runtimeEnvironment
  workload_statement -->|workload| workload

Concepts

ConceptDefinitionAttributesWritten in
dataCopyA copy of a dataset in a place, with why it exists, who answers for it and when it was last refreshed: what makes the copies of the data known and not only the original7commons/data/models/operations/mod.ts:103
decisionA decision that shaped the platform, with its context, what was decided and what follows from it, so that a later person finds out why and not only what8commons/data/models/operations/mod.ts:76
freshnessRuleHow old the latest load of a source may be before it is stale: the expectation that source freshness is held to4commons/data/models/operations/mod.ts:166
limitA certificate, key, quota, licence or agreement that runs out or fills, with when and who renews it: the inventory of what will stop the platform if nobody acts6commons/data/models/operations/mod.ts:94
promotionA release arriving in an environment, with who promoted it, when and the evidence: the promotion log, only ever added to4commons/data/models/operations/mod.ts:130
releaseOne version of an artifact (a pipeline, a model, a schema) that was cut for release, with when and what evidence it carries5commons/data/models/operations/mod.ts:121
runtimeEnvironmentAn environment a release is promoted through, what it is for, whether it holds real data and who answers for it5commons/data/models/operations/mod.ts:112
signalA measurement the platform emits: its name, its kind, its unit and the attributes it carries, so that every emitter and every alert agree on what it is6commons/data/models/operations/mod.ts:157
waitingA precondition the work waits on, from whom, since when and by when it is needed: the waiting-on ledger, whose status is computed from its dates7commons/data/models/operations/mod.ts:59
workloadA job, query set or service the platform runs, with who owns it, how often it runs and how critical it is: the register that capacity, cost and recovery are planned from5commons/data/models/operations/mod.ts:139
workloadStatementA read-only statement of a workload with the number of rows and the hash of the rows it gave when it was recorded, to be replayed and compared4commons/data/models/operations/mod.ts:148

Code lists

Code listDefinitionCodes
decisionStatusWhere a decision record is4
environmentKindWhat an environment is for, in the order a release is promoted through them4
limitKindWhat kind of thing has a limit or an expiry5
signalKindWhat kind of measurement a signal is4
waitingStatusWhere a thing the work waits on is3

Titles, headings, exports, tables, columns and requirements. Esc closes.