Skip to content

Dataset.backfill

POST /{namespace}/datasets/{dataset}/backfill

Backfill reads one Source of a Dataset over a past date range and records every value observed in it.

Mode
do
Event
Dataset.backfilled

Inputs

InputTypeRequiredDescription
datasetDatasetrequiredThe Dataset.
sourceSourcerequiredThe Source to read.
fromdaterequiredThe first day of the range.
todaterequiredThe last day of the range.

Outputs

OutputTypeRequiredDescription
datasetDatasetrequiredThe Dataset, with the range filled.

Effects

FactValue
Action classNone: no approval rule names it, so it runs within its seat's Permissions and Limits
StakesThe Startup's own records only
DoorTwo-way: it runs at once
Modestry previews it and stores nothing; send returns a pending Action; do (default) waits for the result
IdempotentOnly with a key: a repeat with the same Idempotency-Key and input returns the first Action, the same key with other input is refused with 409, and a repeat without a key runs again
UndoAction.undo reverses it
EmitsDataset.backfilled
Performed byThe Data Engineer

Refuses when

CheckErrorFixThen call
The key is valid, but its scopes do not allow this operationforbiddenUse a key whose scopes cover the operation, or ask an owner of the namespace to grant them.None.
dataset is missing, or is not a datasetinvalid-inputSend dataset as a dataset, then call it again.None.
source is missing, or is not a sourceinvalid-inputSend source as a source, then call it again.None.
from is missing, or is not a dateinvalid-inputSend from as a date, then call it again.None.
to is missing, or is not a dateinvalid-inputSend to as a date, then call it again.None.
The Idempotency-Key was sent before with another operation or other inputidempotency-mismatchSend a new key for new input; reuse a key only to retry the same request.None.

When it waits

GateDefault
Decision classLow: two-way, no delay window
Delay windowNone: it runs once review passes.
LimitThe call Limit of the Permission it runs under.
Over the LimitIt waits pending for an Approval, which a Human answers: the owner of record, or a Human they named to approve for the Founder seat. Approved, it runs; refused, it ends refused with limit-exceeded; unanswered by its deadline, it ends canceled.

To retry, send the same Idempotency-Key: the retry returns the first Action and runs nothing twice. A new key runs the call again.