Skip to content

Pipeline & Workspace

Pipelines are configured under pipelines: in skippr.yml.

yaml
skippr:
  workspace: dev

pipelines:
  events:
    data_source: data_sources.events
    data_sink: data_sinks.landing
    schema_sink: schema_sinks.catalog
    deadletter_sink: deadletter_sinks.deadletters
    transform:
      batch_time_fields: created_at
      batch_time_unit: day

The pipeline name (events above) is the key used by Skipprd:

bash
skipprd discover --pipeline events
skipprd schema --pipeline events
skipprd sync --pipeline events

data_sources.events and data_sinks.landing are logical names. They are not reserved; use any keys that match your project.

Environment overrides

PIPELINE_NAME

The name of the pipeline. Used as part of the composite key for metadata, schemas, offsets, and WAL storage.

Environment variablePIPELINE_NAME
Defaultdefault

WORKSPACE_NAME

Workspace / domain name. Combined with tenant and pipeline for storage keys.

Environment variableWORKSPACE_NAME
Defaultdefault

TENANT

Tenant identifier. Comes from authenticated credentials for hosted runs; local runs may set it via environment.

Environment variableTENANT
Defaultdefault

This site is source-available under PolyForm Shield 1.0.0