Stdin Input
Reads line-delimited data from standard input.
Supported formats
- Depends on the optional
formatsetting (e.g. JSON lines). Each line is typically one record.
How it works
- Reads from
stdinuntil EOF (batch mode, default) or continuously (stream mode). - Batch mode: suitable for pipes and one-shot jobs; ingestion completes when the stream closes.
- Stream mode: keeps reading as new lines arrive for long-running processes.
- Namespace convention:
stdin.
Configuration
bash
DATA_SOURCE_PLUGIN_NAME=StdinOr via YAML pipeline config:
yaml
data_sources:
source:
Stdin:
mode: batch
format: jsonlTypical usage
Pipe data into Skipprd:
bash
cat data.json | skipprd sync --pipeline my_pipelineConfiguration variables
| Variable | Default | Description |
|---|---|---|
mode | batch | batch (read until EOF) or stream (continuous) |
format | Optional format hint for the parser |
Namespace convention
stdinAuthentication
No connector-specific authentication is required.
Troubleshooting
| Symptom | Fix |
|---|---|
| no records are ingested | Check that the upstream process is piping data into stdin and that --mode matches the input format. |
| parse errors | Verify the piped payload is valid for the selected mode and that record boundaries are what you expect. |
