Connectors
Reference for configuring data sources, ingest sinks, and schema sinks in skippr.yml.
| Role | YAML block | Overview |
|---|---|---|
| Read / extract | data_sources: | Input connectors (table below) |
| Write ingested data | data_sinks: | Data sinks |
| Catalog / DDL for ingest | schema_sinks: | Schema sinks |
Optional version: on a source, sink, or schema connector pins that connector to a specific release.
Data sources
Databases
| Plugin | Doc |
|---|---|
Clickhouse | ClickHouse |
Dynamodb | DynamoDB |
Mongodb | MongoDB |
Motherduck | MotherDuck |
Mssql | MSSQL |
Mysql | MySQL |
Postgres | PostgreSQL |
Redshift | Redshift |
DeltaLake | Delta Lake |
Object stores
| Plugin | Doc |
|---|---|
File | Local file |
S3 | S3 |
Sftp | SFTP |
Streaming
| Plugin | Doc |
|---|---|
Kafka | Kafka |
Sqs | SQS |
Kinesis | Kinesis |
Amqp | AMQP |
Sns | SNS |
Eventbridge | EventBridge |
Mqtt | MQTT |
Websocket | WebSocket |
HTTP / Network
| Plugin | Doc |
|---|---|
HttpClient | HTTP client |
HttpServer | HTTP server |
Socket | Socket |
Statsd | StatsD |
Pcap | PCAP |
API / SaaS
| Plugin | Doc |
|---|---|
GoogleAnalytics | GA4 |
AppleSearchAds | Apple Search Ads |
GoogleAds | Google Ads |
MetaAds | Meta Ads |
MetaInstagramAds | Meta Instagram Ads |
LinkedInAds | LinkedIn Ads |
XAds | X Ads |
AdrollAds | AdRoll Ads |
Stripe | Stripe |
ShopifyAdmin | Shopify Admin |
HubspotCrm | HubSpot CRM |
XeroAccounting | Xero Accounting |
RevolutBusiness | Revolut Business |
SumUp | SumUp |
Other
| Plugin | Doc |
|---|---|
Stdin | Stdin |
Data sinks
| Plugin | Doc |
|---|---|
Athena | Athena (S3 + Glue) |
Bigquery | BigQuery |
Clickhouse | ClickHouse |
Databricks | Databricks |
Motherduck | MotherDuck |
Postgres | Postgres |
Redshift | Redshift |
Snowflake | Snowflake |
Synapse | Synapse |
Iceberg | Iceberg |
S3 | S3 |
Gcs | GCS |
AzureBlob | Azure Blob |
Sftp | SFTP |
File | Local file |
Amqp | AMQP |
Stdout | Stdout |
Schema sinks
| Plugin | Doc | Typical data sink |
|---|---|---|
Glue | Glue | Athena |
Iceberg | Iceberg | Iceberg |
Bigquery | — | Bigquery |
Snowflake | — | Snowflake |
Postgres | — | Postgres |
Redshift | — | Redshift |
Clickhouse | — | Clickhouse |
Motherduck | — | Motherduck |
