What it is
Airbyte is an open-source data movement (ELT) platform: it continuously copies data from your apps, databases and files into a data warehouse, data lake or vector database. It ships hundreds of ready-made connectors, like Salesforce, HubSpot, Stripe or Shopify, plus a builder for the ones that are missing. Self-host it for free or use Airbyte Cloud.
How to use it
- Pick a source and a destination and schedule incremental syncs.
- Load data into Snowflake, BigQuery or Databricks to analyze it with SQL.
- Feed a vector database like Pinecone or Qdrant with chunked documents and their embeddings.
- Build a custom connector with the Connector Builder instead of writing one from scratch.
- Automate everything with its API, Terraform or the PyAirbyte library.
What it's good for
- A logistics company pulling ERP, CRM and order-sheet data into BigQuery.
- A data team replacing homegrown scripts with monitored syncs.
- An AI startup keeping its vector database up to date with Notion and Google Drive documents.
Pros
- Hundreds of connectors, including Salesforce, HubSpot, Stripe and Shopify
- Free, self-hostable Community edition
- No-code Connector Builder for APIs that aren't covered yet
- Vector database destinations alongside warehouses and data lakes
Cons
- Self-hosting means running Kubernetes and keeping an eye on your syncs
- Connector quality varies; some are community-maintained
- Cloud costs grow with the volume of data you sync