MCPcopy
hub / github.com/airbytehq/airbyte

github.com/airbytehq/airbyte @v2.0.0 sqlite

repository ↗ · DeepWiki ↗ · release v2.0.0 ↗
20,117 symbols 88,640 edges 3,133 files 4,952 documented · 25%
README

Airbyte

<em>Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes</em>

Test Release Slack YouTube Channel Views Build License License

We believe that only an open-source solution to data movement can cover the long tail of data sources while empowering data engineers to customize existing connectors. Our ultimate vision is to help you move data from any source to any destination. Airbyte already provides the largest catalog of 300+ connectors for APIs, databases, data warehouses, and data lakes.

Airbyte Connections UI Screenshot taken from Airbyte Cloud.

Getting Started

Try it out yourself with our demo app, visit our full documentation, and learn more about recent announcements. See our registry for a full list of connectors already available in Airbyte or Airbyte Cloud.

Join the Airbyte Community

The Airbyte community can be found in the Airbyte Community Slack, where you can ask questions and voice ideas. You can also ask for help in our Airbyte Forum, or join our Office Hours. Airbyte's roadmap is publicly viewable on GitHub.

For videos and blogs on data engineering and building your data stack, check out Airbyte's Content Hub, YouTube, and sign up for our newsletter.

Contributing

If you've found a problem with Airbyte, please open a GitHub issue. To contribute to Airbyte and see our Code of Conduct, please see the contributing guide. We have a list of good first issues that contain bugs that have a relatively limited scope. This is a great place to get started, gain experience, and get familiar with our contribution process.

Security

Airbyte takes security issues very seriously. Please do not file GitHub issues or post on our public forum for security vulnerabilities. Email security@airbyte.io if you believe you have uncovered a vulnerability. In the message, try to provide a description of the issue and ideally a way of reproducing it. The security team will get back to you as soon as possible.

Airbyte Enterprise also offers additional security features (among others) on top of Airbyte open-source.

License

See the LICENSE file for licensing information, and our FAQ for any questions you may have on that topic.

Thank You

Airbyte would not be possible without the support and assistance of other open-source tools and companies! Visit our thank you page to learn more about how we build Airbyte.

Extension points exported contracts — how you extend this code

RedisCache (Interface)
Interface defined to support caching in different Redis data types for different purposes. [2 implementers]
airbyte-integrations/connectors/destination-redis/src/main/java/io/airbyte/integrations/destination/redis/RedisCache.java
SftpFileParser (Interface)
(no doc) [4 implementers]
airbyte-integrations/connectors/source-sftp/src/main/java/io/airbyte/integrations/source/sftp/parsers/SftpFileParser.java
KafkaFormat (Interface)
(no doc) [3 implementers]
airbyte-integrations/connectors/source-kafka/src/main/java/io/airbyte/integrations/source/kafka/format/KafkaFormat.java
StarburstGalaxyStreamCopierFactory (Interface)
(no doc) [1 implementers]
airbyte-integrations/connectors/destination-starburst-galaxy/src/main/java/io/airbyte/integrations/destination/starburst_galaxy/StarburstGalaxyStreamCopierFactory.java

Core symbols most depended-on inside this repo

get
called by 5961
airbyte-integrations/connectors/destination-teradata/src/test-integration/java/io/airbyte/integrations/destination/teradata/envclient/TeradataHttpClient.java
of
called by 1758
airbyte-integrations/connectors/source-postgres/src/main/java/io/airbyte/integrations/source/postgres/ctid/Ctid.java
append
called by 750
airbyte-integrations/connectors/destination-aws-datalake/destination_aws_datalake/aws.py
build
called by 664
airbyte-integrations/connectors/source-stripe/unit_tests/integration/config.py
add
called by 545
airbyte-integrations/bases/base-normalization/normalization/transform_catalog/table_name_registry.py
build
called by 537
airbyte-integrations/connectors/source-intercom/unit_tests/config_builder.py
with_record
called by 483
airbyte-integrations/connectors/source-shopify/unit_tests/integration/api/bulk.py
format
called by 434
airbyte-integrations/connectors/source-mssql/src/main/java/io/airbyte/integrations/source/mssql/cdc/MssqlDebeziumStateUtil.java

Shape

Method 10,258
Function 5,063
Class 4,490
Route 260
Enum 38
Interface 8

Languages

Python78%
Java21%
TypeScript1%

Modules by API surface

airbyte-integrations/connectors/source-github/source_github/github_schema.py1,453 symbols
airbyte-integrations/connectors/source-github/source_github/streams.py201 symbols
airbyte-integrations/connectors/source-outbrain-amplify/source_outbrain_amplify/source.py132 symbols
airbyte-integrations/connectors/source-shopify/source_shopify/shopify_graphql/bulk/query.py108 symbols
airbyte-integrations/connectors/source-rki-covid/source_rki_covid/source.py101 symbols
airbyte-ci/connectors/pipelines/pipelines/airbyte_ci/connectors/migrate_to_manifest_only/declarative_component_schema.py97 symbols
airbyte-integrations/bases/connector-acceptance-test/connector_acceptance_test/tests/test_core.py96 symbols
airbyte-integrations/connectors/source-shopify/source_shopify/streams/base_streams.py78 symbols
airbyte-integrations/connectors/source-iterable/source_iterable/streams.py78 symbols
airbyte-ci/connectors/connector_ops/connector_ops/utils.py76 symbols
airbyte-integrations/connectors/source-salesforce/source_salesforce/streams.py70 symbols
airbyte-integrations/connectors/source-jira/unit_tests/conftest.py70 symbols

Dependencies from manifests, versioned

@babel/core7.23.6 · 1×
@babel/helper-builder-binary-assignment-operator-visitor7.22.15 · 1×
@babel/helper-explode-assignable-expression7.18.6 · 1×
@babel/plugin-bugfix-safari-id-destructuring-collision-in-function-expression7.23.3 · 1×
@babel/plugin-bugfix-v8-spread-parameters-in-optional-chaining7.23.3 · 1×
@babel/plugin-proposal-async-generator-functions7.20.7 · 1×
@babel/plugin-proposal-class-properties7.18.6 · 1×
@babel/plugin-proposal-class-static-block7.21.0 · 1×
@babel/plugin-proposal-dynamic-import7.18.6 · 1×
@babel/plugin-proposal-export-namespace-from7.18.9 · 1×
@babel/plugin-proposal-json-strings7.18.6 · 1×
@babel/plugin-proposal-logical-assignment-operators7.20.7 · 1×

Datastores touched

(mongodb)Database · 1 repos
(mysql)Database · 1 repos
dbNameDatabase · 1 repos
POLARISDatabase · 1 repos
dbDatabase · 1 repos

For agents

$ claude mcp add airbyte \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact