MCPcopy
hub / github.com/apache/dolphinscheduler

github.com/apache/dolphinscheduler @3.4.2 sqlite

repository ↗ · DeepWiki ↗ · release 3.4.2 ↗
16,056 symbols 62,881 edges 3,123 files 2,457 documented · 15%
README

Apache DolphinScheduler

License codecov Quality Gate Status Twitter Follow EN doc

关于

一个分布式易扩展的可视化 DAG 工作流任务调度系统。致力于解决数据处理流程中错综复杂的依赖关系，使调度系统在数据处理流程中开箱即用。

DolphinScheduler 的主要特性如下：

  • 易于部署，提供四种部署方式，包括 Standalone、Cluster、Docker 和 Kubernetes
  • 易于使用，可以通过多种方式创建和管理工作流，包括 Web UI、Python SDK 和 Open API
  • 高可靠高可用，多主多从的去中心化架构，原生支持横向扩展
  • 高性能，性能比其他编排平台快N倍，每天可支持千万级任务
  • Cloud Native，DolphinScheduler支持编排多云/数据中心工作流，支持自定义任务类型
  • 对工作流和工作流实例（包括任务）进行版本控制
  • 工作流和任务的多种状态控制，支持随时暂停/停止/恢复它们
  • 多租户支持
  • 其他如补数支持（Web UI 原生），包括项目和数据源的权限控制

快速开始

系统部分截图

  • 主页：项目和工作流概览，包括最新的工作流实例和任务实例状态统计。 home

  • 工作流定义： 通过拖拉拽创建和管理工作流，轻松构建和维护复杂的工作流，内置支持多种任务类型，开箱即用。 workflow-definition

  • 工作流树状图： 抽象的树形结构可以更清晰地理解任务之间的关系。 workflow-tree

  • 数据源： 支持管理多种外部数据源，为MySQL、PostgreSQL、Hive、Trino等，并提供统一的数据访问能力。 data-source

  • 监控：实时查看master、worker和数据库的状态，包括服务器资源使用情况和负载情况，无需登录服务器即可快速进行健康检查。 monitor

建议和报告 bugs

根据 这个步骤 来报告你的 bug 或者提交建议。

参与贡献

社区欢迎大家贡献，请参考此页面了解更多：如何贡献，如果你是首次贡献 DolphinScheduler，在这里可以找到good first issue

社区

欢迎通过以下方式加入社区：

Landscapes

cncf-landscape  cncf-logo

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.

Extension points exported contracts — how you extend this code

IShellInterceptor (Interface)
This interface is used to execute shell commands. It should be created by @IShellInterceptorBuilder. [18 implementers]
dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/shell/IShellInterceptor.java
ISourceGenerator (Interface)
Source Generator Interface [20 implementers]
dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/generator/ISourceGenerator.java
Registry (Interface)
The SPI interface for registry center, each registry plugin should implement this interface. [6 implementers]
dolphinscheduler-registry/dolphinscheduler-registry-api/src/main/java/org/apache/dolphinscheduler/registry/api/Registry.java
IReportableTaskExecutorLifecycleEvent (Interface)
The lifecycle event of ITaskExecutor which should be report to master. [7 implementers]
dolphinscheduler-task-executor/src/main/java/org/apache/dolphinscheduler/task/executor/events/IReportableTaskExecutorLifecycleEvent.java
DataSourceClient (Interface)
Interface used to get connection of a data source. [37 implementers]
dolphinscheduler-spi/src/main/java/org/apache/dolphinscheduler/spi/datasource/DataSourceClient.java
AlertChannel (Interface)
alert channel for sending alerts [24 implementers]
dolphinscheduler-alert/dolphinscheduler-alert-plugins/dolphinscheduler-alert-api/src/main/java/org/apache/dolphinscheduler/alert/api/AlertChannel.java
ILifecycleEventHandler (Interface)
The event handler interface, used to handle the event [25 implementers]
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/engine/ILifecycleEventHandler.java
DaoPluginConfiguration (Interface)
DaoPluginConfiguration used to configure the dao plugin. [7 implementers]
dolphinscheduler-dao-plugin/dolphinscheduler-dao-api/src/main/java/org/apache/dolphinscheduler/dao/plugin/api/DaoPluginConfiguration.java

Core symbols most depended-on inside this repo

getCode
called by 996
dolphinscheduler-scheduler-plugin/dolphinscheduler-scheduler-api/src/main/java/org/apache/dolphinscheduler/scheduler/api/SchedulerExceptionEnum.java
get
called by 730
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/config/IPropertyDelegate.java
build
called by 707
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/engine/task/execution/ITaskInstanceFactory.java
getId
called by 679
dolphinscheduler-task-executor/src/main/java/org/apache/dolphinscheduler/task/executor/ITaskExecutor.java
add
called by 631
dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/resources/ResourceComponent.java
isEmpty
called by 590
dolphinscheduler-eventbus/src/main/java/org/apache/dolphinscheduler/eventbus/IEventBus.java
builder
called by 532
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/engine/task/execution/ITaskInstanceFactory.java
format
called by 532
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/DateUtils.java

Shape

Method 10,745
Class 2,298
Function 2,278
Interface 609
Enum 126

Languages

Java84%
TypeScript16%
Python1%

Modules by API surface

dolphinscheduler-ui/public/lodash.min.js473 symbols
dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/permission/ResourcePermissionCheckServiceImpl.java64 symbols
dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/model/TaskNode.java53 symbols
dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/WorkflowDefinitionServiceTest.java49 symbols
dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/WorkflowDefinitionServiceImpl.java48 symbols
dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/DateUtils.java43 symbols
dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/security/impl/oidc/OidcAuthenticatorTest.java40 symbols
dolphinscheduler-ui/src/components/crontab/modules/day.tsx38 symbols
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/engine/graph/WorkflowExecutionGraph.java37 symbols
dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/UsersServiceTest.java36 symbols
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/engine/graph/IWorkflowExecutionGraph.java35 symbols
dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/cron/CycleFactory.java32 symbols

Dependencies from manifests, versioned

ch.qos.logback:logback-classic1×
ch.qos.logback:logback-core1×
com.alibaba:druid1×
com.aliyun.oss:aliyun-sdk-oss1×
com.aliyun:credentials-java1×
com.aliyun:dyvmsapi201705251×
com.aliyun:emr_serverless_spark202308081×
com.amazon.redshift:redshift-jdbc421×
com.amazonaws:aws-java-sdk-dms1×
com.amazonaws:aws-java-sdk-emr1×
com.amazonaws:aws-java-sdk-emrserverless1×
com.amazonaws:aws-java-sdk-redshift1×

Datastores touched

(mysql)Database · 1 repos
dolphinschedulerDatabase · 1 repos
dolphinschedulerDatabase · 1 repos
metastoreDatabase · 1 repos
defaultDatabase · 1 repos
defaultDatabase · 1 repos
aaDatabase · 1 repos

For agents

$ claude mcp add dolphinscheduler \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact