Commit Graph

56 Commits

Author SHA1 Message Date
xuhhui 513f336015
[Feature] Add new task type chunjun (#10937) 2022-07-28 19:25:29 +08:00
Tq 9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js (#11173)
add Feishu alert doc and configure email alert doc to the docsdev.js
2022-07-28 17:21:32 +08:00
JieguangZhou af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Jiajie Zhong 08cfbc73e0
[doc] Add missing doc change by snehal (#10892) 2022-07-12 14:16:00 +08:00
ZhaoGuodong 8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster (#10657)
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
qianli2022 1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster (#10650)
* server code

* namespace ui

* fix dao test

* fix test

* fix

* docs and image update

Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
sneh-wha fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. (#10713) 2022-07-05 21:58:05 +08:00
Kerwin bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node (#10480) 2022-07-05 19:21:30 +08:00
aiwenmo 5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640) 2022-07-05 10:07:24 +08:00
sneh-wha 423cc5b9be
[doc] Modified project doc. (#10711) 2022-07-04 10:23:25 +08:00
sneh-wha 7898f41dc0
[doc] Change datasource doc (#10660) 2022-06-30 23:33:59 +08:00
Stalary a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
caishunfeng c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
Stalary b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
houshitao 1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
JieguangZhou 36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
liubo1990 b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00
qianli2022 ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
JieguangZhou 3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217)
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
Wenjun Ruan e21d7b1551
[Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT
2022-06-09 10:55:39 +08:00
chuxing 7e39e0d48d
[doc] Add switch task demo (#10247)
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
HuangWei c5961aed25
[feat][task] Add OpenMLDB task plugin (#10198) 2022-05-31 11:00:21 +08:00
QuakeWang cd36401a6a
[doc] Refactor context parameter docment (#10227) 2022-05-30 11:44:10 +08:00
QuakeWang 58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document (#10242)
* fix issue-9898
* delete no use pictures
2022-05-30 11:04:42 +08:00
Jiajie Zhong 6d9bc0743b
[doc] Add setValue syntax in local param (#10245)
ref: #9576
same as: #9671
2022-05-25 21:53:41 +08:00
QuakeWang 5998c73aac
[doc] Refactor local parameter docment (#10119) 2022-05-24 17:16:08 +08:00
Jiajie Zhong f4b7754952
[doc] Update task DataX document (#10218) 2022-05-24 13:45:26 +08:00
JieguangZhou 54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component (#10175)
* Add MLflow Projects (custom project) component

* fix something

* update document

* update document

* Supplementary test cases
2022-05-24 09:42:46 +08:00
QuakeWang 0abfb5e744
[doc] Refactor global parameter docment (#10045) 2022-05-23 10:46:11 +08:00
JieguangZhou e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) (#10150)
* Add backend of MLflow Moldes component

* Add front end of MLflow Moldes component

* [DOC] update mlflow document

* revert unnecessary

* fix doc image url

* Update docs/docs/en/guide/task/mlflow.md

Discard the lr abbreviation

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-20 19:41:22 +08:00
Mr.An 7d5af7e7ec
[doc] Update editorial workflow content and images (#10130) 2022-05-20 16:44:56 +08:00
Jiajie Zhong 94c515555e
[doc] Remove flink call docs (#10122)
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
2022-05-19 16:41:33 +08:00
Mr.An 73f13a9c9c
[doc] Show all the functions of the home page through screenshots (#10118) 2022-05-19 14:45:44 +08:00
QuakeWang 243ee8ba70
[Bug][doc] Fix the open-api docs request error (#10100) 2022-05-19 11:28:33 +08:00
JieguangZhou 9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. (#10036)
* [Feature][Task Plugin] Add mlflow task plugin (#9725)

* [Feature][Task Plugin] Add mlflow task plugin UI (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] revert unnecessary

* [Feature][Task Plugin] add auto ml to mlflow task plugin

* [DOC] add mlflow document

* [DOC] fix mlflow docs imgs

* [DOC] fix dead link localhost:5000

* [DOC] fix dead link localhost:5000

* [DOC] remove dead link localhost:5000

* Update docs/docs/en/guide/task/mlflow.md

* Update docs/docs/zh/guide/task/mlflow.md

* [DOC] format ui code

* [DOC] remove dead link localhost:5000

* [Feature][Task Plugin] revert unnecessary

* fix some nits

* Move the personal repository to the public repository.

* Run the command directly instead of saving the file

* fix paramsMap initialize

* revert unnecessary

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-19 09:40:31 +08:00
He Zhao 5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin (#9425)
* [Feature][plugin] Add k8s task in task plugin

* [Feature][plugin] fix dos and code problems

* [Feature][plugin] refactor some code based on sonar

* [Feature][UI] front-end for k8s task plugin

* [Feature][plugin] delete some front files

* [Feature][plugin] update document

* Update docs/docs/zh/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* [Feature][UI] front-end change from review comments

* [Feature][UI] replace get namespace list api

* [Feature][plugin] change file name

* Add kubernetes to zh task list

Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-18 17:23:42 +08:00
xiangzihao 225cb332d1
[Fix-10049] Conditions Task branch flow failed (#10077) 2022-05-18 11:40:32 +08:00
Eric Gao 80369363c9
[feat][task plugin] Add Jupyter task plugin (#9872)
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-05-12 19:55:49 +08:00
QuakeWang 0fe75482a2
[doc] Add example and notice about task type Dependent (#10001)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-12 18:23:43 +08:00
qianli2022 bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update (#9881)
* test

* test

* doc

* fix image error

* fix

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/zh/guide/security.md

* fix doc

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-11 16:40:30 +08:00
QuakeWang 12a4b01268
[Doc] Add example and notice about task type Conditions (#9945) 2022-05-11 11:43:11 +08:00
QuakeWang f790bc25fd
[doc] Update the document picture to new UI (#9953) 2022-05-11 11:38:15 +08:00
Dannila 2d36449444
[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840)
* flink_sql

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* [refactor] flinksql

* '[refactor]flinksql'

* [refactor] dolphinscheduler flinksql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* Update docs/docs/en/guide/task/flink.md

* Update docs/docs/zh/guide/task/flink.md

* prettier front-end code

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-05-09 18:51:55 +08:00
QuakeWang 691e8ab538
[Feature][doc] Refactor and separate the Resource Center Document (#9658)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-07 18:07:35 +08:00
Eric Gao 1f7884609a
[Feature][Doc] Add docs for zeppelin task plugin (#9866) 2022-05-06 15:04:52 +08:00
sq-q b1bb69c959
[Improve][docs] Add spark sql docs to task spark (#9851) 2022-05-05 10:48:17 +08:00
Tq 7b0b4c126e
[Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
* add http alert doc and change body param to unnecessary

* submit http en doc and fix doc

* fix http doc
2022-04-27 17:26:58 +08:00
Tq e3070d9fa3
[Bug] [Website-9764]add script doc to the alert function (#9765)
* add script doc to the alert function

* add script doc to the alert function modify docsdev.js
2022-04-26 17:43:46 +08:00
zixi0825 337696e258
[Docs][DataQuality]: Add DataQuality Docs (#9512)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-21 14:54:38 +08:00
wangyang 6155dc3dab
[Docs] enhance alert doc (#9534)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-20 13:02:28 +08:00