688f84452d
[Feature-14678][Master][UI]Dependent task parameter passing ( #14702 )
...
* feat: dependent task parameter passing
* style: code format
* refactor: remove inappropriate log
* refactor: Modify unreasonable code structure
* refactor: Modify unreasonable code structure
* refactor: Solve conflicts caused by merge
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
2023-10-25 16:24:30 +08:00
76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent ( #14824 )
...
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- delete useless output
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- add log
- run spotless check
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
2023-09-09 17:23:34 +08:00
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
76f33bea2b
[doc] Change DinkyTask picture to english ( #14061 )
2023-05-05 22:37:01 +08:00
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin ( #13801 )
2023-03-30 20:17:28 +08:00
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis ( #12693 )
2022-11-17 10:14:36 +08:00
0373e06615
[Feature-8030][docs] Add sqoop task doc ( #12855 )
...
* [Feature-8030][docs] Add sqoop task doc
* Update docs/docs/zh/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update docs/docs/en/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Feature-8030][docs] Add sqoop task doc
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-11-13 00:09:05 +08:00
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario ( #12843 )
2022-11-11 16:08:38 +08:00
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc ( #12765 )
2022-11-07 17:39:02 +08:00
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2022-10-09 10:47:01 +08:00
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2022-09-30 10:16:16 +08:00
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2022-09-21 10:45:05 +08:00
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2022-09-09 10:37:24 +08:00
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2022-08-30 10:45:51 +08:00
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
513f336015
[Feature] Add new task type chunjun ( #10937 )
2022-07-28 19:25:29 +08:00
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster ( #10657 )
...
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node ( #10480 )
2022-07-05 19:21:30 +08:00
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL ( #10640 )
2022-07-05 10:07:24 +08:00
a45fc5b032
[doc] Add doc for pre-sql and post-sql ( #10685 )
2022-06-30 20:01:23 +08:00
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario ( #10372 ) ( #10407 )
2022-06-21 13:13:46 +08:00
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose ( #10217 )
...
* [Feature] [MLOps] support mlflow deploy with docker compose
fix doc
Update docs/docs/en/guide/task/mlflow.md
fix doc
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
revert cancel modification
fix ENV name and docker compose command
* fix doc image link
* fix testModelsDeployDockerCompose
* add docker compose container health check and fix mlflow bug
* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
7e39e0d48d
[doc] Add switch task demo ( #10247 )
...
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
c5961aed25
[feat][task] Add OpenMLDB task plugin ( #10198 )
2022-05-31 11:00:21 +08:00
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component ( #10175 )
...
* Add MLflow Projects (custom project) component
* fix something
* update document
* update document
* Supplementary test cases
2022-05-24 09:42:46 +08:00
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) ( #10150 )
...
* Add backend of MLflow Moldes component
* Add front end of MLflow Moldes component
* [DOC] update mlflow document
* revert unnecessary
* fix doc image url
* Update docs/docs/en/guide/task/mlflow.md
Discard the lr abbreviation
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-20 19:41:22 +08:00
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. ( #10036 )
...
* [Feature][Task Plugin] Add mlflow task plugin (#9725 )
* [Feature][Task Plugin] Add mlflow task plugin UI (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] revert unnecessary
* [Feature][Task Plugin] add auto ml to mlflow task plugin
* [DOC] add mlflow document
* [DOC] fix mlflow docs imgs
* [DOC] fix dead link localhost:5000
* [DOC] fix dead link localhost:5000
* [DOC] remove dead link localhost:5000
* Update docs/docs/en/guide/task/mlflow.md
* Update docs/docs/zh/guide/task/mlflow.md
* [DOC] format ui code
* [DOC] remove dead link localhost:5000
* [Feature][Task Plugin] revert unnecessary
* fix some nits
* Move the personal repository to the public repository.
* Run the command directly instead of saving the file
* fix paramsMap initialize
* revert unnecessary
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-19 09:40:31 +08:00
5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin ( #9425 )
...
* [Feature][plugin] Add k8s task in task plugin
* [Feature][plugin] fix dos and code problems
* [Feature][plugin] refactor some code based on sonar
* [Feature][UI] front-end for k8s task plugin
* [Feature][plugin] delete some front files
* [Feature][plugin] update document
* Update docs/docs/zh/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* [Feature][UI] front-end change from review comments
* [Feature][UI] replace get namespace list api
* [Feature][plugin] change file name
* Add kubernetes to zh task list
Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-18 17:23:42 +08:00
225cb332d1
[Fix-10049] Conditions Task branch flow failed ( #10077 )
2022-05-18 11:40:32 +08:00
80369363c9
[feat][task plugin] Add Jupyter task plugin ( #9872 )
...
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-05-12 19:55:49 +08:00
0fe75482a2
[doc] Add example and notice about task type Dependent ( #10001 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-12 18:23:43 +08:00
12a4b01268
[Doc] Add example and notice about task type Conditions ( #9945 )
2022-05-11 11:43:11 +08:00
2d36449444
[Feature- 9837][plugin/ui] support FlinkSQL Task ( #9840 )
...
* flink_sql
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* [refactor] flinksql
* '[refactor]flinksql'
* [refactor] dolphinscheduler flinksql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* Update docs/docs/en/guide/task/flink.md
* Update docs/docs/zh/guide/task/flink.md
* prettier front-end code
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-05-09 18:51:55 +08:00
691e8ab538
[Feature][doc] Refactor and separate the Resource Center Document ( #9658 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-07 18:07:35 +08:00
1f7884609a
[Feature][Doc] Add docs for zeppelin task plugin ( #9866 )
2022-05-06 15:04:52 +08:00
b1bb69c959
[Improve][docs] Add spark sql docs to task spark ( #9851 )
2022-05-05 10:48:17 +08:00
337696e258
[Docs][DataQuality]: Add DataQuality Docs ( #9512 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-21 14:54:38 +08:00
eb21b6cc52
[Feature][Doc] Switch shell task instruction screenshots to latest ( #9434 )
2022-04-13 14:13:42 +08:00
9f84dbbda0
[doc] Migrate dev doc from website repository ( #9291 )
...
* [doc] Migrate dev doc from website repository
* Correct release language
* Fix license issue
* Add all images from website
* Delete unused images
* Add CI
* Fix ci
* fix ci
* Remove no need file
* Add latest commit from website
* correct img_utils.py script
* Remove unused imgs
2022-04-02 10:43:34 +08:00
Orange Summer