5a6c6c37f0
[Improvement-15910][UI] Supposed to provide a default value for the custom parallelism when using the mode of parallel execution. ( #15912 )
...
* worked out the issue
* imrpove the parallism strategy
* imrpove the parallism strategy
* merge from dev
2024-04-28 18:47:20 +08:00
6c78c8ec9a
[Improvement][Spark] Support Local Spark Cluster ( #15589 )
...
* [Improvement][Spark] Support Local Spark Cluster
* remote default local from deploy mode
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2024-04-22 15:05:59 +08:00
920ac154cb
[Improvement-15744][parameter] project parameter add update time and update user id ( #15745 )
...
* project parameter add update time and update user id
* project parameter add comment operator user id and UT
* project parameter add ui
2024-04-02 09:42:44 +08:00
faa794c39b
fix ui build error ( #15732 )
2024-03-18 17:48:42 +08:00
c61b81e0c6
[Improvement-15603][API] When removing or modifying a workflow the system can check if there any tasks depend on it. ( #15681 )
...
* modify the function of queryTaskSubProcessDepOnProcess
* add a function to query downstream dependent tasks
* confirm to make the workflow offline
* query dependent tasks
* check dependencies
* done
* done
* done
* done
* improve the test case
* improve the test case
* improve codes
* prettier the codes
* prettier the codes
2024-03-10 18:55:12 +08:00
5213290262
[Feature-14863][API] Support to manage what worker groups can be used for a project. ( #15600 )
2024-02-20 17:20:00 +08:00
3640a28348
[Improvement][HTTP] support custom rendering of http body ( #15531 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2024-01-31 11:02:48 +08:00
0f7081be10
[Feature] timed scheduler Improvement ( #15449 ) ( #15450 )
2024-01-11 17:25:31 +08:00
fd74cf16cb
adjust the sequence of alarm group and add validate ( #15382 ) ( #15384 )
2024-01-02 17:36:30 +08:00
c849501f3b
Display the resource file doesn't exist message in task create page ( #15350 )
2023-12-26 11:07:43 +08:00
159179ac95
[Feature-15146][dolphinscheduler-task-sqoop] add sqoop source/target type ( #15146 )
...
* task list: sgoop node params optimize
* security.ts add alarm_instance params
* 1 add SqoopTask params
2 add alert plugin aliyun-voice
* add license header
* commit sqhoop optimize
* pnpm-locl.yaml supplement annotation
* remove irrelevent commit.
* Code specification optimization
* optimize sqoop task ui
* Merge Code
* add the license header to pnpm-locl.yaml
* format the code
* format the code
* Fix sqoop task echo error
---------
Co-authored-by: xujiaqiang <xujiaqiang@aimatech.com>
Co-authored-by: xujiaqiang <“xujiaqiangwz@163.com”>
Co-authored-by: David Zollo <dailidong66@gmail.com>
2023-12-13 17:12:05 +08:00
688f84452d
[Feature-14678][Master][UI]Dependent task parameter passing ( #14702 )
...
* feat: dependent task parameter passing
* style: code format
* refactor: remove inappropriate log
* refactor: Modify unreasonable code structure
* refactor: Modify unreasonable code structure
* refactor: Solve conflicts caused by merge
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
2023-10-25 16:24:30 +08:00
f90eadd40f
[feature-#14449] add secret in k8s Task ( #14930 )
...
* [feature-#14449] add secret
* [feature-#14449] upgrade UT and rename parameter ```secret```
* [feature-#14449] fix UT
* [feature-#14449] fix UT
* [feature-#14449] improvement
* [feature-#14449] format
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2023-09-28 11:06:35 +08:00
4938470d20
[Fix-14907]Fix click to view the history in the task node of the workflow instance ( #14909 )
2023-09-13 11:17:10 +08:00
76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent ( #14824 )
...
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- delete useless output
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- add log
- run spotless check
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
2023-09-09 17:23:34 +08:00
e2b97c026e
[Improvement][UI] Support to disable or enable the project preferences. ( #14756 )
2023-08-16 20:20:48 +08:00
de2d215aee
impv: Correct datax execute and python execute script name ( #14523 )
...
* impv: Correct datax execute and python execute script name
we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name
* Add pr number
* fix ut
* style
---------
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
20cf4ad4e6
[Feature-14505][UI] Support to set project-level preferences ( #14573 )
...
* add a few codes about the project preferences
2023-07-19 15:35:54 +08:00
9778652f17
[Improvement-14136][task] Support submitting spark-sql task with the sql file in resource center ( #14527 )
...
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-19 10:09:30 +08:00
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database ( #14406 )
...
* add dataquality database api
* change ui
* api change
* update
* fix spotless
* fix h2
* fix pg
* fix-dead-line
* update
* fix-spotless
* update pg sql
* add ut
* fix ut
2023-07-12 09:00:28 +08:00
92d2b8e33f
[Improvement-14456][UI] When making the process online the system should remind user to take care of its offline timing. ( #14460 )
2023-07-10 08:46:39 +08:00
0b69236b04
[Feature-14251][Task] Support yarn queue definition in yarn task ( #14310 )
2023-07-07 14:24:47 +08:00
76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date ( #14450 )
2023-07-05 14:35:18 +08:00
65b6a4b097
[Feature-14421][K8S Task] Configurable image pull policy ( #14426 )
2023-07-05 09:17:47 +08:00
9cbb2629d9
[Improvement-14442][UI] Uniformly set the label name of parameter ( #14443 )
2023-07-04 14:09:30 +08:00
79b6db74fe
[Improvement-14363][UI] Add Default Branch Flow in switch task ( #14364 )
2023-06-27 10:29:03 +08:00
d4921fa2dd
[Feature][UI] Support CRUD of project-level parameters. ( #14344 )
2023-06-13 18:54:41 +08:00
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
525e441223
[Improvement-14282][Task] Add app_link on the ui of task instance ( #14283 )
2023-06-07 15:00:12 +08:00
4e78248238
[Feature][K8S Task] support node selector ( #14126 )
...
* feat: support K8S node selector
* fix CI
2023-05-26 09:21:23 +08:00
4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. ( #14178 )
2023-05-24 08:50:53 +08:00
8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes ( #14150 )
...
* Added a dependent task failure policy in the dependent task node
2023-05-19 14:49:50 +08:00
56b0f91f6e
fix: Save task seatunnel error ( #14129 )
2023-05-19 10:47:16 +08:00
03ff78fdcb
[Improvement-14112][UI] Add a quick link to visit workflow instances of the current workflow. ( #14134 )
2023-05-18 19:47:02 +08:00
db2da822de
Add supported operations of workflow definition ( #14122 )
2023-05-18 10:27:36 +08:00
f384d71da0
[Improvement-14111][UI] Add a tooltip for the copy button of workflow definition. ( #14116 )
2023-05-16 16:52:48 +08:00
c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task ( #14067 )
...
* [Improvement-13868] Support the custom labels for k8s task
* fix front-end type mismatched
2023-05-16 12:04:33 +08:00
d2f83ee8cf
[Feature] Support run all level dependent when complement ( #11778 )
...
* ADD: support all level dependent
* MOD: delete log
* MOD: format
* FIX: ut
* ADD: ut
* format
2023-05-05 14:52:27 +08:00
3bad68a942
[Bug-13929][K8S Task] Set command contains single quote is invalid ( #13930 )
...
* [Fix-13929][K8S Task] Set command contains single quote is invalid
* fix UT
2023-05-01 11:45:03 +08:00
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters ( #13935 )
...
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2023-04-18 14:56:38 +08:00
35bb533a50
[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin ( #13861 )
...
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-04-18 12:18:51 +08:00
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
3ecb4dbe24
align the workflow execution status with those from backend ( #13243 )
2022-12-22 09:21:54 +08:00
5fe25c995f
Fix spelling ( #13237 )
2022-12-21 16:22:49 +08:00
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2022-12-18 18:17:09 +08:00
e4b9b67255
Allow execute task in workflow instance ( #13103 )
2022-12-13 16:43:44 +08:00
3c31ddfd9f
[Improvement-12536][k8s] Support the command for the container in k8s task plugin ( #12538 )
2022-10-31 19:06:41 +08:00
dc8d18cf87
[Feature-12040][api][ui] Add authorization management of read and write permissions for project center ( #12048 )
...
[Feature-12040][api][ui] Add authorization management of read and write permissions for project center
2022-10-27 18:01:51 +08:00
53340fc07b
[Feature][UI] Added the display and hide function of dynamically created workflow buttons. ( #12558 )
2022-10-27 14:13:00 +08:00
856083d591
fix ml group ( #12172 )
2022-09-28 18:30:52 +08:00
calvin