Commit Graph

1325 Commits

Author SHA1 Message Date
liyou d983e36ea4
improvement (#15018) 2023-10-12 07:01:04 -05:00
Gallardot 049c1511fa
[Improvement][K8S] K8S task support passing context parameters to downstream task (#14934)
* [Improvement][K8S] K8S task support passing context parameters to downstream task

Signed-off-by: Gallardot <gallardot@apache.org>

* [Improvement][K8S] K8S task support passing context parameters to downstream task

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: update doc img

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: update doc

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: add UT

Signed-off-by: Gallardot <gallardot@apache.org>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-10-08 17:27:10 +08:00
fuchanghai f90eadd40f
[feature-#14449] add secret in k8s Task (#14930)
* [feature-#14449] add secret

* [feature-#14449] upgrade UT and rename parameter ```secret```

* [feature-#14449] fix UT

* [feature-#14449] fix UT

* [feature-#14449] improvement

* [feature-#14449] format

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2023-09-28 11:06:35 +08:00
Eric Gao 1e2fddf958
Fix typo (#14973) 2023-09-27 18:58:55 +08:00
AmriStrong c438d7194c
[Bug] Dependent components cannot be justified and viewed (#14924)
* Dependent components cannot be justified and viewed (dependent components cannot be edited and viewed) #14865

* Dependent components cannot be justified and viewed (dependent components cannot be edited and viewed) #14865  Improve stability

---------

Co-authored-by: AmriStrong <wanggang1@baseus.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-09-18 19:17:23 +08:00
Kerwin 4938470d20
[Fix-14907]Fix click to view the history in the task node of the workflow instance (#14909) 2023-09-13 11:17:10 +08:00
Chenshuai 121c981a5d
[Fix-14788][dolphinscheduler-ui] Fix the task name of dependent node, keyword filtering not supported (#14791)
* fix: filter

* fix: dependent filter

---------

Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-09-12 15:11:00 +08:00
Chenshuai 034e99f5a9
[Fix-14790][dolphinscheduler-ui] Fix the data quality task, keyword filtering not supported (#14792)
* fix: filter

* fix: data-quality task filter rule

---------

Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-09-12 12:35:57 +08:00
sgw 76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent (#14824)
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970)

* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970)

- delete useless output

* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970)

- add log
- run spotless check

---------

Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
2023-09-09 17:23:34 +08:00
yeahhhz 70e384c9fc
[Improvement][UI] Optimize task disable node style in dark theme (#14871)
Co-authored-by: 旺阳 <qingwli@cisco.com>
2023-09-08 07:39:05 +08:00
旺阳 89a55de070
[Bug] [UI] New tasks with the flag normal show a grey color (#14862) 2023-09-07 10:12:44 +08:00
calvin 168a3930fa
[Improvement-14835][UI] Support to immediately adjust the fill color of the task node after changing the run flag of the task. (#14837)
* worked out this issue
2023-09-01 09:01:16 +08:00
yangyang zhong 70731a1617
[Feature][Authentication] support oauth2 login (#14743)
* support oauth2 login

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-21 15:57:30 +08:00
Chenshuai 502bd36fde
fix: filter (#14770)
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-20 14:30:47 +08:00
calvin e2b97c026e
[Improvement][UI] Support to disable or enable the project preferences. (#14756) 2023-08-16 20:20:48 +08:00
Gallardot 150d9e04b0
[Improvement][UI] Image pull policy in the K8S task provides default values (#14650)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-29 19:56:19 +08:00
amao 5ccc4cc889
[Improvement-4375][api] cannot delete yarn queue (#13046)
* [Bug-12833][api]
delete api

* [Bug-12833][api]
delete yarn queue

* [Bug-12833][api]
add Unit Test

* Repair the failed CI

* Repair the failed UT

* Repair the failed Docs

* Repair the failed Doc

---------

Co-authored-by: amao <Guoqing.Mao@Yumchina.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-26 11:52:57 +08:00
Aaron Wang 759756ae80
[Improvement-14269][API] Bind task group with project (#14392)
* [Improvement-14269][API] Bind task group with project

* remove comment

* add project permission check for task group operation

* add doc
2023-07-23 12:11:37 +08:00
calvin fc65c185dc
[Fix-14601][UI] Ironed out the issue with choosing an environment on the task form of both types of DMS and DATASYNC. (#14605)
* worked out this issue
2023-07-20 22:27:28 +08:00
pppppjcc cbfb1cbffb
[Fix-14603] phone Number validate (#14604) 2023-07-20 20:39:54 +08:00
Xinxing 1d0d85b988
[Feature] doris add datasource (#14391)
* Added doris data source plug-in

* Update DbType.java

* XML configuration

* doc and ui

* Missing catch of NumberFormatException

* code format

---------

Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 17:15:22 +08:00
Jay Chung de2d215aee
impv: Correct datax execute and python execute script name (#14523)
* impv: Correct datax execute and python execute script name

we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name

* Add pr number

* fix ut

* style

---------

Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
calvin 50386d622c
worked out the issue (#14588) 2023-07-19 18:46:46 +08:00
Orange Summer af2986eca1
[Feature-14545][Master][UI]Cross workflow parameter passing (#14552)
* feat: cross-workflow parameter passing

* refactor: remove useless parameters

* refactor: remove useless code

* refactor: code format

* docs: update docs

* docs: docs format

* more effective information

Co-authored-by: xiangzihao <zihaoxiang@apache.org>

* more effective information

Co-authored-by: xiangzihao <zihaoxiang@apache.org>

* fix: wrong writing of log code

* fix: perfect error log

---------

Co-authored-by: xiangzihao <zihaoxiang@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-07-19 18:00:44 +08:00
calvin 20cf4ad4e6
[Feature-14505][UI] Support to set project-level preferences (#14573)
* add a few codes about the project preferences
2023-07-19 15:35:54 +08:00
Rick Cheng 9778652f17
[Improvement-14136][task] Support submitting spark-sql task with the sql file in resource center (#14527)
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-19 10:09:30 +08:00
arlendp c0d776381c
[Fix-14531][UI] Tooltip of Chart not show text in light theme mode (#14532)
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-18 17:56:36 +08:00
zyfjrx 4111acb58e
[Bug] [Seatunnel-Task] Run Mode defaults to run, and you cannot select a null value (#14267)
Co-authored-by: zhang <zhangyfcoder@163.com>
2023-07-12 09:06:19 +08:00
旺阳 175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database (#14406)
* add dataquality database api

* change ui

* api change

* update

* fix spotless

* fix h2

* fix pg

* fix-dead-line

* update

* fix-spotless

* update pg sql

* add ut

* fix ut
2023-07-12 09:00:28 +08:00
calvin c3c2dda861
[Improvement-14387][UI] Support to reset user's password. (#14498) 2023-07-11 12:01:49 +08:00
calvin cb0866ca9b
[Fix-14488][UI] When creating a tenant add the strong validation of its tenant code. (#14492) 2023-07-10 13:33:58 +08:00
calvin 92d2b8e33f
[Improvement-14456][UI] When making the process online the system should remind user to take care of its offline timing. (#14460) 2023-07-10 08:46:39 +08:00
Aaron Wang 0b69236b04
[Feature-14251][Task] Support yarn queue definition in yarn task (#14310) 2023-07-07 14:24:47 +08:00
calvin 76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date (#14450) 2023-07-05 14:35:18 +08:00
Aaron Wang 65b6a4b097
[Feature-14421][K8S Task] Configurable image pull policy (#14426) 2023-07-05 09:17:47 +08:00
Rick Cheng 9cbb2629d9
[Improvement-14442][UI] Uniformly set the label name of parameter (#14443) 2023-07-04 14:09:30 +08:00
yeahhhz 0880549440
[Improvement-14318][UI] migrate version 2.x workflow definition d3 tree view to version 3.x (#14382)
* [Improvement][UI] migrate version 2.x workflow definition d3 tree view to version 3.x

* remove unnessnary code

* fix code smells

* update lock file to fix front-end CI Build error

* update package.json
2023-07-04 10:33:27 +08:00
calvin babb8d9d85
worked out this issue (#14438) 2023-07-03 20:50:42 +08:00
Jay Chung 0f190ae3da
chore: Add new step skip for ui build and spotless (#14427) 2023-07-03 20:41:12 +08:00
Aaron Wang bcd1df19b8
[Improvement-14393][Resource Center] Remove deprecated resource description in api and UI page (#14394) 2023-06-28 14:13:20 +08:00
IT-Kwj 7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource (#14404)
---------

Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
2023-06-28 10:56:41 +08:00
Aaron Wang 8a2c05f1ed
[Improvement][UI] Description input box can not input blank (#14396) 2023-06-28 09:15:31 +08:00
Jay Chung 221df4a278
revert: Datasource need test binding to create prod (#14381)
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible

related to https://github.com/apache/dolphinscheduler/pull/11670
2023-06-27 10:59:17 +08:00
Rick Cheng 79b6db74fe
[Improvement-14363][UI] Add Default Branch Flow in switch task (#14364) 2023-06-27 10:29:03 +08:00
pppppjcc 906353bbaf
feat: dynamic-dag-sidebar-change (#14244) 2023-06-19 14:28:53 +08:00
pppppjcc f840b17cfb
[Fix-14171] Add dynamic font sizes to dashboards (#14260)
* feat: Add dynamic font sizes to dashboards

* feat: code review

* feat: change initChart params

* feat: code review

* feat: code review

* feat: build fix
2023-06-15 15:48:29 +08:00
calvin d4921fa2dd
[Feature][UI] Support CRUD of project-level parameters. (#14344) 2023-06-13 18:54:41 +08:00
JieguangZhou e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127)
* add dynamic task plugin

* fix ui

* update code

* add DOC

* ADD UT

* fix doc

* fix sanity check

* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
Rick Cheng 525e441223
[Improvement-14282][Task] Add app_link on the ui of task instance (#14283) 2023-06-07 15:00:12 +08:00
jackfanwan 6b1a952c6b
add if judge (#14290) 2023-06-07 14:57:48 +08:00
Devosend 85b581b232
fix resource center upload file timeout bug (#14268) 2023-06-02 21:15:13 +08:00
Zinway 18d176c5f4
feat: Introduce new datasource vertica (#14232)
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2023-06-02 13:57:37 +08:00
Rick Cheng 767331281a
[Improvement-14255][Project] Remove userName when update project (#14256) 2023-06-02 09:58:22 +08:00
Aaron Wang 4e78248238
[Feature][K8S Task] support node selector (#14126)
* feat: support K8S node selector

* fix CI
2023-05-26 09:21:23 +08:00
calvin c6ac356134
[Improvement-14201][UI] Improve the select component to support users to filter options. (#14202) 2023-05-25 13:12:04 +08:00
calvin 4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. (#14178) 2023-05-24 08:50:53 +08:00
秋天 9979ea3467
[fix-11321][ui] fix create workflow contains chunjun node failed (#11979) 2023-05-22 13:52:32 +08:00
Kerwin 8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150)
* Added a dependent task failure policy in the dependent task node
2023-05-19 14:49:50 +08:00
Jay Chung 56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
calvin 03ff78fdcb
[Improvement-14112][UI] Add a quick link to visit workflow instances of the current workflow. (#14134) 2023-05-18 19:47:02 +08:00
Kerwin 8583de878b
fix error TS2339: Property '' does not exist on type CreateComponentPublicInstance (#14144) 2023-05-18 18:46:42 +08:00
Rick Cheng db2da822de
Add supported operations of workflow definition (#14122) 2023-05-18 10:27:36 +08:00
calvin f384d71da0
[Improvement-14111][UI] Add a tooltip for the copy button of workflow definition. (#14116) 2023-05-16 16:52:48 +08:00
Aaron Wang c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067)
* [Improvement-13868] Support the custom labels for k8s task

* fix front-end type mismatched
2023-05-16 12:04:33 +08:00
He Zhao f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729)
---------

Co-authored-by: weitong <weitong@cisco.com>
2023-05-06 19:30:50 +08:00
imp2002 920e9b80fb
[Fix-13928][UI] Fix repeat CustomParams input box (#14029) 2023-05-06 17:21:56 +08:00
Stalary e932f780b6
FIX: default value (#14059) 2023-05-05 21:57:48 +08:00
Stalary d2f83ee8cf
[Feature] Support run all level dependent when complement (#11778)
* ADD: support all level dependent
* MOD: delete log
* MOD: format
* FIX: ut
* ADD: ut
* format
2023-05-05 14:52:27 +08:00
Bingchang Chen 77e58ce245
[Feature] Add SSO login by Casdoor (#8706) 2023-05-05 14:43:06 +08:00
Aaron Wang 3bad68a942
[Bug-13929][K8S Task] Set command contains single quote is invalid (#13930)
* [Fix-13929][K8S Task] Set command contains single quote is invalid

* fix UT
2023-05-01 11:45:03 +08:00
liyou b451d64696
resource file manager page,repeat onMounted optimize (#14011) 2023-04-25 17:28:58 +08:00
Jeremy db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin (#13866)
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-04-24 21:28:14 +08:00
Aaron Wang 45586f71d5
[BUG][Resource Center] Task can not select main JAR (#13536) 2023-04-18 18:38:16 +08:00
Kerwin 79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935)
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2023-04-18 14:56:38 +08:00
zzm 35bb533a50
[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin (#13861)
---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-04-18 12:18:51 +08:00
He Zhao c0126b7f30
[Feature][plugin] Support Kyuubi datasource (#13642)
---------

Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2023-04-18 11:12:39 +08:00
Aaron Wang 4bf097ee40
[Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath (#13848)
* [Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath

* remove semicolon

* set null in some specific scenario

* remove useless console.log
2023-04-17 11:56:42 +08:00
Wenjun Ruan 2177d70150
Set user default tenant (#13909) 2023-04-13 15:43:24 +08:00
Aaron Wang 16b743c777
[Fix-13802][UI] Display english column name in resource center (#13806) 2023-04-13 13:24:41 +08:00
Kerwin c3de282f31
Fix item, workflow, and task parameters in dependent task nodes can be searched (#13918) 2023-04-13 08:56:38 +08:00
Rick Cheng 1b6dbde470
[Improvement-13884][UI] Improve the UI of flink sql task (#13885) 2023-04-09 11:17:23 +08:00
Assert 4439c1ec90
[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 (#13086) 2023-04-08 22:02:19 +08:00
Wenjun Ruan 64833952fc
Remove the extra default tenant in workflow save page (#13867) 2023-04-04 17:14:40 +08:00
JieguangZhou 273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin (#13801) 2023-03-30 20:17:28 +08:00
calvin 1e8d09e955
improve the select component on the page of workflow relation (#13805) 2023-03-28 18:20:42 +08:00
He Wang 35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675)
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-03-07 10:12:58 +08:00
Aaron Wang 08ca57e4e8
[BUG][UI] Flink task display right version and deploy mode (#13628) 2023-03-02 19:42:16 +08:00
Aaron Wang 047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
Devosend eaf2541018
support modal close for datasources (#13586) 2023-02-20 19:10:38 +08:00
QuantumXiecao dd4804ee4c
[fix-13504] Display the current project name on the left corner of the page (#13572)
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2023-02-17 15:04:38 +08:00
Sheldon 75c5915b78
[Feature-11195][UI] Add re-upload feature for resource files and udf files (#11203)
* add re-upload feature for resource files
* add re-upload feature for udf files

Co-authored-by: sheldonliu <sheldonliu>
2023-02-09 13:51:04 +08:00
Rick Cheng 8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
朱通通 9a6f83383b
[Improvement][task node] #13498 (#13508)
[Improvement][task node] task node includes shell、proceduce、sql、spark、datax、sqoop、flink_stream and so on,those can not select resource file by seraching resources tree #13498
2023-02-07 11:19:02 +08:00
shenyun 8fa90c2d8f
feature flinksql support standalone deploy mode (#13495) 2023-02-05 20:37:56 +08:00
yangyang zhong 615b1dbb37
[bug][UI]Fixed a bug where the environment name of a task could not be changed when a workflow was created(issue-12457) (#13148) 2023-02-02 14:53:21 +08:00
Tq 78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
imizao 23c7363f64
[Refactor][UI]Add a back button when viewing an error file (#13354)
Co-authored-by: imizao <lai.jinwen@vpclub.cn>
2023-01-30 10:06:56 +08:00
Aaron Wang 802bf4a2e0
[Fix-13418][UI] Remove move-task-definition code (#13441)
* remove move task definition

* remove unused DragOutlined
2023-01-30 10:01:59 +08:00
Tq 3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379)
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
2023-01-16 16:21:26 +08:00
LiXuemin a5c6748202
[doc] Remove excess space (#13388)
Remove excess space,from `127.0. 0.1` to `127.0.0.1`
2023-01-12 18:42:15 +08:00