Commit Graph

5570 Commits

Author SHA1 Message Date
zhuangchong f1a3c52a66 [maven-release-plugin] prepare release 2.0.3 2022-01-20 16:02:58 +08:00
wind f5241e5d27
upgrade version to 2.0.3 (#8130)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-20 15:31:37 +08:00
wind 4748df9990
add delete workflow instance when delete process definition (#8131)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-20 13:21:01 +08:00
wind 05545e1041
[Fix-8098] [UI] Fix resource manage bug (#8107) (#8129)
Co-authored-by: Devosend <devosend@gmail.com>
2022-01-20 10:34:00 +08:00
JinYong Li 6bf8063fe8
[Bug] [dolphinscheduler] fix duplicate key (#8111)
* fix #8043

* fix null when no change

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-19 17:14:41 +08:00
wind 8e9b4a9821
[cherry-pick-2.0.3][Feature][Dag] Number of failed retries and failed retry interval use input component (#8106)
* [Feature][Dag] Number of failed retries and failed retry interval use input component. (#8104)

* delayTime

Co-authored-by: songjianet <1778651752@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-18 19:40:34 +08:00
zwZjut d2bd95d453
[2.0.3][Bug] [dolphinscheduler-remote] process is always running: netty writeAndFlush without retry when failed leads to worker response to master failed (#8081)
* to #8046

* to #8046

* to #8046

* to #8046

* to #8046

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-18 11:40:40 +08:00
wind 5ba55cc55d
Revert "[fix-7712][Docker] support docker-compose 2.X (#7980)" (#8093)
This reverts commit 3b30ed7f51.
2022-01-17 21:44:13 +08:00
songjianet 40762a2ef9
[Feature][Workflow Instance] Add Workflow instalce batch delete reload table list. (#8084) 2022-01-17 15:51:10 +08:00
wind 5158f4a0a9
[Fix-8056] Rectify this issue about failing to edit worker groups for an environment. (#8072) (#8078)
Co-authored-by: calvin <jianghuachinacom@163.com>
2022-01-17 10:52:23 +08:00
wind 0ba4263d90
[2.0.3][Bug-7986] Disable deletion of running workflow (#8064)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-16 18:51:38 +08:00
wind 49ce61e496
fix a few issues (#8063) (#8068)
Co-authored-by: calvin <jianghuachinacom@163.com>
2022-01-16 18:51:27 +08:00
BaoLiang 6d0b5a5837
fix 7732 update is_directory in upgrade sql. (#8055) 2022-01-15 09:10:45 +08:00
songjianet bca7353fe4
[Fix][Dag] Timeout alert. (#8047) 2022-01-14 17:41:08 +08:00
飞到死的鸟 3b30ed7f51
[fix-7712][Docker] support docker-compose 2.X (#7980)
Co-authored-by: HomminLee <lihongmin@ysstech.com>
2022-01-14 17:23:30 +08:00
xiangzihao 59c0abcc27
[Cherry-pick-2.0.3] (#8044)
* resolve conflict

* [Fix-7513] Fix identical numbers and add positive integer judgment (#8032)

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* test

* test

* test

* test

* test

* chinese change

Co-authored-by: Assert <42203474+shangeyao@users.noreply.github.com>
2022-01-14 16:32:27 +08:00
wind 2d3c50cbae
[Bug-7942][Config] update config of master and worker (#7975)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-14 16:11:10 +08:00
calvin cf9e04ce1d
fix a little issue (#8042) 2022-01-14 14:46:11 +08:00
wind 1f0aeabb92
[cherry-pick-2.0.3]Cherry pick to 2.0.3 (#8041)
* [cherry-pick-2.0.3]Correct typo in English README #7695

* Update NOTICE year (#7784)

* [BUG] Repair JDBC connection of Oracle (#7883)

* [cherry-pick-2.0.3][Fix-7538] [server] Fix when there is a forbidden node in dag, the execution flow is abnormal #7613

* [cherry-pick-2.0.3][Fix-7825] Remedy the value of create time and update time to be current time when importing a process json file. #7828

* [FIX-7732][fix] fix column 'is_directory' of table `t_ds_resources` type error in PG database (#7898)

Fix column 'is_directory' of table t_ds_resources type error in PG database
This closes #7732

Co-authored-by: Brennan Fox <brnnnfx@users.noreply.github.com>
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: X&Z <980813351@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: 天仇 <532066967@qq.com>
2022-01-14 14:24:49 +08:00
Jiajie Zhong 600ee5e77c
Remove ambari plugin profile in 2.0.3 (#8011)
We already total remove ambari in dev branch
by #7880, and in version 2.0.2 just remove
ambari plugin directory in #7749. This patch
also remove related profiles of ambari plugin
2022-01-13 23:23:17 +08:00
wind 4d5b5b42a4
[cherry-pick-2.0.3] cherry-pick to 2.0.3 (#8008)
* finished issue#7527 (#7561)

Co-authored-by: 时光 <caizhedong@cai-inc.com>

* [Fix-7713] Handling the sensitive data in the log (#7728)

* add a feature to handle sensitive data

* [cherry-pick-2.0.3]fix-#7740-upgrade_sql #7761

* [cherry-pick-2.0.3][Fix-7203] Remedy the issue about importing a process json file

* [cherry-pick-2.0.3][Fix-7857] The user won't be allowed to disable their own account

Co-authored-by: 时光 <41109695+yikeshiguang@users.noreply.github.com>
Co-authored-by: 时光 <caizhedong@cai-inc.com>
Co-authored-by: calvin <jianghuachinacom@163.com>
Co-authored-by: uh001 <96870549+uh001@users.noreply.github.com>
2022-01-13 22:36:00 +08:00
wind d6d806c3cc
[fix-7671][plugin] Supports whether SQL is placed in the same session for configuration(fix-7671) (#7675) (#8002)
-Supports whether SQL is placed in the same session for configuration

Co-authored-by: mask <39329477+Narcasserun@users.noreply.github.com>
2022-01-13 19:37:58 +08:00
wind 99cfd4864a
fix zk root (#7998)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-13 17:42:20 +08:00
Kerwin dbcf179482
cherry pick Fix process definition versions delete failed #7994 (#7996) 2022-01-13 17:21:06 +08:00
JinYong Li ceae42721f
[cherry-pick-7930][Improvement]support instance to definition (#7939)
* Update ProcessDefinitionMapper.xml (#7931)

Resolves  process definition list issue(data duplication )

* pick 7930

* Update WorkflowExecuteThread.java

* fix pg_ddl

* fix pg_ddl

Co-authored-by: mazhong <316422240@qq.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
2022-01-13 15:39:59 +08:00
Kerwin 7b0617b58d
cherry-pick Fix query workflow history version information error #7988 (#7989) 2022-01-13 13:42:56 +08:00
zwZjut 889274562e
to #7981 (#7982)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-13 11:11:20 +08:00
Wenjun Ruan 584ad1cd17
Fix global params cannot transport into sub_process (#7969) 2022-01-12 20:54:29 +08:00
Kerwin 7b1744baf5
cherry-pick DingTalk alert plugin adds signature. #7805 (#7959) 2022-01-12 18:13:55 +08:00
wind 1642968b34
fix sql filename (#7958)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-12 15:31:45 +08:00
wind 329a37ccee
change soft version to 2.0.3 (#7957)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-12 14:55:52 +08:00
Kerwin ddd516cb96
Create or update users to add tenants cannot be empty verification. #7594 (#7956) 2022-01-12 14:45:17 +08:00
zwZjut f02cde30b8
#7949 (#7953)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-12 13:51:30 +08:00
wind 90a33e06eb
[cherry-pick-2.0.3] cache manager (#7882)
* cherry-pick [DS-6963][MasterServer]add cache manager for tenant and user

* [cherry-pick][Feature-6988][MasterServer] add cache manager for workflow

* [Feature][MasterServer] add cache for workGroup and schedule #6987 (#7161)

* to #6987

* to #6987

* to #6987

* to #6987

* to #6987

* to #6987: @Param -> @Name

* to #6987: fix Sonar

* to #6987: fix Sonar

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* [cherry-pick][Feature-6963][MasterServer] unified cache manager

* [cherry-pick][Bug-7292][ApiServer] fix cache error when standalone

* [cherry-pick][Fix-7245] [API] Fix spelEvaluationException: EL1008E: Property or field 'all' cannot be found

* bugfix

Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-12 11:59:51 +08:00
wind 46a5d17bf6
[cherry-pick-2.0.3][Improvement][TaskLog] Unified task log #7831 (#7926)
* [cherry-pick][Improvement][TaskLog] Unified task log #7831

* [cherry-pick][Improvement][TaskLog] Unified task log #7831

* fix thread name

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-11 22:51:00 +08:00
zwZjut 8dc529d35f
[dolphinscheduler-server] process instance is always running (#7914)
* #7698

* #7698

* #7698

* fix workflow is always running

* fix workflow is always running

* fix workflow is always running

* #7700 #7698

* add license

* fix ut

* #7700 #7698

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-10 18:47:26 +08:00
zwZjut 419f18f8b8
[Feature][dolphinscheduler-dao] expose hikari parameters when deploy on k8s #7910 (#7911)
* #7910

* #7910

* #7910

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-10 15:53:26 +08:00
xiangzihao 6b2ae79d5f
[Fix-7902] The default registration plug-in is missing parameters (#7903)
* add exist check when add task to standby list

Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
2022-01-09 20:11:11 +08:00
xiangzihao be86eaf357
[Cherry-pick-2.0.3] 20220107 (#7871)
* cherry-pick

* fix bug_7629 (#7630)

* fix bug_7564 (#7625)

* fix bug_7512 (#7716)

* [Fix-7459][Sqoop] running error in parallel (#7752)

* fix bug_7459

* fix bug_7459

* fix bug_7459

* fix bug_7459

* fix bug_7459

Co-authored-by: SbloodyS <sbloodys@qq.com>

* [Feature-7576][Master] Optimize complement task's date (#7585)

* feature_7576

* feature_7576

* feature 7576

* feature 7576

* [Fix-7767]Task instance is not deleted while deleting the process instance (#7768)

* fix bug_7767

* fix bug_7767

* fix bug_7767

* fix bug_7767

* fix bug_7767

* [Feature-5951][Improvement][UI] When creating an alarm instance, the alarm instance name input box prompts optimization (#7770)

* cherry-pick

* [Fix-7773][Api] malform batchDeleteProcessInstanceByIds log output (#7774)

* bug_7773

* bug_7773

* bug_7773

* bug_7773

* bug_7773

* [Feature-7777][UI] process definition page add create username (#7778)

* feature_7777

* fix bug_7499 (#7739)

Co-authored-by: SbloodyS <sbloodys@qq.com>

* fix conflict

* fix conflict

* fix mapState never used error

* fix bug_7789 (#7790)

Co-authored-by: SbloodyS <sbloodys@qq.com>

Co-authored-by: SbloodyS <sbloodys@qq.com>
Co-authored-by: wangyizhi <wangyizhi1_yewu@cmss.chinamobile.com>
2022-01-09 16:10:06 +08:00
wind 5592e7bb7b
[Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry (#7808) (#7866)
* [Bug-7788] fix submit duplicate tasks sometimes when retry

* add exist check when add task to standby list

* update

* put queue contain judge first

Co-authored-by: caishunfeng <534328519@qq.com>

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-07 10:42:01 +08:00
lenboo 1d3f77bedb [maven-release-plugin] prepare for next development iteration 2021-12-31 23:32:17 +08:00
lenboo 24ddd07493 [maven-release-plugin] prepare release 2.0.2 2021-12-31 23:32:06 +08:00
Jiajie Zhong d1fcb0e821
[deployment] Drop support Ambari plugins in 2.0.2 (#7749)
Our ambari plugin is only support version before 2.0
and not work in currently version, so we just drop
Ambari directory
2021-12-31 15:12:53 +08:00
mask a668c46e89
[fix-7750]Compatible historical version data source connection information(#7750) (#7751) 2021-12-31 13:49:17 +08:00
kezhenxu94 4d525536f6
Remove init script when gaining a new DB connection (#7748) 2021-12-31 12:03:46 +08:00
lenboo c4eab17bd4 [maven-release-plugin] prepare for next development iteration 2021-12-30 23:00:23 +08:00
lenboo 28cbaf05cb [maven-release-plugin] prepare release 2.0.2 2021-12-30 23:00:12 +08:00
wind 35a1d732c6
[cherry-pick-2.0.2] fix depend task project 202 #7726 (#7727)
* [DS-7654][ApiServer]fix dependent node on change projectCode error

* test

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-30 17:54:39 +08:00
kezhenxu94 6aaecdbd0b
Remove fast return for alert plugins due to bean initialization lifecycle is not determinged
Causing alert sender is not executed
2021-12-30 13:45:55 +08:00
lenboo f5fd29a05d [maven-release-plugin] prepare for next development iteration 2021-12-29 19:42:57 +08:00