Commit Graph

757 Commits

Author SHA1 Message Date
Jay Chung 109ac5486e [maven-release-plugin] prepare release 3.0.6 2023-05-25 19:44:02 +08:00
Jay Chung 3cea494dba [maven-release-plugin] prepare for next development iteration 2023-03-30 20:27:31 +08:00
Jay Chung dc3c965134 [maven-release-plugin] prepare release 3.0.5 2023-03-30 20:26:22 +08:00
Jay Chung 0a9e72e218 [maven-release-plugin] prepare for next development iteration 2023-03-30 19:33:08 +08:00
Jay Chung ec4dafa057 [maven-release-plugin] prepare release 3.0.5 2023-03-30 19:33:07 +08:00
Jay Chung 7dd7391835 [maven-release-plugin] prepare for next development iteration 2022-12-28 20:11:15 +08:00
Jay Chung 0a4175261e [maven-release-plugin] prepare release 3.0.4 2022-12-28 20:11:14 +08:00
Jay Chung bab80aaba2 [maven-release-plugin] prepare for next development iteration 2022-12-05 16:19:34 +08:00
Jay Chung a3b882a80a [maven-release-plugin] prepare release 3.0.3 2022-12-05 16:19:33 +08:00
EricGao888 934e7f806c [maven-release-plugin] prepare for next development iteration 2022-11-16 21:21:48 +08:00
EricGao888 d2ba3d4cfb [maven-release-plugin] prepare release 3.0.2 2022-11-16 21:21:47 +08:00
EricGao888 ef3669fc3a [maven-release-plugin] prepare for next development iteration 2022-11-16 14:18:18 +08:00
EricGao888 818a256952 [maven-release-plugin] prepare release 3.0.2 2022-11-16 14:18:17 +08:00
Eric Gao c3a98dd9d9
[3.0.2-prepare] Fix issues after cherry-pick and run CI (#12808) 2022-11-11 21:43:08 +08:00
Eric Gao 63f34cc361
[3.0.2-prepare][cherry-pick] Fix python class description error (#12790)
Co-authored-by: chenrj <102030622+xdu-chenrj@users.noreply.github.com>
2022-11-07 19:00:26 +08:00
Eric Gao ce5e32d73d
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264) (#12788)
Co-authored-by: Yann Ann <xiaoqiang.yann@gmail.com>
2022-11-07 18:05:25 +08:00
Eric Gao c9e467f660
[Bug] [Common] update IPv4 Pattern (#11762) (#12739)
* [Bug] [Common] IPv4 Pattern is wrong. #11758

Co-authored-by: Yann Ann <xiaoqiang.yann@gmail.com>
2022-11-06 23:04:40 +08:00
Eric Gao e500dc5b9f
[fix] Validate before deleting workflow or task used by other tasks (#10873) (#12731)
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-11-06 00:06:34 +08:00
zhuangchong 5f85235462 [maven-release-plugin] prepare for next development iteration 2022-09-22 16:10:18 +08:00
zhuangchong cb03ca8166 [maven-release-plugin] prepare release 3.0.1 2022-09-22 16:10:17 +08:00
zhuangchong 364cafe138 [maven-release-plugin] prepare for next development iteration 2022-09-19 13:36:46 +08:00
zhuangchong 17e36b7060 [maven-release-plugin] prepare release 3.0.1 2022-09-19 13:36:45 +08:00
Kerwin 827eb60dbf
cherry-pick S3 Resource center supports bucket customization (#12022)
Co-authored-by: guodong <guodongym@163.com>
2022-09-19 09:50:03 +08:00
Kerwin c4c943277c
[3.0.1-prepare]cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11994)
* cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2022-09-18 14:23:35 +08:00
caishunfeng 5df86d0b7e
[Cherry-pick-3.0.1] #11697 #11400 #11696 (#12023)
* [Cherry-pick-3.0.1][fix-#11691] Add lz4-java in clickhouse datasource. #11697

* [Cherry-pick-3.0.1][fix-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames #11696

* [fix-11378] fix API-Server release response message typo (#11400)

* [fix-11295] remove duplicate classes

* [fix-11378] fix response message error

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>

Co-authored-by: fuchanghai <33984497+fuchanghai@users.noreply.github.com>
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2022-09-17 22:41:15 +08:00
caishunfeng 3ea17820a7
[Cherry-pick-3.0.1][fix-11452][Bug] [Logger Server] Incorrect password regular expression (#11993)
Co-authored-by: jackfanwan <61672564+jackfanwan@users.noreply.github.com>
2022-09-16 15:26:16 +08:00
Kerwin 275b68992c
fix hdfs defaultFs not working (#11823) (#11936) 2022-09-15 15:02:41 +08:00
Kerwin 8123bc4464
cherry-pick Process definition length too long when copy or import #10621 (#11893) 2022-09-14 09:15:53 +08:00
Jiajie Zhong 889fd580e3 [maven-release-plugin] prepare for next development iteration 2022-08-05 18:16:57 +08:00
Jiajie Zhong 9efd1ace78 [maven-release-plugin] prepare release 3.0.0 2022-08-05 18:16:57 +08:00
pinkhello dca87a4b0c [Fixed-10833] [Bug] [Quartz] timezone display doesn't match the next_fire_time in ds 3.0.0-beta1 version (#10865)
* closed [10619]  [Improvement][Master] batch remove TaskInstaceId and workflowInstanceId

* fixed # 10833 timezone display error

* checkstyle

(cherry picked from commit 030fb89d6e)
2022-08-03 19:41:14 +08:00
Sheldon 1f55cc89c1 [Fix-10665] [S3] Fix s3 download method (#10675)
when overwrite param is true and dest file is exist, throw exception
make dirs for ancestor directories of the source file path if it is not exists
To describe the error more clearly, change "the file isn`t exists" to specific error message

Co-authored-by: sheldonliu <sheldonliu>
(cherry picked from commit efd68f4805)
2022-07-28 11:22:31 +08:00
陈家名 4da1240b0e [Python] Supports creating or editing resources. (#10823)
(cherry picked from commit 59cd86157f)
2022-07-28 11:13:48 +08:00
Wenjun Ruan f3250bf5fa Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979)
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed

* Move heartbeat error threshold to applicaiton.yml

(cherry picked from commit 2be1d4bf0a)
2022-07-19 12:23:20 +08:00
Wenjun Ruan b259deb196 [Fix-10854] Fix database restart may lost task instance status (#10866)
* Fix database update error doesn't rollback the task instance status

* Fix database error may cause workflow dead with running status

(cherry picked from commit f639a2eed4)
2022-07-19 12:12:57 +08:00
Wenjun Ruan 71edaf41a2 [Fix-10842] Fix master/worker failover will cause status incorrect (#10839)
* Fix master failover will not update task instance status
* Add some failover log
* Fix worker failover will rerun task more than once
* Fix workflowInstance failover may rerun already success taskInstance

(cherry picked from commit 3f69ec8f28)
2022-07-19 12:08:32 +08:00
Wenjun Ruan 7500e99682 [Fix-10785] Fix state event handle error will not retry (#10786)
* Fix state event handle error will not retry

* Use state event handler to deal with the event

(cherry picked from commit 67d14fb7b3)
2022-07-19 11:52:06 +08:00
Wenjun Ruan db31deb54f [Bug] [Master] Worker failover will cause task cannot be failover (#10631)
* fix worker failover may lose event

(cherry picked from commit 66624c5c86)
2022-07-19 11:41:25 +08:00
Wenjun Ruan fc1c1f6ad1 add CMDPARAM_COMPLEMENT_DATA_SCHEDULE_DATE_LIST 2022-07-19 11:30:47 +08:00
Wenjun Ruan 3ab9ee13fc Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516)
* Optimize master log, add workflow instance id and task instance id in log

* Use MDC to set the workflow info in log4j

* Add workflowInstanceId and taskInstanceId in MDC

(cherry picked from commit db595b3eff)
2022-07-19 11:29:41 +08:00
Wenjun Ruan 90c87f0121 [Fix-10413] Fix Master startup failure the server still hang (#10500)
* Fix Master startup failure the server still hang

(cherry picked from commit 117f78ec4b)
2022-07-19 11:22:53 +08:00
Wenjun Ruan 318a8e3ae0 [Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT

(cherry picked from commit e21d7b1551)
2022-07-19 11:12:28 +08:00
Wenjun Ruan 81cadd15d2 Optimize MasterServer, add MasterRPCService (#10371)
* Optimize MasterServer, avoid NPE

(cherry picked from commit 3ecbee3885)
2022-07-19 11:10:08 +08:00
Wenjun Ruan 4ceb420873 Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479)
* Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe

(cherry picked from commit ad2646ff1f)
2022-07-19 11:02:57 +08:00
juzimao ae4c3ab4e1 [Fix] Fix the JSONUtils tool class time zone problem #10282 (#10284)
* [Fix] Fix the JSONUtils tool class time zone problem #10282

* [Fix] Fix the JSONUtils tool class time zone problem #10282

* Update JSONUtils.java

remove unnessnary log

* Update JSONUtilsTest.java

add timezone import

Co-authored-by: xiangzihao <460888207@qq.com>
2022-07-19 09:47:58 +08:00
juzimao 10c295eae5 [Fix-10641] [Common] Fix the hdfs NPE (#10642)
Fix the hdfs NPE (#10642)
2022-07-18 16:32:54 +08:00
devosend 7ddaa2f47d [maven-release-plugin] prepare for next development iteration 2022-06-28 16:41:31 +08:00
devosend 0a1b9bdd52 [maven-release-plugin] prepare release 3.0.0-beta-2 2022-06-28 16:41:30 +08:00
devosend d68dcda2bb [chore] pre-release change pom.xml 2022-06-28 08:24:21 +08:00
guodong 8edaa6a7de [Fix-10305][common] AWS config Constant definitions are repeated (#10311)
(cherry picked from commit 70dbcb2155)
2022-06-20 11:39:59 +08:00