Commit Graph

371 Commits

Author SHA1 Message Date
天仇 90ea6ebb6f
[Improvement-7907][refactor] Optimization for query task instances list when build dag flow (#7915)
Optimization for query task instances list when build dag flow
This closes #7907
2022-01-16 22:30:09 +08:00
Assert 12d7e6261e
[Improvement][MasterServer] process complement data optimization #7925 (#7976)
* [Improvement][MasterServer] process complement data optimization #7925

* [Improvement][MasterServer] process complement data optimization #7925

Co-authored-by: shangeyao <sgy960921>
2022-01-13 10:42:28 +08:00
wind a8c592bd93
[Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry (#7809)
* [Bug-7788] fix submit duplicate tasks sometimes when retry

* [Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-11 22:54:42 +08:00
JinYong Li 24a97fda75
[Bug] [dolphinscheduler-api]support workflow instance to definition (#7930)
* add task save and  binds workflow

* add task update with upstream

* support workflow instance to definition

* fix ut
2022-01-11 14:41:45 +08:00
wind e4cdd82b7c
[Improvement][TaskLog] Unified task log (#7831)
* task logger

* update

* log format

* remove master config task-logger

* udpate log level

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-07 21:04:54 +08:00
wind 4b22ad6cf6
[Implement][MasterServer]TaskProcessor code optimization (#7754)
* task processor optimization

* fix test

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-04 13:38:31 +08:00
aaronlinv 707e3a6ec1
[Improvement][Logger] Logger server integrate into master and worker (#6894) 2021-12-30 16:29:22 +08:00
wind d3bd7309fb
[Bug-7686][Server]fix restart server after kill force (#7688)
* [DS-7686][Server]fix restart server after kill force

* update registry logic

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-29 15:35:03 +08:00
aaronlinv 9a1cea402e
[Fix-7062][MasterServer] NPE when run switch conditions sub-process (#7687) 2021-12-29 10:58:23 +08:00
wind 8808c0a700
[Bug-7474][MasterServer] fix failover when node host is null (#7475)
* fix failover when node host is null

* add failover execute thread

* worker handle dead server

* fix task instance failover time check

* fix upgrade sql

* failover logic update

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-28 19:32:10 +08:00
lhjzmn 3af4d765c2
[Fix-7538] [server] Fix when there is a forbidden node in dag, the execution flow is abnormal (#7613)
* when there is a forbidden node in dag, the execution flow is abnormal
Co-authored-by: hongjie.li <hongjie.li@dmall.com>
2021-12-28 18:37:59 +08:00
Assert e172015cd3
fix conflict pr 6997 (#7571)
Co-authored-by: shangeyao <sgy960921>
2021-12-27 12:03:27 +08:00
wangxj3 9e763ad0d1
[Feature-#6422] [api-server] task group queue (#7491)
* add task group

* modify task group

* pull dev

* add license header

* modify code style

* fix code style

* fix sql error

* fix error

* fix test

* fix test

* fix test

* fix test

* fix code style

* fix ut

* code style

* fix unit test

* test ut

* ut

* add unittest

* test ut

* modify back ut

* majorization code

* fix conflict

* fix ut

* add task group api

* reset file

* fix ut

* fix lost column

* fix ut

* fix ut

* fix ut

* fix ut

* delete duplicate code

* fix code style 、name

* fix ut

* fix mapper

Co-authored-by: wangxj <wangxj31>
2021-12-24 16:37:59 +08:00
xiangzihao 1efa85ca27
[Fix-7534][Master] zookeeper failover error (#7562)
* fix bug_7534

* fix bug_7534

* fix bug_7534

* fix bug_7534

* fix bug_7534

* fix bug_7534

Co-authored-by: SbloodyS <sbloodys@qq.com>
2021-12-24 11:40:21 +08:00
SbloodyS 9f56123a26
fix bug_7537 (#7551)
Co-authored-by: SbloodyS <sbloodys@qq.com>
2021-12-22 20:21:52 +08:00
Kerwin b23f756c22
[Fix-7146][server]Fix the task processor thread is not safe. (#7488)
* Fix the task processor thread is not safe.

* fix code style
2021-12-20 17:58:57 +08:00
wind 41bf1a955e
[Improvement-7213][MasterServer] execute thread pool code optimization (#7258)
* threadpool optimization

* threadpool params

* rebase dev

* ut check fix

* add return

* rebase dev

* event loop

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-16 23:45:32 +08:00
wind 1cbc86b9e6
add task-logger config (#7423)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-16 16:14:46 +08:00
wind 99b8ec6492
[Bug-7319][MasterServer] fix taskNode NPE when switch else branch is empty (#7320)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-13 22:46:48 +08:00
Kerwin 939fa0c3ba
fix TaskResponseProcessor process NullPointerException (#7318) 2021-12-10 16:55:56 +08:00
kezhenxu94 67cc260d52
Split the components into individual package, refactor configurations to use Spring properties (#7160)
* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
2021-12-10 11:28:53 +08:00