Commit Graph

7838 Commits

Author SHA1 Message Date
lgcareer fdb8fde776
[NOTICE]Update the NOTICE year (#14272)
Co-authored-by: lgcareer <lgcareer@apache.org>
2023-06-06 10:25:33 +08:00
Jay Chung dd55de4429
chore: Remove EOL issue version and add prepare one (#14270)
* due to we release the last version of 2.0.x and 3.0.x, we do not
  accept bug report for them now.
* Add new version 3.2.0-prepare for testing the incoming verison
  3.2.0-prepare
2023-06-04 17:12:40 +08:00
Devosend 85b581b232
fix resource center upload file timeout bug (#14268) 2023-06-02 21:15:13 +08:00
Zinway 18d176c5f4
feat: Introduce new datasource vertica (#14232)
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2023-06-02 13:57:37 +08:00
Rick Cheng 767331281a
[Improvement-14255][Project] Remove userName when update project (#14256) 2023-06-02 09:58:22 +08:00
Eric Gao e86630bb7b
[Improvement][Metrics] Add more worker related metrics and fix some previous ones (#14254)
* Add more worker related metrics and fix some previous ones

* update metrics docs
2023-06-01 16:54:48 +08:00
alexBaiJW d67fe52c33
Fix the perm setting for the process definition import function (#14239)
* Fix the perm setting for the process definition import function

* fix the style issue
2023-06-01 15:59:02 +08:00
Rick Cheng 8aec3846b4
[Improvement-14243][Metrics] Add user tag of response time of api server (#14248) 2023-06-01 15:13:28 +08:00
Wenjun Ruan 5e9f1de075
Remove state check for dependent/subProcess in StateWheelExecuteThread (#14242) 2023-05-31 16:39:12 +08:00
Jay Chung 7226edd04e
chore: Release version 3.0.6 (#14234) 2023-05-30 10:36:58 +08:00
scorpig b8748e29ae
Fix TreeView "Task Status" not show bug and compatibility with older versions (#14207)
use WorkflowExecutionStatus.name()
2023-05-29 13:39:38 +08:00
Aaron Wang 9e0991145e
[Improvement-14146][K8S Task] print complete error logs in task log file (#14147) 2023-05-27 17:39:03 +08:00
Rick Cheng 1011852ab2
[Improvement-14195][Parameter] remove misleading comment of combining local and global parameter (#14196) 2023-05-26 09:29:09 +08:00
Aaron Wang 4e78248238
[Feature][K8S Task] support node selector (#14126)
* feat: support K8S node selector

* fix CI
2023-05-26 09:21:23 +08:00
Kerwin fa4a4f6938
Added 3.1.7 release document (#14206) 2023-05-25 18:08:04 +08:00
Wenjun Ruan d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed (#14200)
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed

* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2023-05-25 14:42:32 +08:00
calvin c6ac356134
[Improvement-14201][UI] Improve the select component to support users to filter options. (#14202) 2023-05-25 13:12:04 +08:00
haibingtown af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099)
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
2023-05-25 11:02:39 +08:00
Aaron Wang 41e3ce35a7
fix: disordered comments in values.yaml (#14197) 2023-05-24 21:06:18 +08:00
Wenjun Ruan deca0a7ea1
Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed (#14162)
* Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/execute/MasterTaskExecuteRunnable.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-05-24 13:49:32 +08:00
Zzih 43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() (#14188)
* optimize checkBucketNameExists

* fix code style

---------

Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2023-05-24 13:43:44 +08:00
calvin 4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. (#14178) 2023-05-24 08:50:53 +08:00
Rick Cheng 5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server (#14177) 2023-05-23 12:22:49 +08:00
Rick Cheng 0ab2447d58
[Improvement-14080][script] cleanup dist directory at the beginning of check-LICENSE.sh (#14081) 2023-05-23 10:52:50 +08:00
Aaron Wang 708086c8fe
fix: PULL_REQUEST_TEMPLATE.md dead link (#14163) 2023-05-23 09:44:04 +08:00
Aaron Wang 5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default (#14145) 2023-05-22 20:48:40 +08:00
Rick Cheng 428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
秋天 9979ea3467
[fix-11321][ui] fix create workflow contains chunjun node failed (#11979) 2023-05-22 13:52:32 +08:00
Alex Ting 606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql (#13378)
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .

for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})

after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
2023-05-22 11:19:30 +08:00
Wenjun Ruan 05df0269f6
Fix task exception might not exist in task instance log (#14085) 2023-05-21 09:55:35 +08:00
Kerwin 8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150)
* Added a dependent task failure policy in the dependent task node
2023-05-19 14:49:50 +08:00
Jay Chung 56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
calvin 03ff78fdcb
[Improvement-14112][UI] Add a quick link to visit workflow instances of the current workflow. (#14134) 2023-05-18 19:47:02 +08:00
Kerwin c6512edc3a
revert [fix-#13956] [Master]taskId is null cause NPE #13980 (#14142) 2023-05-18 19:28:27 +08:00
Kerwin 503d54aff9
Fix dependent task nodes in workflow instances cannot display data (#14141) 2023-05-18 19:24:53 +08:00
Kerwin 8583de878b
fix error TS2339: Property '' does not exist on type CreateComponentPublicInstance (#14144) 2023-05-18 18:46:42 +08:00
fuchanghai 67f50e3904
[fix-#13940] add status of ``` stop``` in class of TaskExecutionStatus (#14016) 2023-05-18 13:31:02 +08:00
Rick Cheng db2da822de
Add supported operations of workflow definition (#14122) 2023-05-18 10:27:36 +08:00
calvin f0881b65a1
fix syntax errors (#14124) 2023-05-17 08:59:24 +08:00
Aaron Wang 74ed7856bc
[Bug-14105][Task] Replace default tenant when downloading resource (#14106) 2023-05-16 18:11:58 +08:00
calvin f384d71da0
[Improvement-14111][UI] Add a tooltip for the copy button of workflow definition. (#14116) 2023-05-16 16:52:48 +08:00
Aaron Wang c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067)
* [Improvement-13868] Support the custom labels for k8s task

* fix front-end type mismatched
2023-05-16 12:04:33 +08:00
Jay Chung 2124a95081
chore: roadmap should not label stale (#14103) 2023-05-15 17:45:22 +08:00
Aaron Wang 1e3ae7b942
[improv][Resource Center] Implement getResourceFileName in StorageOperator (#14097) 2023-05-15 14:02:30 +08:00
Kerwin 8944fdc622
Added 3.1.6 release document (#14100) 2023-05-15 11:25:45 +08:00
JieguangZhou a3b2cc0275
[CI] Try fix api test error (#14094)
* try fix api test error

* add workergroupapitest to ci and fix log output

* fix log output

* skip remote shell UT

---------

Co-authored-by: SbloodyS <460888207@qq.com>
2023-05-12 21:39:00 +08:00
openopen2 fc97118bdc
[Doc] Fix upgrade-schema.sh cannot load driver class (#14072)
* fix upgrade-schema.sh cannot load driver class

When initializing and creating related tables for the first time, the support of related jdbc drivers is required. This article omits placing jdbc drivers in the tools directory.

* Update datasource-setting.md

update english doc
2023-05-10 13:44:23 +08:00
Drake Youngkun Min 801216bd35
RECOVER_TOLERANCE_FAULT_PROCESS CommandType needs the start parameters (#13958) 2023-05-10 13:02:21 +08:00
He Zhao f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729)
---------

Co-authored-by: weitong <weitong@cisco.com>
2023-05-06 19:30:50 +08:00
Rick Cheng 3eb4c0ed1d
[Improvement-14054][Worker] Kill multiple yarn apps at the same time (#14055)
* [Improvement-14054][Worker] Kill multiple yarn apps at the same time

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/YarnApplicationManager.java

Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-05-06 19:13:12 +08:00