Commit Graph

7685 Commits

Author SHA1 Message Date
He Wang 35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675)
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-03-07 10:12:58 +08:00
Wenjun Ruan c9066e8de9
Use MDC to filter task instance log (#13673)
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2023-03-06 17:44:23 +08:00
陈家名 a8e3deca8b
[Improvement][api] Remove unless code in ResourcesServiceImpl (#13676)
* remove unless code in ResourcesServiceImpl

---------

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2023-03-06 10:40:17 +08:00
陈家名 c2d5774790
[Improvement] SQL optimization queryTheHighestPriorityTasks (#13671)
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2023-03-05 22:35:24 +08:00
Aaron Wang fd720880c7
[Improvement] Add missing placeholder (#13663)
* Add missing placeholder

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/KubernetesApplicationManager.java

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>

---------

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2023-03-03 18:02:46 +08:00
iuhoay b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path (#13641) 2023-03-03 09:34:44 +08:00
Wenjun Ruan ca9df868f1
Fix task instance log order might be wrong due to async print (#13660) 2023-03-02 22:37:05 +08:00
Aaron Wang 08ca57e4e8
[BUG][UI] Flink task display right version and deploy mode (#13628) 2023-03-02 19:42:16 +08:00
Rick Cheng 7c97febefb
[Improvement-12697][UT] Improve the ProjectServiceTest (#12698) 2023-03-01 11:37:52 +08:00
Rick Cheng eb4cba8884
[Improvement-12782][UT] Add UT for the 13 implementations of ResourceAcquisitionAndPermissionCheck (#12784) 2023-03-01 11:37:19 +08:00
旺阳 43d79e45b4
Fix data quality pwd error (#13643) 2023-02-28 18:50:44 +08:00
QuantumXiecao 7586710d49
[fix-13625] Modify systemd-run from MemoryMax to MemoryLimit for more generality (#13627)
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2023-02-28 14:17:54 +08:00
Jay Chung c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs (#13607)
* doc: new quick start doc with more detail and gif

copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22

and the chinese translate by Google Translate

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-02-28 11:20:28 +08:00
kezhenxu94 9668c84d30
Fix typo (#13632) 2023-02-27 10:12:14 +08:00
kezhenxu94 f937c511b1
Publish Docker images to docker hub when released (#13631) 2023-02-27 09:24:28 +08:00
Kerwin 9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc (#13621) 2023-02-25 11:24:43 +08:00
Qi Zhang 6516240e0c
[Docs] Update rainbond docs (#13608)
Signed-off-by: Qi Zhang <smallqi1@163.com>
2023-02-24 16:52:43 +08:00
Wenjun Ruan 4351a25f2a
Add execute function to handle the workflow instance operation (#13610) 2023-02-24 13:47:41 +08:00
Aaron Wang 938f13b568
[Doc] Spark on K8S (#13605) 2023-02-23 10:31:34 +08:00
Rick Cheng 0db916473e
[Improvement-13437][UT] Add UT for S3StorageOperator (#13530) 2023-02-22 19:57:18 +08:00
fuchanghai 79d3ed0744
Update DataxUtils.java (#13604) 2023-02-22 19:01:43 +08:00
fuchanghai 7bf3e3cdd6
[improve-#13201] update pid during running (#13206) 2023-02-22 14:22:49 +08:00
fuchanghai c406f81e9c
[improve-#13597] fix the method name (#13599) 2023-02-22 10:53:51 +08:00
Aaron Wang 047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
旺阳 aea84055fe
Fix webex teams alert plugin null exception error (#13591) 2023-02-21 20:10:48 +08:00
Devosend eaf2541018
support modal close for datasources (#13586) 2023-02-20 19:10:38 +08:00
fuchanghai 701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop (#13051)
* [improve-#13045] add max submit number of workflow

* [fix-13405] remove max times

* Update dolphinscheduler-master/src/main/resources/application.yaml

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2023-02-20 14:10:59 +08:00
Wenjun Ruan e8b20def54
Fix task instance will generate multiple times when retry interval is 0/s (#13571) 2023-02-18 23:41:16 +08:00
QuantumXiecao dd4804ee4c
[fix-13504] Display the current project name on the left corner of the page (#13572)
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2023-02-17 15:04:38 +08:00
qindongliang 6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml (#13354) (#13560) 2023-02-14 12:53:49 +08:00
Rick Cheng 2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS (#13332) 2023-02-13 16:38:26 +08:00
kezhenxu94 a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` (#13547) 2023-02-11 16:35:57 +08:00
Aaron Wang 966201af86
[BUG][Resource Center] NPE caused by uninitialized hdfsProperties (#13540)
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties

* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
2023-02-11 13:12:44 +08:00
kezhenxu94 e368bde7ee
Publish Helm Chart snapshot to ghcr.io (#13546) 2023-02-11 12:40:35 +08:00
fuchanghai 37939add0c
[fix-13492]add single quotes (#13534)
* [fix-13492]add single quotes

* [improve-#13201] fix test error

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2023-02-09 19:02:27 +08:00
caishunfeng df963f8393
[Improvement] Add call cost time for api (#13518) 2023-02-09 14:29:23 +08:00
Sheldon 75c5915b78
[Feature-11195][UI] Add re-upload feature for resource files and udf files (#11203)
* add re-upload feature for resource files
* add re-upload feature for udf files

Co-authored-by: sheldonliu <sheldonliu>
2023-02-09 13:51:04 +08:00
Bingchang Chen 75544025df
[Improvement] Fix typos in tools for demo (#13538) 2023-02-09 12:13:36 +08:00
Wenjun Ruan 133d1733eb
Alter title in t_ds_alert to 512 (#13535) 2023-02-09 09:41:07 +08:00
JieguangZhou 16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529)
* support http output response as param

* add UT

* fix sqoop UT
2023-02-08 23:03:21 +08:00
Aaron Wang f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources (#13512) 2023-02-08 10:20:08 +08:00
seedscoder 8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
kezhenxu94 57db06e1b0
Fix the parameter table is messed up (#13526) 2023-02-07 13:45:10 +08:00
Rick Cheng 8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
朱通通 9a6f83383b
[Improvement][task node] #13498 (#13508)
[Improvement][task node] task node includes shell、proceduce、sql、spark、datax、sqoop、flink_stream and so on,those can not select resource file by seraching resources tree #13498
2023-02-07 11:19:02 +08:00
xiaojingXU 3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api (#13475)
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool

* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
shenyun 8fa90c2d8f
feature flinksql support standalone deploy mode (#13495) 2023-02-05 20:37:56 +08:00
旺阳 0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
dddyszy 19ffd64e23
Fix complement data date order will change due to use set (#13487) 2023-02-03 19:44:45 +08:00
Wenjun Ruan 5a9cb7ee64
Fix task log might delay until task finished due to batch flush (#13502) 2023-02-02 21:48:03 +08:00