natas_hw
/
dolphinscheduler
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,056 Commits 27 Branches 54 Tags 416 MiB
Commit Graph

8056 Commits

Author SHA1 Message Date
dalong 6dbd235a88
[Bug] [docs] doc MinIO write wrong #15394 (#15418) 
Co-authored-by: 86157 <mapengfei@lnxjit.commapengfei@lnxjit.com>
 2024-01-03 18:40:28 +08:00
Jay Chung e648d6d2ad [maven-release-plugin] prepare for next development iteration 2023-10-11 16:59:09 +08:00
Jay Chung f64b254809 [maven-release-plugin] prepare release 3.2.0 2023-10-11 16:59:08 +08:00
dbac ef003c6211 Pre release change 2023-10-11 16:29:47 +08:00
Jay Chung 6d7dbe6733
Reduce the size of tarball to continue ASF release (#15004) 
* Reduce the size of tarball to continue ASF release

for more detail you can see https://lists.apache.org/thread/rmp7fghlj0n7h9y2v3p8gkw9f9qbo6qt

* rename the new module

* spotless

* license

* fix api test

* fix api test
 2023-10-11 16:19:25 +08:00
Gallardot a8272b2606 [Doc]fix typo (#15005) 
(cherry picked from commit 23b2c8a532)
 2023-10-11 15:59:16 +08:00
旺阳 33305532bf [Improvement][Alert] HTTP Related Alert plugin add retry logic (#14972) 
* add RetryHandler for http client

* fix spotless

* update

(cherry picked from commit a866de1754)
 2023-10-11 15:59:03 +08:00
Gallardot 7b43c66811 [Feature][Helm] Supports deploying only partial components (#14985) 
* [Feature][Helm] Supports deploying only partial components

* chore: add doc

* chore: miss some doc

(cherry picked from commit 4fe41ac57f)
 2023-10-11 15:58:46 +08:00
Gallardot a1a041082d [Improvement][K8S] K8S task support passing context parameters to downstream task (#14934) 
* [Improvement][K8S] K8S task support passing context parameters to downstream task

Signed-off-by: Gallardot <gallardot@apache.org>

* [Improvement][K8S] K8S task support passing context parameters to downstream task

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: update doc img

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: update doc

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: add UT

Signed-off-by: Gallardot <gallardot@apache.org>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

* merge suggestion

Co-authored-by: 旺阳 <wang@lqwang.net>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit 049c1511fa)
 2023-10-11 15:58:18 +08:00
Gallardot 9190f23133 [Improvement][Task] Mask password in task log (#14988) 
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit 2a65590117)
 2023-10-11 15:57:50 +08:00
Wenjun Ruan 512f94070a Fix task log appender will not be closed immediate after throwing exception (#14989) 
(cherry picked from commit 629fced9ef)
 2023-10-11 15:57:19 +08:00
winghv f2c68bc97a [Improvement][Common] Obtain resource information in the k8s environm… (#14968) 
* [Improvement][Common] Obtain resource information in the k8s environment.

* [Improvement][Common] Change the comment

---------

Co-authored-by: 旺阳 <qingwli@cisco.com>
(cherry picked from commit c5bc535b85)
 2023-10-11 15:56:39 +08:00
fuchanghai c2dd874c82 [feature-#14449] add secret in k8s Task (#14930) 
* [feature-#14449] add secret

* [feature-#14449] upgrade UT and rename parameter ```secret```

* [feature-#14449] fix UT

* [feature-#14449] fix UT

* [feature-#14449] improvement

* [feature-#14449] format

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
(cherry picked from commit f90eadd40f)
 2023-10-11 15:56:27 +08:00
Eric Gao 333866489a Fix typo (#14973) 
(cherry picked from commit 1e2fddf958)
 2023-10-11 15:56:10 +08:00
旺阳 62275e932d [Bug] [Api] Logback file STDOUT duplicate (#14966) 
(cherry picked from commit 8cb765bdcb)
 2023-10-11 15:55:58 +08:00
Kerwin cb80df4570 Fix the error of using shell task to obtain Home variable in Ubuntu system. (#14964) 
(cherry picked from commit 6de1e2c1b3)
 2023-10-11 15:55:43 +08:00
Wenjun Ruan 2fb488f4ac Set charset in upgrading tools to solve read upgrade sql mojibake (#14955) 
(cherry picked from commit 020092ed1e)
 2023-10-11 15:55:23 +08:00
Chenshuai 6b36354ba3 [Improvement-14894][dolphinscheduler-alert] alert message contains the operator (#14910) 
* feat: add operator in alert info

* fix: optimize get user info directly

* fix: also optimize get user info directly

* fix: code style

* fix: code style

* fix: update test case

* fix: code check style

---------

Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit 4b5eb1a2bb)
 2023-10-11 15:54:15 +08:00
LiuCanWu 06a555e494 fix the #14729 problem (#14902) 
Co-authored-by: 刘阳 <liuy2590@chinaunicom.cn>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit e748c2eb9a)
 2023-10-11 15:52:42 +08:00
AmriStrong 23f6494ad6 [Improvement][Api]Change default zookeeper timeout setting (#14940) 
* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* reported connection timeout #14939  Adjust the connection  timeout time use the curator default setting

---------

Co-authored-by: AmriStrong <wanggang1@baseus.com>
(cherry picked from commit b303648752)
 2023-10-11 15:52:27 +08:00
Aaron Wang 3ef25e50cc [Fix-14895][API] Keep printing null if task log file not exist (#14912) 
(cherry picked from commit 2f2884fd6b)
 2023-10-11 15:51:55 +08:00
Yhr-N 87d6092ef9 [Fix-14546] seatunnel unable submit spark job to spark (#14617) 
(cherry picked from commit 9083f9d0e0)
 2023-10-11 15:50:45 +08:00
dong6349 60b9abba18 Fix the ephemeralId will not be deleted before jdbc-registry closed. (#14936) 
(cherry picked from commit 298b8ccf5a)
 2023-10-11 15:50:26 +08:00
AmriStrong fb7fab0ecd [Bug] Dependent components cannot be justified and viewed (#14924) 
* Dependent components cannot be justified and viewed (dependent components cannot be edited and viewed) #14865

* Dependent components cannot be justified and viewed (dependent components cannot be edited and viewed) #14865  Improve stability

---------

Co-authored-by: AmriStrong <wanggang1@baseus.com>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit c438d7194c)
 2023-10-11 15:50:13 +08:00
fuchanghai 4eae5e224f [fix-#14918] add missing ddl (#14921) 
(cherry picked from commit e3482fbe5d)
 2023-10-11 15:50:02 +08:00
Chenshuai 6d1e9d37c4 feat: add task priority in alert info (#14919) 
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
(cherry picked from commit 6dcc26f52e)
 2023-10-11 15:49:26 +08:00
Gallardot 12baee69d8 [Bug][Worker] Global and local parameters are not replaced in SQL components (#14926) 
Signed-off-by: Gallardot <gallardot@apache.org>
(cherry picked from commit f6a6794289)
 2023-10-11 15:49:23 +08:00
Aaron Wang 8097d74663 [Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change (#14887) 
(cherry picked from commit 73e846d03e)
 2023-10-11 15:49:20 +08:00
Kerwin 3b3e2f1712 [Fix-14907]Fix click to view the history in the task node of the workflow instance (#14909) 
(cherry picked from commit 4938470d20)
 2023-10-11 15:48:15 +08:00
calvin b77d5c4b88 [Improvement][API] Support to check if the worker group has been used by any tasks or schedulers when users delete or rename it. (#14893) 
(cherry picked from commit a070aa93a7)
 2023-10-11 15:47:53 +08:00
JueLance 06e5b21b4f Fix java.sql.Date serialize error by convert it to java.util.Date (#13050) 
(cherry picked from commit e7c579d8f1)
 2023-10-11 15:47:27 +08:00
Chenshuai 82926f1850 [Fix-14790][dolphinscheduler-ui] Fix the data quality task, keyword filtering not supported (#14792) 
* fix: filter

* fix: data-quality task filter rule

---------

Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit 034e99f5a9)
 2023-10-11 15:45:40 +08:00
Hunter e2c8815457 fix(dolphinscheduler-alert): fix create http request error (#14793) 
request type should use equalsIgnoreCase to equal,msg should add URLEncoder.encode

Co-authored-by: hunter-cloud09 <liuhunter09@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
(cherry picked from commit 3c71fb05f6)
 2023-10-11 15:44:26 +08:00
Jay Chung e71ae0da55 [Bug][Worker] Fix sql/shell task doesn't replace parameter (#14876) 
Fix parameter assign error, fix #14869 which including
* shell task param not work, botch local and global
* others task chain assign not work

(cherry picked from commit 3fa69d2db8)
 2023-10-11 15:44:01 +08:00
yeahhhz eb9a6ab4ce [Improvement][UI] Optimize task disable node style in dark theme (#14871) 
Co-authored-by: 旺阳 <qingwli@cisco.com>
(cherry picked from commit 70e384c9fc)
 2023-10-11 15:43:58 +08:00
Nothing Chan 5270cc62a4 [Improvement][doc] fix typo in readme (#14878) 
(cherry picked from commit f3a4842bf6)
 2023-10-11 15:43:28 +08:00
gaopeng 6c1d14dcfe [Fix-14811][fix] Fix when using Casdoor SSO, ldap, OAuth2 to log in, the tenant problem of not specifying the currently logged in user (#14812) 
(cherry picked from commit 5062aa12da)
 2023-10-11 15:42:58 +08:00
Aaron Wang fd00bb605a [Fix][Resource Center] Remove NONE storage type and set LOCAL type as default (#14661) 
(cherry picked from commit b12df72a0c)
 2023-10-11 15:42:29 +08:00
Wenjun Ruan 121bb3d854 Fix session/thread leak at ssh datasource (#14859) 
(cherry picked from commit bc4326125d)
 2023-10-11 15:41:52 +08:00
旺阳 984eebd0c4 [Bug] [UI] New tasks with the flag normal show a grey color (#14862) 
(cherry picked from commit 89a55de070)
 2023-10-11 15:41:35 +08:00
lamberken 3a749d0109 [Improve] Fix placeholders should match arguments in log statement (#14850) 
(cherry picked from commit 11c8e0bdf1)
 2023-10-11 15:40:58 +08:00
Aaron Wang ce935c5c99 chore: add revert label check (#14853) 
(cherry picked from commit 6406243db0)
 2023-10-11 15:40:21 +08:00
gaopeng fdc2421817 [Feature-14802][api] Use Casdoor SSO to log in, add admin user configuration (#14814) 
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* update doc

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
(cherry picked from commit adf49fd23f)
 2023-10-11 15:38:23 +08:00
Jay Chung 9d4f9a7457 feat: Add others scopes for release tool (#14844) 
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
(cherry picked from commit 46c0eb48c6)
 2023-10-11 15:37:50 +08:00
calvin baf7b5ef45 [Improvement-14835][UI] Support to immediately adjust the fill color of the task node after changing the run flag of the task. (#14837) 
* worked out this issue

(cherry picked from commit 168a3930fa)
 2023-10-11 15:37:01 +08:00
eye-gu ab306cedd5 [Fix-14149][master] task finished so not dispatch (#14161) 
(cherry picked from commit 7ae4fb3787)
 2023-09-01 15:19:42 +08:00
eye-gu 8c451a0e19 [Fix-14828][master] check task id not null to avoid NPE (#14829) 
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
(cherry picked from commit 33525a17c3)
 2023-09-01 15:19:34 +08:00
Zinway fb792849e1 fix invalid registry path ends with 'master' or 'worker' (#14328) 
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
(cherry picked from commit 96041e3876)
 2023-09-01 15:19:18 +08:00
Jay Chung 793b9a8ea0 chore: Correct db upgrade and add ci avoid regression (#14620) 
add atlasgo to ci
https://atlasgo.io/declarative/diff
related: https://github.com/apache/dolphinscheduler/issues/11286

BTW, it seems some ddl change only exist in 3.1.3、3.1.5、3.1.6 but do not exist in dev which will also cause an error when updating from those version

(cherry picked from commit 25e841a228)
 2023-08-30 17:13:04 +08:00
eye-gu 07c52903d9 [Improvement-14658][etcd] Distinguish between add and update by using pre kv (#14659) 
Co-authored-by: eye <eye.gu@aloudata.com>
(cherry picked from commit 3148dba7a5)
 2023-08-30 17:12:30 +08:00