natas_hw
/
dolphinscheduler
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,926 Commits 27 Branches 54 Tags 416 MiB
Commit Graph

551 Commits

Author SHA1 Message Date
旺阳 d414f2631b [Feature][Data Quality] Data Quality Support Choose Database (#14406) 
* add dataquality database api

* change ui

* api change

* update

* fix spotless

* fix h2

* fix pg

* fix-dead-line

* update

* fix-spotless

* update pg sql

* add ut

* fix ut

(cherry picked from commit 175d976cd2)
 2023-07-20 11:30:20 +08:00
Wenjun Ruan ded332c0e1 Polish config, expose rpc config in application.yml (#14501) 
(cherry picked from commit 0246327083)
 2023-07-20 11:30:07 +08:00
Wenjun Ruan e801e5dd57 Use jvm_args_env.sh to set JVM args (#14487) 
(cherry picked from commit 406aeaf659)
 2023-07-20 11:29:58 +08:00
Rick Cheng 0878578255 [Feature-14339][Parameter] Add parameter combining of project-level parameters (#14452) 
(cherry picked from commit 3de0b5a38c)
 2023-07-20 11:29:45 +08:00
Aaron Wang a99596a2df [Feature-14251][Task] Support yarn queue definition in yarn task (#14310) 
(cherry picked from commit 0b69236b04)
 2023-07-20 11:29:21 +08:00
Aaron Wang 09e0a11f21 [Feature-14421][K8S Task] Configurable image pull policy (#14426) 
(cherry picked from commit 65b6a4b097)
 2023-07-20 11:26:28 +08:00
Jay Chung da79a64316 chore: Add new step skip for ui build and spotless (#14427) 
(cherry picked from commit 0f190ae3da)
 2023-07-20 11:24:57 +08:00
QuakeWang 5d04238b13 fix issue#14375 (#14435) 
add sqoop config in website

(cherry picked from commit 8f3d354c3c)
 2023-07-20 11:24:54 +08:00
旺阳 28c2ec8e4b [Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration (#14349) 
(cherry picked from commit f186cd5dab)
 2023-07-20 11:24:49 +08:00
Eric Gao 5d263b563f [Bug][Doc] Fix dead link in api test docs (#14419) 
(cherry picked from commit 3c04d5c4fa)
 2023-07-20 11:24:41 +08:00
Aaron Wang 63441d1222 [Improvement-14393][Resource Center] Remove deprecated resource description in api and UI page (#14394) 
(cherry picked from commit bcd1df19b8)
 2023-07-20 11:24:32 +08:00
IT-Kwj b0a7e15e3e [Feature-14404][datasource-plugin] add HANA datasource (#14404) 
---------

Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
(cherry picked from commit 7a24be0672)
 2023-07-20 11:24:09 +08:00
Rick Cheng 4be93325b0 [feature][Resource] Add support for Azure Blob Storage in the resource center (#14082) 
(cherry picked from commit 4fa0ab4d7e)
 2023-07-20 09:55:26 +08:00
Aaron Wang 1f8a77d79d fix: trim node selector requirement value (#14307) 
(cherry picked from commit b7fb393eed)
 2023-07-20 09:54:58 +08:00
JieguangZhou 1168fabf13 [Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127) 
* add dynamic task plugin

* fix ui

* update code

* add DOC

* ADD UT

* fix doc

* fix sanity check

* add upgrade ddl
* fix sql

(cherry picked from commit e7cdc7c136)
 2023-07-20 09:54:42 +08:00
Zinway cd486aa652 feat: Introduce new datasource vertica (#14232) 
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
(cherry picked from commit 18d176c5f4)
 2023-07-20 09:53:20 +08:00
Eric Gao 7a310f442a [Improvement][Metrics] Add more worker related metrics and fix some previous ones (#14254) 
* Add more worker related metrics and fix some previous ones

* update metrics docs

(cherry picked from commit e86630bb7b)
 2023-07-20 09:52:26 +08:00
Rick Cheng 7dc236730a [Improvement-14243][Metrics] Add user tag of response time of api server (#14248) 
(cherry picked from commit 8aec3846b4)
 2023-07-20 09:52:14 +08:00
Jay Chung 661522af56 chore: Release version 3.0.6 (#14234) 
(cherry picked from commit 7226edd04e)
 2023-07-20 09:51:48 +08:00
Aaron Wang 4e78248238
[Feature][K8S Task] support node selector (#14126) 
* feat: support K8S node selector

* fix CI
 2023-05-26 09:21:23 +08:00
Kerwin fa4a4f6938
Added 3.1.7 release document (#14206) 2023-05-25 18:08:04 +08:00
haibingtown af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099) 
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
 2023-05-25 11:02:39 +08:00
Rick Cheng 5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server (#14177) 2023-05-23 12:22:49 +08:00
Rick Cheng 428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
Alex Ting 606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql (#13378) 
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .

for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})

after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
 2023-05-22 11:19:30 +08:00
Kerwin 8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150) 
* Added a dependent task failure policy in the dependent task node
 2023-05-19 14:49:50 +08:00
Jay Chung 56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
Rick Cheng db2da822de
Add supported operations of workflow definition (#14122) 2023-05-18 10:27:36 +08:00
Aaron Wang c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067) 
* [Improvement-13868] Support the custom labels for k8s task

* fix front-end type mismatched
 2023-05-16 12:04:33 +08:00
Kerwin 8944fdc622
Added 3.1.6 release document (#14100) 2023-05-15 11:25:45 +08:00
openopen2 fc97118bdc
[Doc] Fix upgrade-schema.sh cannot load driver class (#14072) 
* fix upgrade-schema.sh cannot load driver class

When initializing and creating related tables for the first time, the support of related jdbc drivers is required. This article omits placing jdbc drivers in the tools directory.

* Update datasource-setting.md

update english doc
 2023-05-10 13:44:23 +08:00
He Zhao f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729) 
---------

Co-authored-by: weitong <weitong@cisco.com>
 2023-05-06 19:30:50 +08:00
aiwenmo 76f33bea2b
[doc] Change DinkyTask picture to english (#14061) 2023-05-05 22:37:01 +08:00
Bingchang Chen 77e58ce245
[Feature] Add SSO login by Casdoor (#8706) 2023-05-05 14:43:06 +08:00
Aaron Wang 3bad68a942
[Bug-13929][K8S Task] Set command contains single quote is invalid (#13930) 
* [Fix-13929][K8S Task] Set command contains single quote is invalid

* fix UT
 2023-05-01 11:45:03 +08:00
Jay Chung 8c43e71adf
doc: Change readme and standalone docker quick start (#14002) 2023-04-25 09:35:49 +08:00
Jeremy db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin (#13866) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-04-24 21:28:14 +08:00
Aaron Wang 731123cebc
[Bug][Worker] get worker status bug (#13992) 
* get worker status bug

* modify configuration name
 2023-04-24 09:51:47 +08:00
JieguangZhou 5c1edd2912
[Improvement][DOC] Update resource S3 configuration docs (#13985) 
* update resoure s3 docs
 2023-04-21 17:00:14 +08:00
zzm 35bb533a50
[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin (#13861) 
---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-04-18 12:18:51 +08:00
He Zhao c0126b7f30
[Feature][plugin] Support Kyuubi datasource (#13642) 
---------

Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
 2023-04-18 11:12:39 +08:00
Wenjun Ruan 61a689aa5a
Use percentage to represent memory/cpu usage (#13896) 2023-04-13 15:48:20 +08:00
Jay Chung f9f88cb505
doc: Add hyperlink for pydolphinscheduler doc (#13907) 
* doc: Add hyperlink for pydolphinscheduler doc

* style

* remove Tianqi-Dotes for docs code owner
 2023-04-11 14:42:09 +08:00
Assert 4439c1ec90
[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 (#13086) 2023-04-08 22:02:19 +08:00
Kerwin 7e3ecfa68f
add 3.1.5 release (#13877) 2023-04-07 16:19:13 +08:00
Rick Cheng 7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777) 2023-04-06 17:49:33 +08:00
Jay Chung 22786351b2
doc: Announce link error (#13855) 2023-04-03 14:23:44 +08:00
Jay Chung 406fef1988
doc: Release version 305 (#13854) 2023-04-03 11:41:49 +08:00
Kerwin 490ead614e
Improve svn commit section in release docs (#13843) 2023-04-03 08:48:32 +08:00
Wenjun Ruan a1861bc2df
Use DATAX_PYTHON to specify a datax python version (#13849) 
(cherry picked from commit 752452ecbd2f8094b819eae219f3eec0f6a6427b)
 2023-04-03 08:47:32 +08:00