Commit Graph

46 Commits

Author SHA1 Message Date
Wenjun Ruan f754611509
[DSIP-42] Add dolphinscheduler-aws-authentication module (#16043) 2024-05-24 14:15:03 +08:00
Rick Cheng dbd790ddac
[Fix][CI] fix the ci error of Values.datasource.profile (#16031)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2024-05-21 11:16:30 +08:00
Gallardot a9decc911f
[Bug][Helm] fix image.registry (#15860)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2024-04-19 16:52:17 +08:00
Wenjun Ruan 66df5d4b90
Split cpuUsage to systemCpuUsage and jvmCpuUsage (#15803) 2024-04-09 14:04:24 +08:00
Jay Chung 91d56f4860
fix: data quality may fail in docker mode (#15563) 2024-02-05 17:14:59 +08:00
Wenjun Ruan 7b9c9e0eb2
Enable set ServerLoadProtection fot Master/Worker (#15439) 2024-01-14 22:17:58 +08:00
Gallardot 1c1d4bd592
[Improvement][Helm] using helm-docs to generate docs automatically (#15299) 2023-12-29 11:24:37 +08:00
Gallardot 2f2825784a
[Improvement][Helm] support task type filter (#15179) 2023-11-19 15:15:10 +08:00
旺阳 b532fe5eda
[Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431)
* k8s support jdbc registryt

* fix spotless

* fix

* update

* update

* update

* update
2023-10-11 20:52:11 -05:00
Gallardot 4fe41ac57f
[Feature][Helm] Supports deploying only partial components (#14985)
* [Feature][Helm] Supports deploying only partial components

* chore: add doc

* chore: miss some doc
2023-10-10 20:58:49 +08:00
Gallardot 11d1df2f32
[Improvement][helm] configmap changes automatically trigger restart (#14657)
* [Improvement][helm] configmap changes automatically trigger restarts

Signed-off-by: Gallardot <gallardot@apache.org>

* feat: add an optional parameter

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-09 10:30:20 +08:00
Gallardot 5a550dd628
[Improvement][CI] deploy to k8s (#14555)
* [Improvement][CI] deploy to k8s

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-26 17:18:04 +08:00
Gallardot 0188f40b84
[Improvement][HELM] add driver-class-name (#14614)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-24 11:58:33 +08:00
Jay Chung de2d215aee
impv: Correct datax execute and python execute script name (#14523)
* impv: Correct datax execute and python execute script name

we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name

* Add pr number

* fix ut

* style

---------

Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
Gallardot f5be784044
[Feature][K8S] add prometheus serviceMonitor (#14539)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-17 16:01:05 +08:00
旺阳 f186cd5dab
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration (#14349) 2023-06-29 16:14:37 +08:00
旺阳 1c0dfbb044
[Improvement][Etcd] Support SSL In Etcd And Enhance Etcd In Helm (#13924) 2023-06-14 13:29:50 +08:00
Rick Cheng 4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082) 2023-06-12 12:05:49 +08:00
Aaron Wang 41e3ce35a7
fix: disordered comments in values.yaml (#14197) 2023-05-24 21:06:18 +08:00
Wenjun Ruan 61a689aa5a
Use percentage to represent memory/cpu usage (#13896) 2023-04-13 15:48:20 +08:00
Rick Cheng 2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Aaron Wang 34d49e0d28
remove WORKER_GROUP conf in values.yaml (#13718) 2023-03-10 15:12:06 +08:00
Aaron Wang 047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
qindongliang 6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml (#13354) (#13560) 2023-02-14 12:53:49 +08:00
kezhenxu94 a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` (#13547) 2023-02-11 16:35:57 +08:00
Eric Gao 366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367)
* Add keda autoscaler support for worker deployment when deployed in K8S cluster

* Add mysql scaler for worker autoscaling

* Add docs for worker autoscaler

* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
旺阳 e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart (#12987) 2022-11-24 15:35:03 +08:00
kezhenxu94 454f1303a0
Add minio as demo storage for helm charts (#12861) 2022-11-11 10:26:57 +08:00
旺阳 23e9d2698c
fix and enhance helm db config (#12707) 2022-11-05 18:20:03 +08:00
旺阳 6766ec04df
Add pythonNodePort in config file (#12685) 2022-11-03 17:47:06 +08:00
Aaron Wang 08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds (#12197)
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.

Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
kezhenxu94 fdac751379
Add mysql support to helm chart (#12517) 2022-10-25 09:20:14 +08:00
rickchengx 6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml (#12290) 2022-10-12 15:55:36 +08:00
rickchengx 08a4c7981f
[improve] Remove the spark version of spark task (#11860) 2022-09-21 20:27:28 +08:00
陈家名 28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties (#11812) 2022-09-07 10:35:50 +08:00
陈家名 6f3b0b2432
[k8s] Delete unnecessary configurations. (#11808) 2022-09-06 21:31:56 +08:00
爱穿格子裤 1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml (#11441)
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
caishunfeng b03f2e22cd
fix k8s master and worker start error (#11156) 2022-07-27 09:23:17 +08:00
Hwting 5803d5c07c
[fix][deploy]fix run on kubernetes bug (#10379)
* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"

* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2022-06-09 15:57:20 +08:00
jiachuan.zhu 24e455304c
Add ingress annotations (#9492) 2022-04-19 20:01:57 +08:00
Eric Gao fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299) 2022-04-07 18:15:19 +08:00
simsicon a38adcb579
Fix https://github.com/apache/dolphinscheduler/issues/8602 (#8604) 2022-03-12 20:51:52 +08:00
Kerwin 103ccb01da
change version to 2.0.4-SNAPSHOT (#8188) 2022-01-25 15:17:17 +08:00
wind c16f65e0d1
[conf] Update master config on k8s (#8045)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-14 17:41:43 +08:00
kezhenxu94 12b46dfaa6
Adjust Helm Chart templates in dev branch (#7353) 2021-12-12 23:17:50 +08:00
kezhenxu94 67cc260d52
Split the components into individual package, refactor configurations to use Spring properties (#7160)
* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
2021-12-10 11:28:53 +08:00