ef003c6211
Pre release change
2023-10-11 16:29:47 +08:00
7b43c66811
[Feature][Helm] Supports deploying only partial components ( #14985 )
...
* [Feature][Helm] Supports deploying only partial components
* chore: add doc
* chore: miss some doc
(cherry picked from commit 4fe41ac57f
2023-10-11 15:58:46 +08:00
8e16834836
[Improvement][helm] configmap changes automatically trigger restart ( #14657 )
...
* [Improvement][helm] configmap changes automatically trigger restarts
Signed-off-by: Gallardot <gallardot@apache.org>
* feat: add an optional parameter
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
(cherry picked from commit 11d1df2f32
2023-08-30 17:05:50 +08:00
40fb3555b9
[Improvement][CI] deploy to k8s ( #14555 )
...
* [Improvement][CI] deploy to k8s
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
(cherry picked from commit 5a550dd628
2023-08-30 16:59:53 +08:00
c927d657f3
[Improvement][HELM] add driver-class-name ( #14614 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
(cherry picked from commit 0188f40b84
2023-08-30 13:59:21 +08:00
e677a3816a
impv: Correct datax execute and python execute script name ( #14523 )
...
* impv: Correct datax execute and python execute script name
we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name
* Add pr number
* fix ut
* style
---------
Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit de2d215aee
2023-07-20 11:30:46 +08:00
c7cac26468
[Feature][K8S] add prometheus serviceMonitor ( #14539 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
(cherry picked from commit f5be784044
2023-07-20 11:30:39 +08:00
946d173e7b
fix terrafrom config bug ( #14362 )
...
(cherry picked from commit b5d88f2a6f
2023-07-20 11:30:21 +08:00
28c2ec8e4b
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration ( #14349 )
...
(cherry picked from commit f186cd5dab
2023-07-20 11:24:49 +08:00
a3e059443b
[Improvement][Etcd] Support SSL In Etcd And Enhance Etcd In Helm ( #13924 )
...
(cherry picked from commit 1c0dfbb044
2023-07-20 10:00:20 +08:00
4be93325b0
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
...
(cherry picked from commit 4fa0ab4d7e
2023-07-20 09:55:26 +08:00
41e3ce35a7
fix: disordered comments in values.yaml ( #14197 )
2023-05-24 21:06:18 +08:00
0a5b32e8b6
[Improvement-13785][docker] upgrade zk and pg image version to support arm architecture ( #13789 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
2023-04-19 16:37:01 +08:00
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2023-04-13 15:48:20 +08:00
664d2e4ed3
Add init schema job to Helm hooks so that schema can be updated when upgrading deployment ( #13898 )
2023-04-10 15:44:20 +08:00
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2023-03-15 19:29:27 +08:00
34d49e0d28
remove WORKER_GROUP conf in values.yaml ( #13718 )
2023-03-10 15:12:06 +08:00
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2023-02-21 23:26:21 +08:00
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml ( #13354 ) ( #13560 )
2023-02-14 12:53:49 +08:00
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` ( #13547 )
2023-02-11 16:35:57 +08:00
a843e0b96d
Add documentation to release Helm Chart ( #13385 )
2023-01-15 10:10:31 +08:00
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster ( #13367 )
...
* Add keda autoscaler support for worker deployment when deployed in K8S cluster
* Add mysql scaler for worker autoscaling
* Add docs for worker autoscaler
* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
dd0d73036e
Fix minio version in helm chart ( #13368 )
2023-01-11 00:40:17 +08:00
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file ( #13271 )
...
* tz in docker
* update default tz and update doc
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-27 14:41:34 +08:00
1f7f900e78
[Fix][Doc] Replace the links. ( #13276 )
...
* [Fix][Doc] Replace the links.
* [Fix][Doc] Revised `.dlc.json`
* [Fix] Fix the dead link.
2022-12-26 14:32:40 +08:00
de6bc56aee
Add Terraform deploy manifests for quick setup in AWS ( #13252 )
2022-12-22 16:55:32 +08:00
dcf02eab45
[Fix] Replaced dead links in the docs. ( #13170 )
...
* [Fix] Replaced dead links.
* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart ( #12987 )
2022-11-24 15:35:03 +08:00
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2022-11-11 10:26:57 +08:00
23e9d2698c
fix and enhance helm db config ( #12707 )
2022-11-05 18:20:03 +08:00
6766ec04df
Add pythonNodePort in config file ( #12685 )
2022-11-03 17:47:06 +08:00
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
d4e7ae96a9
Add configmap resource permissions so config hot reload can work ( #12572 )
2022-10-28 10:27:44 +08:00
fdac751379
Add mysql support to helm chart ( #12517 )
2022-10-25 09:20:14 +08:00
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S ( #12369 )
2022-10-14 16:19:57 +08:00
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml ( #12290 )
2022-10-12 15:55:36 +08:00
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2022-09-21 20:27:28 +08:00
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2022-09-17 11:33:32 +08:00
cc5f710147
[helm] fix worker template persistentVolumeClaim link ( #11248 )
2022-09-11 20:46:55 +08:00
28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties ( #11812 )
2022-09-07 10:35:50 +08:00
6f3b0b2432
[k8s] Delete unnecessary configurations. ( #11808 )
2022-09-06 21:31:56 +08:00
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml ( #11441 )
...
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
b03f2e22cd
fix k8s master and worker start error ( #11156 )
2022-07-27 09:23:17 +08:00
5855274b26
[Fix-10652] fix docker-compose.yml ( #10653 )
...
* [Fix-10652] fix docker-compose.yml
* [Fix-10652] fix docker-stack.yml
* [Fix-10652] fix python api port in k8s config
* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
* [Fix-10652] fix { { to {{
* [Fix-10652] del space between {{ and -
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-06-30 15:43:19 +08:00
0b377f72b1
[Fix-10400]Fix K8s deployment bitnami version error ( #10567 )
...
* Fix k8s bitnami bug
* add comments
2022-06-24 15:29:26 +08:00
388b214aca
[fix] Change K8s postgresql password key name ( #10545 )
2022-06-23 11:37:56 +08:00
a7e20798cb
Update chart.yaml dependencies version ( #10420 )
2022-06-13 10:27:34 +08:00
5803d5c07c
[fix][deploy]fix run on kubernetes bug ( #10379 )
...
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2022-06-09 15:57:20 +08:00
4351148f36
[Bug] init docker compose DATABASE env ( #10244 )
...
skip source env if in docker
2022-05-26 13:50:59 +08:00
dbac