de2d215aee
impv: Correct datax execute and python execute script name ( #14523 )
...
* impv: Correct datax execute and python execute script name
we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name
* Add pr number
* fix ut
* style
---------
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
f5be784044
[Feature][K8S] add prometheus serviceMonitor ( #14539 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-17 16:01:05 +08:00
b5d88f2a6f
fix terrafrom config bug ( #14362 )
2023-07-14 09:52:16 +08:00
f186cd5dab
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration ( #14349 )
2023-06-29 16:14:37 +08:00
1c0dfbb044
[Improvement][Etcd] Support SSL In Etcd And Enhance Etcd In Helm ( #13924 )
2023-06-14 13:29:50 +08:00
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
2023-06-12 12:05:49 +08:00
41e3ce35a7
fix: disordered comments in values.yaml ( #14197 )
2023-05-24 21:06:18 +08:00
0a5b32e8b6
[Improvement-13785][docker] upgrade zk and pg image version to support arm architecture ( #13789 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
2023-04-19 16:37:01 +08:00
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2023-04-13 15:48:20 +08:00
664d2e4ed3
Add init schema job to Helm hooks so that schema can be updated when upgrading deployment ( #13898 )
2023-04-10 15:44:20 +08:00
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2023-03-15 19:29:27 +08:00
34d49e0d28
remove WORKER_GROUP conf in values.yaml ( #13718 )
2023-03-10 15:12:06 +08:00
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2023-02-21 23:26:21 +08:00
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml ( #13354 ) ( #13560 )
2023-02-14 12:53:49 +08:00
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` ( #13547 )
2023-02-11 16:35:57 +08:00
a843e0b96d
Add documentation to release Helm Chart ( #13385 )
2023-01-15 10:10:31 +08:00
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster ( #13367 )
...
* Add keda autoscaler support for worker deployment when deployed in K8S cluster
* Add mysql scaler for worker autoscaling
* Add docs for worker autoscaler
* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
dd0d73036e
Fix minio version in helm chart ( #13368 )
2023-01-11 00:40:17 +08:00
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file ( #13271 )
...
* tz in docker
* update default tz and update doc
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-27 14:41:34 +08:00
1f7f900e78
[Fix][Doc] Replace the links. ( #13276 )
...
* [Fix][Doc] Replace the links.
* [Fix][Doc] Revised `.dlc.json`
* [Fix] Fix the dead link.
2022-12-26 14:32:40 +08:00
de6bc56aee
Add Terraform deploy manifests for quick setup in AWS ( #13252 )
2022-12-22 16:55:32 +08:00
dcf02eab45
[Fix] Replaced dead links in the docs. ( #13170 )
...
* [Fix] Replaced dead links.
* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart ( #12987 )
2022-11-24 15:35:03 +08:00
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2022-11-11 10:26:57 +08:00
23e9d2698c
fix and enhance helm db config ( #12707 )
2022-11-05 18:20:03 +08:00
6766ec04df
Add pythonNodePort in config file ( #12685 )
2022-11-03 17:47:06 +08:00
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
d4e7ae96a9
Add configmap resource permissions so config hot reload can work ( #12572 )
2022-10-28 10:27:44 +08:00
fdac751379
Add mysql support to helm chart ( #12517 )
2022-10-25 09:20:14 +08:00
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S ( #12369 )
2022-10-14 16:19:57 +08:00
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml ( #12290 )
2022-10-12 15:55:36 +08:00
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2022-09-21 20:27:28 +08:00
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2022-09-17 11:33:32 +08:00
cc5f710147
[helm] fix worker template persistentVolumeClaim link ( #11248 )
2022-09-11 20:46:55 +08:00
28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties ( #11812 )
2022-09-07 10:35:50 +08:00
6f3b0b2432
[k8s] Delete unnecessary configurations. ( #11808 )
2022-09-06 21:31:56 +08:00
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml ( #11441 )
...
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
b03f2e22cd
fix k8s master and worker start error ( #11156 )
2022-07-27 09:23:17 +08:00
5855274b26
[Fix-10652] fix docker-compose.yml ( #10653 )
...
* [Fix-10652] fix docker-compose.yml
* [Fix-10652] fix docker-stack.yml
* [Fix-10652] fix python api port in k8s config
* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
* [Fix-10652] fix { { to {{
* [Fix-10652] del space between {{ and -
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-06-30 15:43:19 +08:00
0b377f72b1
[Fix-10400]Fix K8s deployment bitnami version error ( #10567 )
...
* Fix k8s bitnami bug
* add comments
2022-06-24 15:29:26 +08:00
388b214aca
[fix] Change K8s postgresql password key name ( #10545 )
2022-06-23 11:37:56 +08:00
a7e20798cb
Update chart.yaml dependencies version ( #10420 )
2022-06-13 10:27:34 +08:00
5803d5c07c
[fix][deploy]fix run on kubernetes bug ( #10379 )
...
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2022-06-09 15:57:20 +08:00
4351148f36
[Bug] init docker compose DATABASE env ( #10244 )
...
skip source env if in docker
2022-05-26 13:50:59 +08:00
b1885c7a26
[Bug] fix run on docker and k8s ( #10026 )
...
* fix docker-compose init schema
* recovery depend on zk
* update doc and dockerfile
* fix run on k8s
* udpate doc
* add DOCKER flag & update doc
* remove repeat DOCKER env
2022-05-16 15:41:45 +08:00
8d17fd20f9
[ci] Dead link check all markdown file ( #10004 )
...
there are 162 markdown files in dir `docs`
and all file in project is 175 files, so I
think check all file will not add too much
load for our ci, but it could discovered
the dead link in time to avoid some thing
like #9998
2022-05-12 11:30:01 +08:00
24e455304c
Add ingress annotations ( #9492 )
2022-04-19 20:01:57 +08:00
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
2022-04-07 18:15:19 +08:00
3457cee960
[python] Migrate pythonGatewayServer into api server ( #9372 )
...
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server
The distribute package size before and after this patch is:
```sh
# before
796M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
# after
647M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
2022-04-07 14:41:15 +08:00
Jay Chung