Commit Graph

18 Commits

Author SHA1 Message Date
kezhenxu94 ef0cb46661
Fix shell tools for database schema cannot run (#7003) 2021-11-26 11:10:38 +08:00
kezhenxu94 05bae0b226
Refactor alert plugins and simplify its usage (#6723) 2021-11-09 18:59:34 +08:00
kezhenxu94 5400abc74f
Refactor registry plugin and simplify its usage (#6712) 2021-11-07 15:18:10 +08:00
Shiwen Cheng 93f1d4df7d
[Improvement-5405][Docker/K8s] Adapt to registry SPI (#5681) 2021-06-23 11:30:15 +08:00
Kirs e2243d63be
[Feature-#3961][Registry]Registry-SPI (#5562)
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
2021-06-09 15:21:02 +08:00
Shiwen Cheng b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393)
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
2021-05-24 00:03:35 +08:00
Shiwen Cheng 1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py (#5019) 2021-03-17 14:38:04 +08:00
游侠 2d8c4ec86b
[Improvement][Worker-Task] Python Command (#5036)
* create the interpreter for python command

* Update README.md

Co-authored-by: zhouhong <zhouhong@zhangyue.com>
2021-03-15 10:22:13 +08:00
wenjun fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight (#4997) (#5014) 2021-03-10 08:55:04 +08:00
chengshiwen fb2b55c150 [Improvement][Docker] Improve readme, notes, and long host display 2021-03-05 15:15:23 +08:00
chengshiwen 61f4086e84 [Fix-4897][Docker] Support supervisor management and fix log stdout 2021-03-02 21:27:14 +08:00
chengshiwen 3b562f557d [Fix-4886][Docker] Fix invalid volume specification in Windows 2021-02-26 20:31:26 +08:00
wangdazhong001 73b2d5b7fc
[Fix-4843] Rename WORKER_GROUP to WORKER_GROUPS (#4843) (#4856)
* [Fix-4843] docker yml

* [Fix-4843] k8s env

* [Fix-#4843]  fix startup-init-conf.sh worker.properties.tpl  WORK_GROUP change WORK_GROUPS

* [Fix-#4843]  fix README.md README_zh_CN.md  WORK_GROUP change WORK_GROUPS

Co-authored-by: wangdz50 <wangdz50@chinaunicom.cn>
2021-02-25 22:44:06 +08:00
Shiwen Cheng 149b0dab4d
[Improvement][Docker] Sync docker conf templates to the latest conf properties (#4772) 2021-02-23 14:47:10 +08:00
Shiwen Cheng cbada7c16d
[Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log, improve compose/swarm deployment and fix random PSQLException (#4643)
* [Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log and improve compose/swarm deployment

* [Improvement][Docker] Fix random PSQLException
2021-02-14 17:42:04 +08:00
CalvinKirs d6a32ac652
[Feature#3234][cluster]enhanced load balancing (#3235)
* [Future#3234][cluster]enhanced load balancing
weight-based load balancing algorithm
this close # 3234

* remove useless parameter

* code smell

* load balancing according to work group

* add smooth weight round robin

* remove unused constants

* perfect unit test

* code smell

* code smell

* add work weight config

* fix config error

* add weight docs to readme.md
2020-08-10 19:05:21 +08:00
rockxsj b6a0d55949
fix and update k8s deploy (#3215)
* Modify the AWS S3 request encryption method to V4.

* * update Dockerfile to add mysql-client for mysql database service test
* update wechat alert config replace placeholder from  to {xx} because of the  will be treat as env variable
* fix unit test of EnterpriseWeChatUtilsTest
* update values.yaml default config for helm deploy DS cluster
* update values.yaml default config for custom install
* update templates of helm for custom install
* update some name of env varibale, for example change from POSTGRESQL_HOST to DATABASE_HOST
* delele the redundancy requirements.yaml for heml
* update README* in the docker dir and subdir
* update startup scripts for support mysql as backend database

* * fix the ENV name wrong in docker-compose.yml and docker-stack.yml
* remove the didn't need port mapping in postgresql & zookeeper & dolphinscheduler-api

* * keep expose the port of postgresql & zk & api because of unit test needed

* * remove mysql-client package from dockerfile

Co-authored-by: rockxsj <junjun@mgtv.com>
2020-07-16 16:36:29 +08:00
xiaochun.liu c68785632f merge from dev-1.3.0 2020-05-13 23:31:36 +08:00