Commit Graph

36 Commits

Author SHA1 Message Date
JinYong Li f8f6302068
[Release-for-2.0.9] update version (#14227)
* fix #13760

* pre-209

---------

Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2023-05-29 11:43:16 +08:00
JinYong Li 5e70d10562
update version for release (#12435)
Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-10-19 14:39:08 +08:00
JinYong Li 8383b331a3
[release] 206 release (#10767)
Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-07-04 16:42:03 +08:00
JinYong Li d95132921d
update version (#8667) 2022-03-02 20:07:27 +08:00
JinYong Li d91d403749
[204-Release] update version (#8534)
* update version

* update version
2022-02-25 10:59:14 +08:00
wind f5241e5d27
upgrade version to 2.0.3 (#8130)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-20 15:31:37 +08:00
wind 2d3c50cbae
[Bug-7942][Config] update config of master and worker (#7975)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-14 16:11:10 +08:00
zwZjut f02cde30b8
#7949 (#7953)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2022-01-12 13:51:30 +08:00
lenboo 27795e695e update docker version to 2.0.2 2021-12-29 00:35:35 +08:00
zwZjut df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 (#7641)
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238)

* to #7237

* rerun test

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 05aef27 and handle conflicts

* to #7065: fix ExecutorService and schedulerService (#7072)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081  (#7082)

* to #7081

* fix #7081

* to #7081

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 8ebe060 and handle conflicts

* cherry-pick 1f18444 and handle conflicts

* fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>

* add default constructor (#6780)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* to #7108 (#7109)

* add conf && pick #7562 to worker

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
2021-12-28 10:31:36 +08:00
zwZjut f8942bf798
[Improvement][MasterServer] event response handle parallel (#7560)
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238)

* to #7237

* rerun test

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 05aef27 and handle conflicts

* to #7065: fix ExecutorService and schedulerService (#7072)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081  (#7082)

* to #7081

* fix #7081

* to #7081

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 8ebe060 and handle conflicts

* cherry-pick 1f18444 and handle conflicts

* fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>

* add default constructor (#6780)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* to #7108 (#7109)

* to #7450

* to #7450: fix parallel bug

* add index

* expose config to user

* fix bug

* fix bug

* add delay delete

* fix bug

* add License

* fix ut

* fix ut

* fix name

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
2021-12-24 10:39:52 +08:00
zwZjut c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 (#7540)
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238)

* to #7237

* rerun test

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 05aef27 and handle conflicts

* to #7065: fix ExecutorService and schedulerService (#7072)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081  (#7082)

* to #7081

* fix #7081

* to #7081

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* chery-pick 8ebe060 and handle conflicts

* cherry-pick 1f18444 and handle conflicts

* fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>

* add default constructor (#6780)

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>

* to #7108 (#7109)

* to #7511

* to #7511

* to #7511

* to #7511

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
2021-12-22 18:57:51 +08:00
Kirs bb60c518ef
[2.0.1-prepare]update docker version (#7264) 2021-12-08 16:10:13 +08:00
Kirs 2bf3b22d64
[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) (#7041)
* data source spi

* Fix datasource not work in tests and standalone server, and run all tests by default (#6743)

* Refactor alert plugins and simplify its usage (#6723)

* [Fix-6792] resolve API and alert port conflicts (#6792) (#6815)

* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)

* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828)

* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490)

* fix pom dep scope

* filter alert

* filter alert

* filter alert

* fix checkstyle

* remove hikaricp version

* update pom

* add properties

* add properties

* rename properties

* fix e2e fail

* rename properties

* [Fix-6792] resolve API and alert port conflicts (#6792) (#6815)

[Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)

* fix ut fail

* fix license

* fix license

* update package

* update package

* remove unused license

Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2021-11-30 14:03:21 +08:00
Kirs 6821c7a9ac
[2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6999)
* [2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6712)

* upgrade version and fix dep err

* Clean up the utility codes (#6732)

* remove code style check

* upgrade docker version

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2021-11-26 12:26:15 +08:00
Kirs c6c497dbcd
[2.0.0-release]upgrade docker version (#6853) 2021-11-16 00:07:55 +08:00
Kirs 67508d8d1b
update project version to 2.0.0-SNAPSHOT (#6383) 2021-09-28 12:00:43 +08:00
Shiwen Cheng b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393)
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
2021-05-24 00:03:35 +08:00
Shiwen Cheng 1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py (#5019) 2021-03-17 14:38:04 +08:00
游侠 2d8c4ec86b
[Improvement][Worker-Task] Python Command (#5036)
* create the interpreter for python command

* Update README.md

Co-authored-by: zhouhong <zhouhong@zhangyue.com>
2021-03-15 10:22:13 +08:00
wenjun fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight (#4997) (#5014) 2021-03-10 08:55:04 +08:00
chengshiwen 6d2ae7523f [Improvement][K8s] Optimize metadata name 2021-03-08 19:08:20 +08:00
chengshiwen 167a768b32 [Improvement][K8s] Optimize fullname 2021-03-08 17:27:27 +08:00
chengshiwen b689630970 [Improvement][K8s] Optimize image pull secret 2021-03-08 16:25:24 +08:00
chengshiwen e20ffacf22 [Improvement][K8s] Support local image 2021-03-08 16:11:59 +08:00
chengshiwen fb2b55c150 [Improvement][Docker] Improve readme, notes, and long host display 2021-03-05 15:15:23 +08:00
xingchun-chen 969fba8afd
Merge pull request #4783 from chengshiwen/improve-k8s-adapt-alert-server
[Improvement][K8s] Adapt to the latest alert-server with updated config and port 50052
2021-03-04 11:23:29 +08:00
chengshiwen 79b5f8c791 [Improvement][K8s] Optimize ingress compatibility 2021-02-28 12:08:44 +08:00
chengshiwen 01ee2b3211 [Improvement][K8s] Adapt to the latest alert-server with updated config and port 50052 2021-02-28 11:52:06 +08:00
wangdazhong001 73b2d5b7fc
[Fix-4843] Rename WORKER_GROUP to WORKER_GROUPS (#4843) (#4856)
* [Fix-4843] docker yml

* [Fix-4843] k8s env

* [Fix-#4843]  fix startup-init-conf.sh worker.properties.tpl  WORK_GROUP change WORK_GROUPS

* [Fix-#4843]  fix README.md README_zh_CN.md  WORK_GROUP change WORK_GROUPS

Co-authored-by: wangdz50 <wangdz50@chinaunicom.cn>
2021-02-25 22:44:06 +08:00
Shiwen Cheng f166de1798
[Improvement][K8s] Support resource storage when fs.defaultFS=file:/// (#4777) 2021-02-21 22:44:55 +08:00
Shiwen Cheng 93514ddf31
[Improvement][K8s] Improve K8s for helm (#4746) 2021-02-14 21:35:23 +08:00
CalvinKirs d6a32ac652
[Feature#3234][cluster]enhanced load balancing (#3235)
* [Future#3234][cluster]enhanced load balancing
weight-based load balancing algorithm
this close # 3234

* remove useless parameter

* code smell

* load balancing according to work group

* add smooth weight round robin

* remove unused constants

* perfect unit test

* code smell

* code smell

* add work weight config

* fix config error

* add weight docs to readme.md
2020-08-10 19:05:21 +08:00
rockxsj b6a0d55949
fix and update k8s deploy (#3215)
* Modify the AWS S3 request encryption method to V4.

* * update Dockerfile to add mysql-client for mysql database service test
* update wechat alert config replace placeholder from  to {xx} because of the  will be treat as env variable
* fix unit test of EnterpriseWeChatUtilsTest
* update values.yaml default config for helm deploy DS cluster
* update values.yaml default config for custom install
* update templates of helm for custom install
* update some name of env varibale, for example change from POSTGRESQL_HOST to DATABASE_HOST
* delele the redundancy requirements.yaml for heml
* update README* in the docker dir and subdir
* update startup scripts for support mysql as backend database

* * fix the ENV name wrong in docker-compose.yml and docker-stack.yml
* remove the didn't need port mapping in postgresql & zookeeper & dolphinscheduler-api

* * keep expose the port of postgresql & zk & api because of unit test needed

* * remove mysql-client package from dockerfile

Co-authored-by: rockxsj <junjun@mgtv.com>
2020-07-16 16:36:29 +08:00
xiaochun.liu c68785632f merge from dev-1.3.0 2020-05-13 23:31:36 +08:00
liwenhe1993 7eecfe45ea Modify docker-compose and kubernetes config
1. Move kubernetes to docker directory
2. Change docker-compose directory's name, and move docker-compose to docker directory
3. Modify docker-compose config and kubernetes config
4. Modify startup.sh in dockerfile
2020-04-26 14:13:07 +08:00