Commit Graph

500 Commits

Author SHA1 Message Date
Wenjun Ruan 9df89cf0cf
Use bootstrap user as the default tenant (#13825) 2023-03-30 14:11:23 +08:00
Rick Cheng 2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Rick Cheng aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 (#13649)
* [Feature-13419][Remote Logging] Add support for writing task logs to S3

* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* use try with resource

* remove unnecessary log

---------

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-03-13 19:36:12 +08:00
Aaron Wang ceea147e2d
[doc] update kubernetes doc (#13716) 2023-03-10 18:02:36 +08:00
Eric Gao 394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640)
* Tag workflow related metrics with process definition code (workflow id)

* Clean up related metrics when deleting workflow definition

* Add license headers

* Update related UT cases

* Add an example in grafana-demo

* Add related docs
2023-03-09 11:30:21 +08:00
He Wang 35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675)
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-03-07 10:12:58 +08:00
iuhoay b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path (#13641) 2023-03-03 09:34:44 +08:00
Jay Chung c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs (#13607)
* doc: new quick start doc with more detail and gif

copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22

and the chinese translate by Google Translate

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-02-28 11:20:28 +08:00
kezhenxu94 f937c511b1
Publish Docker images to docker hub when released (#13631) 2023-02-27 09:24:28 +08:00
Kerwin 9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc (#13621) 2023-02-25 11:24:43 +08:00
Qi Zhang 6516240e0c
[Docs] Update rainbond docs (#13608)
Signed-off-by: Qi Zhang <smallqi1@163.com>
2023-02-24 16:52:43 +08:00
Aaron Wang 938f13b568
[Doc] Spark on K8S (#13605) 2023-02-23 10:31:34 +08:00
Aaron Wang 047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
Rick Cheng 2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS (#13332) 2023-02-13 16:38:26 +08:00
kezhenxu94 a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` (#13547) 2023-02-11 16:35:57 +08:00
JieguangZhou 16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529)
* support http output response as param

* add UT

* fix sqoop UT
2023-02-08 23:03:21 +08:00
Aaron Wang f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources (#13512) 2023-02-08 10:20:08 +08:00
kezhenxu94 57db06e1b0
Fix the parameter table is messed up (#13526) 2023-02-07 13:45:10 +08:00
xiaojingXU 3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api (#13475)
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool

* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
旺阳 0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
Jay Chung 78e5569afd
[feat] Add type local turn on resource center by default (#13303) 2023-01-31 17:39:20 +08:00
Tq 78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
Tq 3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379)
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
2023-01-16 16:21:26 +08:00
kezhenxu94 a843e0b96d
Add documentation to release Helm Chart (#13385) 2023-01-15 10:10:31 +08:00
v-wx-v e39bf59b4b
[fix][data quality] fix when running data quality task with Error "No main class set in JAR" (#13360) 2023-01-14 14:50:50 +08:00
Eric Gao 366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367)
* Add keda autoscaler support for worker deployment when deployed in K8S cluster

* Add mysql scaler for worker autoscaling

* Add docs for worker autoscaler

* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
v-wx-v 3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163)
* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [improvement][install.sh] fix the install Error "Command not found rmr" &  support ZooKeeper (3.4.6+)
* update known-dependencies.txt

* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt

Co-authored-by: wangxx <wangxx@kcwl.com>
2023-01-12 18:07:58 +08:00
Kerwin 22958682c4
add 3.1.3 release (#13357) 2023-01-10 17:17:51 +08:00
Donald Yang 8f7b141fe7
[Fix-13287][doc]Fix Chinese workflow-definition.md duplication description in execution-type (#13361) 2023-01-10 11:33:42 +08:00
lenian bcf03ad4d1
[Feature-9467] add DAMENG DataSource (#12860)
* [Feature-9467][DataSource] add DAMENG (达梦) data source

* [Feature-9467] add DM datasource doc (Issue #9467)

* [Feature-9467] add DM IDataBaseOptionKeys

* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method

* [Feature-9467] modification package dm to dameng;

* [Feature-9467] add Dameng DmJdbcDriver18 License

* [Feature-9467] add DM DataSource: remove DruidDataSourceClient

Co-authored-by: lenian <yuenian@mananacare.com>
2023-01-04 15:00:24 +08:00
Jay Chung 2c952139b4
feat: Release version 304 (#13319)
Release new version 304
2023-01-03 15:17:22 +08:00
Aaron Wang 8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority (#13274) 2022-12-29 11:05:00 +08:00
Jay Chung aec26f06db
[doc] Correct install_env.sh file name (#13294)
duplicate #12209
2022-12-28 17:09:57 +08:00
陈家名 9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file (#13271)
* tz in docker

* update default tz and update doc

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-27 14:41:34 +08:00
Amy0104 1f7f900e78
[Fix][Doc] Replace the links. (#13276)
* [Fix][Doc] Replace the links.

* [Fix][Doc] Revised `.dlc.json`

* [Fix] Fix the dead link.
2022-12-26 14:32:40 +08:00
Tq 06b77b34c7
[doc][datasource-12820] add azure sql database doc (#13254) 2022-12-22 16:04:19 +08:00
Wenjun Ruan 14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00
Eric Gao c213c6fe34
Fix a tiny bug in release doc (#13239) 2022-12-21 17:52:56 +08:00
JieguangZhou 66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194)
* Supports task instance cache operation

* add task plugin cache

* use SHA-256 to generate key

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Optimizing database Scripts

* Optimize clear cache operation

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2022-12-18 18:17:09 +08:00
Wenjun Ruan 5c75d312fa
Add StarRocks datasource (#13204) 2022-12-17 08:44:39 +08:00
lifeng 84496c5f04
[Fix][Doc]Update pseudo-cluster.md (#13207)
* Update pseudo-cluster.md

* Update pseudo-cluster.md
2022-12-16 19:58:43 +08:00
Amy0104 dcf02eab45
[Fix] Replaced dead links in the docs. (#13170)
* [Fix] Replaced dead links.

* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
Aaron Wang 560d232cbd
[Bug][Worker] Fix duplicated key bug when have out parameters of same name (#12930) 2022-12-12 11:07:23 +08:00
Kerwin 209af2ad29
Add release 3.1.2 documentation (#13150) 2022-12-11 14:26:52 +08:00
longtb 917df4f6ca
[fix-13041] fix example checkFormula (#13110)
Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
2022-12-10 12:23:44 +08:00
Jay Chung 316496211a
[doc] refactor release (#13135)
* [doc] refactor release

* [doc] refactor release
2022-12-10 12:20:53 +08:00
Jay Chung e90cd9e13b
[release] version 3.0.3 (#13131) 2022-12-08 16:57:17 +08:00
旺阳 e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart (#12987) 2022-11-24 15:35:03 +08:00
rickchengx 38b876733c
[Feature-10498] Mask the password in the log of sqoop task (#11589) 2022-11-24 14:54:54 +08:00
insist777 b40c63f02d
[Feature][DataSource]Add trino datasource plugin (#12911) 2022-11-23 10:09:02 +08:00