Aaron Wang
c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task ( #14067 )
...
* [Improvement-13868] Support the custom labels for k8s task
* fix front-end type mismatched
2023-05-16 12:04:33 +08:00
Kerwin
8944fdc622
Added 3.1.6 release document ( #14100 )
2023-05-15 11:25:45 +08:00
openopen2
fc97118bdc
[Doc] Fix upgrade-schema.sh cannot load driver class ( #14072 )
...
* fix upgrade-schema.sh cannot load driver class
When initializing and creating related tables for the first time, the support of related jdbc drivers is required. This article omits placing jdbc drivers in the tools directory.
* Update datasource-setting.md
update english doc
2023-05-10 13:44:23 +08:00
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2023-05-06 19:30:50 +08:00
aiwenmo
76f33bea2b
[doc] Change DinkyTask picture to english ( #14061 )
2023-05-05 22:37:01 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2023-05-05 14:43:06 +08:00
Aaron Wang
3bad68a942
[Bug-13929][K8S Task] Set command contains single quote is invalid ( #13930 )
...
* [Fix-13929][K8S Task] Set command contains single quote is invalid
* fix UT
2023-05-01 11:45:03 +08:00
Jay Chung
8c43e71adf
doc: Change readme and standalone docker quick start ( #14002 )
2023-04-25 09:35:49 +08:00
Jeremy
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-04-24 21:28:14 +08:00
Aaron Wang
731123cebc
[Bug][Worker] get worker status bug ( #13992 )
...
* get worker status bug
* modify configuration name
2023-04-24 09:51:47 +08:00
JieguangZhou
5c1edd2912
[Improvement][DOC] Update resource S3 configuration docs ( #13985 )
...
* update resoure s3 docs
2023-04-21 17:00:14 +08:00
zzm
35bb533a50
[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin ( #13861 )
...
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-04-18 12:18:51 +08:00
He Zhao
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2023-04-18 11:12:39 +08:00
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2023-04-13 15:48:20 +08:00
Jay Chung
f9f88cb505
doc: Add hyperlink for pydolphinscheduler doc ( #13907 )
...
* doc: Add hyperlink for pydolphinscheduler doc
* style
* remove Tianqi-Dotes for docs code owner
2023-04-11 14:42:09 +08:00
Assert
4439c1ec90
[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 ( #13086 )
2023-04-08 22:02:19 +08:00
Kerwin
7e3ecfa68f
add 3.1.5 release ( #13877 )
2023-04-07 16:19:13 +08:00
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2023-04-06 17:49:33 +08:00
Jay Chung
22786351b2
doc: Announce link error ( #13855 )
2023-04-03 14:23:44 +08:00
Jay Chung
406fef1988
doc: Release version 305 ( #13854 )
2023-04-03 11:41:49 +08:00
Kerwin
490ead614e
Improve svn commit section in release docs ( #13843 )
2023-04-03 08:48:32 +08:00
Wenjun Ruan
a1861bc2df
Use DATAX_PYTHON to specify a datax python version ( #13849 )
...
(cherry picked from commit 752452ecbd2f8094b819eae219f3eec0f6a6427b)
2023-04-03 08:47:32 +08:00
JieguangZhou
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin ( #13801 )
2023-03-30 20:17:28 +08:00
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2023-03-30 14:11:23 +08:00
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2023-03-15 19:29:27 +08:00
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-03-13 19:36:12 +08:00
Aaron Wang
ceea147e2d
[doc] update kubernetes doc ( #13716 )
2023-03-10 18:02:36 +08:00
Eric Gao
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) ( #13640 )
...
* Tag workflow related metrics with process definition code (workflow id)
* Clean up related metrics when deleting workflow definition
* Add license headers
* Update related UT cases
* Add an example in grafana-demo
* Add related docs
2023-03-09 11:30:21 +08:00
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-03-07 10:12:58 +08:00
iuhoay
b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path ( #13641 )
2023-03-03 09:34:44 +08:00
Jay Chung
c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs ( #13607 )
...
* doc: new quick start doc with more detail and gif
copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22
and the chinese translate by Google Translate
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-02-28 11:20:28 +08:00
kezhenxu94
f937c511b1
Publish Docker images to docker hub when released ( #13631 )
2023-02-27 09:24:28 +08:00
Kerwin
9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc ( #13621 )
2023-02-25 11:24:43 +08:00
Qi Zhang
6516240e0c
[Docs] Update rainbond docs ( #13608 )
...
Signed-off-by: Qi Zhang <smallqi1@163.com>
2023-02-24 16:52:43 +08:00
Aaron Wang
938f13b568
[Doc] Spark on K8S ( #13605 )
2023-02-23 10:31:34 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2023-02-21 23:26:21 +08:00
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2023-02-13 16:38:26 +08:00
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` ( #13547 )
2023-02-11 16:35:57 +08:00
JieguangZhou
16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter ( #13529 )
...
* support http output response as param
* add UT
* fix sqoop UT
2023-02-08 23:03:21 +08:00
Aaron Wang
f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources ( #13512 )
2023-02-08 10:20:08 +08:00
kezhenxu94
57db06e1b0
Fix the parameter table is messed up ( #13526 )
2023-02-07 13:45:10 +08:00
xiaojingXU
3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api ( #13475 )
...
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool
* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
旺阳
0ee82c5492
[doc] Update LDAP config doc ( #13507 )
2023-02-04 11:05:51 +08:00
Jay Chung
78e5569afd
[feat] Add type local turn on resource center by default ( #13303 )
2023-01-31 17:39:20 +08:00
Tq
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
Tq
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key ( #13379 )
...
* submit redshift auth mode
* add front end
* add doc and fix frontend
Co-authored-by: devosend <devosend@gmail.com>
2023-01-16 16:21:26 +08:00
kezhenxu94
a843e0b96d
Add documentation to release Helm Chart ( #13385 )
2023-01-15 10:10:31 +08:00
v-wx-v
e39bf59b4b
[fix][data quality] fix when running data quality task with Error "No main class set in JAR" ( #13360 )
2023-01-14 14:50:50 +08:00
Eric Gao
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster ( #13367 )
...
* Add keda autoscaler support for worker deployment when deployed in K8S cluster
* Add mysql scaler for worker autoscaling
* Add docs for worker autoscaler
* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
v-wx-v
3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… ( #13163 )
...
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [improvement][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* update known-dependencies.txt
* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt
Co-authored-by: wangxx <wangxx@kcwl.com>
2023-01-12 18:07:58 +08:00
Kerwin
22958682c4
add 3.1.3 release ( #13357 )
2023-01-10 17:17:51 +08:00
Donald Yang
8f7b141fe7
[Fix-13287][doc]Fix Chinese workflow-definition.md duplication description in execution-type ( #13361 )
2023-01-10 11:33:42 +08:00
lenian
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG (达梦) data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2023-01-04 15:00:24 +08:00
Jay Chung
2c952139b4
feat: Release version 304 ( #13319 )
...
Release new version 304
2023-01-03 15:17:22 +08:00
Aaron Wang
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority ( #13274 )
2022-12-29 11:05:00 +08:00
Jay Chung
aec26f06db
[doc] Correct install_env.sh file name ( #13294 )
...
duplicate #12209
2022-12-28 17:09:57 +08:00
陈家名
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file ( #13271 )
...
* tz in docker
* update default tz and update doc
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-27 14:41:34 +08:00
Amy0104
1f7f900e78
[Fix][Doc] Replace the links. ( #13276 )
...
* [Fix][Doc] Replace the links.
* [Fix][Doc] Revised `.dlc.json`
* [Fix] Fix the dead link.
2022-12-26 14:32:40 +08:00
Tq
06b77b34c7
[doc][datasource-12820] add azure sql database doc ( #13254 )
2022-12-22 16:04:19 +08:00
Wenjun Ruan
14ec4a2398
Remove dao module in worker ( #13242 )
2022-12-22 12:25:29 +08:00
Eric Gao
c213c6fe34
Fix a tiny bug in release doc ( #13239 )
2022-12-21 17:52:56 +08:00
JieguangZhou
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2022-12-18 18:17:09 +08:00
Wenjun Ruan
5c75d312fa
Add StarRocks datasource ( #13204 )
2022-12-17 08:44:39 +08:00
lifeng
84496c5f04
[Fix][Doc]Update pseudo-cluster.md ( #13207 )
...
* Update pseudo-cluster.md
* Update pseudo-cluster.md
2022-12-16 19:58:43 +08:00
Amy0104
dcf02eab45
[Fix] Replaced dead links in the docs. ( #13170 )
...
* [Fix] Replaced dead links.
* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
Aaron Wang
560d232cbd
[Bug][Worker] Fix duplicated key bug when have out parameters of same name ( #12930 )
2022-12-12 11:07:23 +08:00
Kerwin
209af2ad29
Add release 3.1.2 documentation ( #13150 )
2022-12-11 14:26:52 +08:00
longtb
917df4f6ca
[fix-13041] fix example checkFormula ( #13110 )
...
Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
2022-12-10 12:23:44 +08:00
Jay Chung
316496211a
[doc] refactor release ( #13135 )
...
* [doc] refactor release
* [doc] refactor release
2022-12-10 12:20:53 +08:00
Jay Chung
e90cd9e13b
[release] version 3.0.3 ( #13131 )
2022-12-08 16:57:17 +08:00
旺阳
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart ( #12987 )
2022-11-24 15:35:03 +08:00
rickchengx
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2022-11-24 14:54:54 +08:00
insist777
b40c63f02d
[Feature][DataSource]Add trino datasource plugin ( #12911 )
2022-11-23 10:09:02 +08:00
JieguangZhou
6e224d08a2
[fix] Python task can not pass the parameters to downstream task. ( #12961 )
2022-11-22 16:11:45 +08:00
Kerwin
2f8f0952fb
[Bug-12954] [Schedule] Fix that workflow-level configuration information does not take effect when timing triggers execution ( #12955 )
2022-11-22 15:35:29 +08:00
John Bampton
27c00ed377
[Document] Fix grammar and spelling ( #12940 )
2022-11-21 20:58:03 +08:00
Eric Gao
5672337156
[docs] Update new release for 3.0.2 ( #12949 )
2022-11-21 13:50:51 +08:00
John Bampton
27c37b8828
Fix grammar and spelling ( #12937 )
2022-11-18 23:03:34 +08:00
John Bampton
d803658abd
[Document] Fix spelling ( #12935 )
2022-11-18 16:01:20 +08:00
John Bampton
22532fe1d8
[Document] Update faq, fix spelling, remove repeated words ( #12934 )
2022-11-18 15:36:47 +08:00
JieguangZhou
7c90bf01bc
[Improvement][Task Plugin] Improvement Kubeflow task plugin ( #12928 )
...
add example
check phase in status:conditions
2022-11-17 15:59:44 +08:00
Assert
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis ( #12693 )
2022-11-17 10:14:36 +08:00
xuhhui
9e6f4d2bc1
[Improvement][Document]Update architecture and process-start-flow pic ( #12912 )
...
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2022-11-16 16:03:00 +08:00
baihongbin
0373e06615
[Feature-8030][docs] Add sqoop task doc ( #12855 )
...
* [Feature-8030][docs] Add sqoop task doc
* Update docs/docs/zh/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update docs/docs/en/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Feature-8030][docs] Add sqoop task doc
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-11-13 00:09:05 +08:00
JieguangZhou
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario ( #12843 )
2022-11-11 16:08:38 +08:00
Kerwin
019e7475d1
The new Chinese document latest version is 3.1.1 ( #12869 )
2022-11-11 16:06:20 +08:00
Kerwin
a887303d48
add 3.1.1 release doc ( #12864 )
2022-11-11 15:39:47 +08:00
kezhenxu94
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2022-11-11 10:26:57 +08:00
Jay Chung
6896fa9b47
[fix][doc] Dead link for python api ( #12848 )
...
* [fix][doc] Dead link for python api
ref: apache/dolphinscheduler#12779 and
apache/dolphinscheduler-sdk-python#1
* fix dead link
2022-11-10 14:49:11 +08:00
Kerwin
775b3f87b4
[doc] Add skip spotless check during ASF release. ( #12835 )
2022-11-10 14:26:24 +08:00
Jay Chung
1347a8f94c
[chore] Separate Python API into another repository ( #12779 )
...
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2022-11-09 21:20:15 +08:00
Tq
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc ( #12765 )
2022-11-07 17:39:02 +08:00
Eric Gao
6d79414491
Add instructions on how to configure logging level for debugging purpose ( #12699 )
2022-11-07 10:30:56 +08:00
JieguangZhou
a47b4d0672
[Feature][Task] Transfer files between tasks ( #12552 )
...
* add data transfer between tasks
* add delete DATA_TRANSFER API
* convert Result to DeleteDataTransferResponse
* add api UT
* fix final
* fix doc
2022-11-03 16:33:39 +08:00
Tq
4e2701b57e
[doc][fix] Add new alert doc Slack ( #12567 )
2022-11-01 09:49:05 +08:00
amao
b71d4983dd
[Feature-6586][Server]add some ds process definition demo when init ( #11759 )
...
* [Feature-6586][Server]add some ds process definition demo when init
1.add some ds process definition demo when init, to display what task type can run and make user easy to
use ds.
2.need configure the JVM parameters (-Ddemo=true) to turn on the StandaloneServer service
3.need modify the tenant information in it
2022-10-31 22:35:11 +08:00
rickchengx
3c31ddfd9f
[Improvement-12536][k8s] Support the command for the container in k8s task plugin ( #12538 )
2022-10-31 19:06:41 +08:00
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
Wenjun Ruan
e6da1ccf81
Add worker-group-refresh-interval in master config ( #12601 )
...
* Add worker-group-refresh-interval in master config
* Set interval cannot smaller than 10s
* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/config/MasterConfig.java
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-10-31 09:37:26 +08:00
Yiming Guo
064fec88b0
[Feature-12040][docs] Update Granted Permissions Guide for PR#12048 ( #12587 )
...
* Upload new ui screenshots.
* Update document of Granted Permissions.
* Delete unused images.
2022-10-30 17:28:30 +08:00
Kerwin
207b4e77d3
Fix document styles. ( #12600 )
2022-10-29 11:31:19 +08:00
houshitao
4a13148bfc
[Bug] [API] Before deleting a worker group, check whether there is environment that reference the worker group. ( #12534 )
...
* [Bug] [API] Before deleting a worker group, check whether there is environment that reference the worker group.
Co-authored-by: houshitao <shitaohou@163.com>
2022-10-27 16:34:08 +08:00
JieguangZhou
21caec01db
fix doc CI ( #12560 )
2022-10-27 12:41:30 +08:00
Kerwin
63244c8065
Optimized complement documentation ( #12550 )
2022-10-27 09:31:12 +08:00
Wenjun Ruan
76a9e6d8a6
Add task executor threads full policy config in worker ( #12510 )
2022-10-26 10:29:22 +08:00
Jiajie Zhong
8add9744d4
[doc][feat] New release 2.0.7 ( #12507 )
2022-10-24 11:38:17 +08:00
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
simsicon
ba538067f2
[fix] Change the default unix shell executor from sh to bash ( #12180 )
...
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2022-10-18 12:57:37 +08:00
Yann Ann
1d0d26a416
[fix#12170] If the worker's clock early than master node, will ignore dispatch time. ( #12219 )
...
* add doc to guide user configure synchronized clocks.
2022-10-17 10:42:51 +08:00
Yann Ann
7aa8a77fb2
[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable
2022-10-16 12:49:11 +08:00
limaiwang
a725614429
[docs] change optional parameters --jar to --jars for Spark ( #12385 ) ( #12386 )
2022-10-16 12:40:17 +08:00
Chris-Arith
b953cdc559
update english oracle.md ( #12332 )
2022-10-14 11:39:06 +08:00
Eric Gao
c50cc997a8
[Doc][Bug] Fix dead link caused by markdown cross-files anchor ( #12357 )
2022-10-14 10:57:11 +08:00
Jiajie Zhong
501119bbb6
[doc] Change release process base on new tool ( #12324 )
...
ref: #11478 we already have a new tool for releasing
2022-10-12 09:52:14 +08:00
Jiajie Zhong
a973054950
[ci] Milestone and Label are required before the PR merged ( #12222 )
...
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for
* label: In this path we required label with at least on with
'feature|bug|improvement|document|chore' to make our changelog
more convenient
* milestone: For easier to cherry-pick PR, currently some of
our milestone only exists in issue and not exists in related
PR, it may
2022-10-10 15:20:51 +08:00
tuchg
ef328d9cea
Update ZooKeeper minimum version requirements ( #12284 ) ( #12288 )
2022-10-10 15:08:07 +08:00
Chris-Arith
c8bd106604
create oracle help.md ( #12218 )
...
* create oracle help.md
* Add files via upload
allow Oracle to choose schema
* move pic under img and add title for oracle.md
2022-10-10 13:53:20 +08:00
fuchanghai
9b1ee1516f
[doc] Correct descriptions in glossary.md ( #12282 )
2022-10-10 09:37:15 +08:00
Tq
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2022-10-09 10:47:01 +08:00
TyrantLucifer
61457d1c2f
[Hotfix][Docs] Fix 404 dead links ( #12261 )
2022-10-08 19:43:35 +08:00
David
7bdbd62985
[doc] Update slack invitation link ( #12258 )
2022-10-08 11:59:53 +08:00
Yann Ann
7beff83e9f
[Doc] Add chmod command after unzip DS tar.gz ( #12210 )
2022-10-07 13:07:36 +08:00
Jiajie Zhong
6fc209ab9d
[fix][doc] Correct release export key step ( #12228 )
...
We should only add KEY to release/KEYS instead of
dev/KEYS, according to
https://lists.apache.org/thread/2gppxc04n0r87vq4qy4j3n52zwhqd442
2022-10-01 21:58:59 +08:00
caishunfeng
40090d459e
[Improvement] remove log-server and server module ( #12206 )
...
* remove log-server module
* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
Wenjun Ruan
aacabc6ec7
Remove workerGroup in registry ( #12217 )
2022-09-30 13:58:53 +08:00
caishunfeng
a055cf5791
[Release][Doc] add 3.1.0 release ( #12227 )
...
* [Release] add 3.1.0 release to doc
2022-09-30 12:14:29 +08:00
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2022-09-30 10:16:16 +08:00
Jiajie Zhong
d3f087e29b
[feat][ci] Add pre-commit for easy spotless config ( #12192 )
...
* Use pre-commit to handle spotless check
* Migrate exists python pre-commit-config into dir root one
* Change related document
2022-09-29 10:10:53 +08:00
darkz
995c1480f9
[Document][Improvement] Polish docs for standalone deployment ( #12181 )
...
* Polish docs for standalone deployment
2022-09-28 20:32:22 +08:00
TyrantLucifer
4973b30efb
[Feature][doc] Add a guide to nominate new committer ( #12175 )
...
Co-authored-by: Kirs <ACM_China@yeah.net>
2022-09-28 14:23:09 +08:00
Jiajie Zhong
b95db44130
[fix][doc] Do not change docsdev.js during releasing ( #12151 )
...
ref: https://github.com/apache/dolphinscheduler/pull/12146#discussion_r979708629
and https://github.com/apache/dolphinscheduler-website/pull/829
2022-09-26 21:46:18 +08:00
Kerwin
4269fa7ea7
[release][doc] Add release 3.0.1 ( #12139 )
...
* add release 3.0.1
* add 30x version in the github bug report
2022-09-26 16:18:31 +08:00
冯剑
779a0b9c75
[Improvement-#11608][task-plugin] New time variables are added to facilitate business development ( #11667 )
...
Add new time expressions for users' convenience
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
Co-authored-by: David <dailidong66@gmail.com>
2022-09-26 16:01:32 +08:00
zhuxt2015
e6832220c3
[Improvement][SQL Task]use default sql segment separator ( #10869 )
2022-09-26 11:08:57 +08:00
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement ( #12121 )
...
* Add instructions for process execution type and data complement
* Fix and polish the docs
2022-09-24 09:59:02 +08:00
rickchengx
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2022-09-21 20:27:28 +08:00
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2022-09-21 10:45:05 +08:00
Eric Gao
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2022-09-20 22:44:06 +08:00
songjianet
8cddb10773
[Feat][UI] Update package. ( #12046 )
...
* [Feat][UI] Update package.
* [Feat][UI] Update package.
2022-09-19 20:58:41 +08:00
Kerwin
89d55bc9b7
Fix link errors in release documentation. ( #12049 )
2022-09-19 20:01:23 +08:00
Eric Gao
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2022-09-17 11:33:32 +08:00
rickchengx
5b6bebf7d5
[fix][doc] Update the registry related configuration in values.yaml ( #11444 )
2022-09-16 10:38:27 +08:00
ZhaoGuodong
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena ( #11157 )
2022-09-16 09:59:20 +08:00
kezhenxu94
b73a9511a7
Remove sensitive configs from dolphinscheduler_env.sh ( #11917 )
2022-09-15 19:03:47 +08:00
Eric Gao
a88cb02ee8
[improve][Doc] Put default task parameters in a new file ( #11776 )
...
* Put default task parameters in a new file
* Add links to task plugin default parameters appendix docs
* Update Chinese docs
2022-09-15 10:32:10 +08:00
caishunfeng
0deafba12c
fix procedure task param pass ( #11919 )
2022-09-14 13:44:01 +08:00
JieguangZhou
892d867270
[Doc][Task Plugin] Fix MLflow task plugin doc ( #11905 )
...
* update mlflow doc
* fix punctuations
2022-09-13 16:20:03 +08:00
fuchanghai
070b8c2546
[fix-#11830]fix doc about sub-process's child node describe ( #11837 )
...
* [fix-#11830]fix doc
* Update docs/docs/en/guide/task/sub-process.md
2022-09-13 10:05:59 +08:00
kezhenxu94
105773f54d
Remove htrace dependencies ( #11881 )
...
* Remove htrace dependencies
* Update pom.xml
2022-09-10 22:54:38 +08:00
juzimao
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2022-09-09 10:37:24 +08:00