Commit Graph

388 Commits

Author SHA1 Message Date
rickchengx 08a4c7981f
[improve] Remove the spark version of spark task (#11860) 2022-09-21 20:27:28 +08:00
JieguangZhou cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use (#12071)
optimize code
2022-09-21 10:45:05 +08:00
Eric Gao 66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708)
* Add support for Alibaba Cloud OSS as storage of resource center

* Add dependency licenses

* Refactor code, add unit tests and related docs
2022-09-20 22:44:06 +08:00
songjianet 8cddb10773
[Feat][UI] Update package. (#12046)
* [Feat][UI] Update package.

* [Feat][UI] Update package.
2022-09-19 20:58:41 +08:00
Kerwin 89d55bc9b7
Fix link errors in release documentation. (#12049) 2022-09-19 20:01:23 +08:00
Eric Gao a44817fc46
[Doc][Style] Fix doc format once for all (#12006) 2022-09-17 11:33:32 +08:00
rickchengx 5b6bebf7d5
[fix][doc] Update the registry related configuration in values.yaml (#11444) 2022-09-16 10:38:27 +08:00
ZhaoGuodong 86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) 2022-09-16 09:59:20 +08:00
kezhenxu94 b73a9511a7
Remove sensitive configs from dolphinscheduler_env.sh (#11917) 2022-09-15 19:03:47 +08:00
Eric Gao a88cb02ee8
[improve][Doc] Put default task parameters in a new file (#11776)
* Put default task parameters in a new file
* Add links to task plugin default parameters appendix docs
* Update Chinese docs
2022-09-15 10:32:10 +08:00
caishunfeng 0deafba12c
fix procedure task param pass (#11919) 2022-09-14 13:44:01 +08:00
JieguangZhou 892d867270
[Doc][Task Plugin] Fix MLflow task plugin doc (#11905)
* update mlflow doc

* fix punctuations
2022-09-13 16:20:03 +08:00
fuchanghai 070b8c2546
[fix-#11830]fix doc about sub-process's child node describe (#11837)
* [fix-#11830]fix doc

* Update docs/docs/en/guide/task/sub-process.md
2022-09-13 10:05:59 +08:00
kezhenxu94 105773f54d
Remove htrace dependencies (#11881)
* Remove htrace dependencies

* Update pom.xml
2022-09-10 22:54:38 +08:00
juzimao 5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689) 2022-09-09 10:37:24 +08:00
kezhenxu94 efedc9a53c
Bump up dependencies to fix cves (#11765) 2022-09-08 09:05:05 +08:00
xiangzihao f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc (#11804) 2022-09-07 09:45:51 +08:00
阿福Chris c76301ab51
[Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326)
* add postgresql config for datasoruce-setting

* Update docs/docs/en/guide/howto/datasource-setting.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-05 10:54:01 +08:00
kezhenxu94 31ba49ac02
Update doc according to recent update of Spring / Swagger (#11755) 2022-09-02 19:06:15 +08:00
kezhenxu94 277f137358
Add Kubernetes configmap reload to all components (#11730) 2022-09-02 12:03:19 +08:00
Evans Sun 5fabce783a
[DOC] improve zk digest doc (#11703) 2022-08-30 21:07:04 +08:00
Eric Gao 4a37345436
[Feature][Task Plugin] Support hive cli task plugin (#11651)
* Add hive cli task plugin

* Add docs for hive-cli task plugin

* Fix hive-cli task related front-end nits and checkstyle

* Fix exception handling logic
2022-08-30 10:45:51 +08:00
旺阳 6e4d974b91
[doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629) 2022-08-28 17:44:06 +08:00
Yann Ann eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 (#11621) 2022-08-26 10:58:56 +08:00
fuchanghai ce8db1c5fb
[improvement-#11630]fix document about common.properties (#11653) 2022-08-26 10:50:31 +08:00
Wenjun Ruan b96d69701a
[Improvement-#11613] Add spi priority factory (#11614)
* Add spi priority factory

* Add doc

* Add override log

* Use lombok

* Add comment
2022-08-24 19:51:47 +08:00
Eric Gao 3e73829924
Fix homepage email subscription link (#11622)
* Fix homepage email link bug

* Replace dev with latest
2022-08-24 09:25:23 +08:00
Eric Gao ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode (#11600)
* Fix resource center docs for standalone mode

* Remove useless images
2022-08-23 09:46:01 +08:00
labbomb 5813a61f09
feat: update slack (#11578) 2022-08-22 11:03:50 +08:00
monster 3e360a8ecb
[Improvement-11550] [Doc]Document content update (#11577)
* [Improvement-11550] [Doc]Document content update

* Update pictures

* fix

* Update Process word to Workflow

Co-authored-by: David <davidzollo365@gmail.com>
2022-08-22 00:00:42 +08:00
Eric Gao 277c78010f
Enable spotless to fix markdown checkstyle and refactor faq.md as an example (#11384) 2022-08-18 16:48:22 +08:00
JieguangZhou a974ba74ab
[Feature] New task plugin Pytorch (#11498)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
sgw 8ec2f79248
[DS-11481][docs] Add log specification document to contribution guidelines. (#11484) 2022-08-17 21:57:02 +08:00
lugela e5d06c40a5
[Feature-10182][task-datax] (#11387)
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2022-08-17 10:01:20 +08:00
Eric Gao 9330d6cfcd
[Doc][Security] Update instructions on worker groups (#11483)
* Update instructions on worker groups
2022-08-15 17:44:00 +08:00
Qi Zhang a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
Wenjun Ruan 7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368)
* Add waiting strategy to support master/worker can recover from registry lost

* throw exception when zookeeper registry start failed due to interrupted
2022-08-13 09:52:03 +08:00
Eric Gao e3c6ace81d
[Doc][DSIP] Move DSIP docs to the right place (#11442) (#11443) 2022-08-12 11:20:12 +08:00
Eric Gao 9d6fc92af9
[Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11435)
* [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11427)

* Remove dead link in pyds README

* Add hyperlinks for docs

Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-08-12 00:18:43 +08:00
labbomb de4e4af844
feat: Modifying Slack Links (#11416)
* feat: Modifying Slack Links

* append

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-11 13:11:23 +08:00
Jiajie Zhong 26afd655cb
[python] Add multiple version of document (#11391)
* Using sphinx-multiversion to support multiple version
of python api document
* change python api sidebar link
* fix whitelist_externals deprecated and add git

close: #8227
2022-08-11 12:02:29 +08:00
Shuo Zhang 50380e008f
[doc] Add how obtain IP address from network card in FAQ (#11311)
This pull request update the FAQ doc (faq.md) by adding how to obtain the IP address
from the specified network card, which is part of relevant information created when 
the master service and worker service are registered with zookeeper.
2022-08-11 09:49:47 +08:00
Jiajie Zhong 278371bcb9
[doc] Recover traffic configuration (#11288)
some config about traffic is deleted by
accident in #11113 this patch recover it
2022-08-11 09:46:43 +08:00
caishunfeng 0464123c2b
[Feature-11223] support stream task (#11350)
* add task execute type

* update task definition list paging

* update task instance list paging

* stream task start

* [Feature][UI] Some changes to execute task.
    * Set the connection edge to dashed line.
    * Add FLINK_STREAM task.

* add stream task

* flink savepoint and cancel

* fix query bug

* add stream task definition

* add task instance for stream task

* delete stream task definition state

* update api for stream task definition edit

* modify search for stream task instance

* add language

* delete task type search for stream task definition

* change task type search for stream task instance

* add jump button

* add savepoint

* add down log for stream task instance

* ui test

* stream task start

* run DAG

* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.

* [Feature][UI] Remove some fields for FLINK_STREAM.

* add start modal

* add dryRun column for stream task instance

* fix duration

* fix pon

* fix build error

* Add success tip

* add auto sync for stream task instance

* remove forgien key for task instance

* license header

* UT fix

* modify locales

* recover common config

* fix UT

* add doc

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-08-10 21:44:43 +08:00
insist777 e9ccaffbe0
[doc] Refine the deployment documentation (#11361) 2022-08-09 19:35:49 +08:00
insist777 8ad6e10da5
[doc] Improve the document introduction of complement (#11275) 2022-08-09 19:35:25 +08:00
Jiajie Zhong c4fdfc7a55
[doc] Fixed hadoop link to avoid dead link (#11363)
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html#jar
point to the latest docs and will be changed more frequent than fixed link
https://hadoop.apache.org/docs/r3.2.4/hadoop-project-dist/hadoop-common/CommandsManual.html#jar.
So I change to the fixed link
2022-08-09 13:34:49 +08:00
Jiajie Zhong 2865b17ed4
[release] New release version 3.0.0 (#11356) 2022-08-09 09:47:15 +08:00
xiangzihao 983f9b41bf
[Doc] Add tools/libs to the init database steps (#11345) 2022-08-08 21:53:23 +08:00
Jiajie Zhong d16c63528f
[community] Remove stackoverflow ref link in website (#11342)
* Our community do not have official support for stack overflow any more
* Change the order side for Slack and mailing list, to avoid some users
  just want to ask question but join mailing list, and then unsubscribe
  found there are too many emails in mailing list
2022-08-08 11:24:09 +08:00