207b4e77d3
Fix document styles. ( #12600 )
2022-10-29 11:31:19 +08:00
4a13148bfc
[Bug] [API] Before deleting a worker group, check whether there is environment that reference the worker group. ( #12534 )
...
* [Bug] [API] Before deleting a worker group, check whether there is environment that reference the worker group.
Co-authored-by: houshitao <shitaohou@163.com>
2022-10-27 16:34:08 +08:00
21caec01db
fix doc CI ( #12560 )
2022-10-27 12:41:30 +08:00
63244c8065
Optimized complement documentation ( #12550 )
2022-10-27 09:31:12 +08:00
76a9e6d8a6
Add task executor threads full policy config in worker ( #12510 )
2022-10-26 10:29:22 +08:00
8add9744d4
[doc][feat] New release 2.0.7 ( #12507 )
2022-10-24 11:38:17 +08:00
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
ba538067f2
[fix] Change the default unix shell executor from sh to bash ( #12180 )
...
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2022-10-18 12:57:37 +08:00
1d0d26a416
[fix#12170] If the worker's clock early than master node, will ignore dispatch time. ( #12219 )
...
* add doc to guide user configure synchronized clocks.
2022-10-17 10:42:51 +08:00
7aa8a77fb2
[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable
2022-10-16 12:49:11 +08:00
a725614429
[docs] change optional parameters --jar to --jars for Spark ( #12385 ) ( #12386 )
2022-10-16 12:40:17 +08:00
b953cdc559
update english oracle.md ( #12332 )
2022-10-14 11:39:06 +08:00
c50cc997a8
[Doc][Bug] Fix dead link caused by markdown cross-files anchor ( #12357 )
2022-10-14 10:57:11 +08:00
501119bbb6
[doc] Change release process base on new tool ( #12324 )
...
ref: #11478 we already have a new tool for releasing
2022-10-12 09:52:14 +08:00
a973054950
[ci] Milestone and Label are required before the PR merged ( #12222 )
...
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for
* label: In this path we required label with at least on with
'feature|bug|improvement|document|chore' to make our changelog
more convenient
* milestone: For easier to cherry-pick PR, currently some of
our milestone only exists in issue and not exists in related
PR, it may
2022-10-10 15:20:51 +08:00
ef328d9cea
Update ZooKeeper minimum version requirements ( #12284 ) ( #12288 )
2022-10-10 15:08:07 +08:00
c8bd106604
create oracle help.md ( #12218 )
...
* create oracle help.md
* Add files via upload
allow Oracle to choose schema
* move pic under img and add title for oracle.md
2022-10-10 13:53:20 +08:00
9b1ee1516f
[doc] Correct descriptions in glossary.md ( #12282 )
2022-10-10 09:37:15 +08:00
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2022-10-09 10:47:01 +08:00
61457d1c2f
[Hotfix][Docs] Fix 404 dead links ( #12261 )
2022-10-08 19:43:35 +08:00
7bdbd62985
[doc] Update slack invitation link ( #12258 )
2022-10-08 11:59:53 +08:00
7beff83e9f
[Doc] Add chmod command after unzip DS tar.gz ( #12210 )
2022-10-07 13:07:36 +08:00
6fc209ab9d
[fix][doc] Correct release export key step ( #12228 )
...
We should only add KEY to release/KEYS instead of
dev/KEYS, according to
https://lists.apache.org/thread/2gppxc04n0r87vq4qy4j3n52zwhqd442
2022-10-01 21:58:59 +08:00
40090d459e
[Improvement] remove log-server and server module ( #12206 )
...
* remove log-server module
* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
aacabc6ec7
Remove workerGroup in registry ( #12217 )
2022-09-30 13:58:53 +08:00
a055cf5791
[Release][Doc] add 3.1.0 release ( #12227 )
...
* [Release] add 3.1.0 release to doc
2022-09-30 12:14:29 +08:00
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2022-09-30 10:16:16 +08:00
d3f087e29b
[feat][ci] Add pre-commit for easy spotless config ( #12192 )
...
* Use pre-commit to handle spotless check
* Migrate exists python pre-commit-config into dir root one
* Change related document
2022-09-29 10:10:53 +08:00
995c1480f9
[Document][Improvement] Polish docs for standalone deployment ( #12181 )
...
* Polish docs for standalone deployment
2022-09-28 20:32:22 +08:00
4973b30efb
[Feature][doc] Add a guide to nominate new committer ( #12175 )
...
Co-authored-by: Kirs <ACM_China@yeah.net>
2022-09-28 14:23:09 +08:00
b95db44130
[fix][doc] Do not change docsdev.js during releasing ( #12151 )
...
ref: https://github.com/apache/dolphinscheduler/pull/12146#discussion_r979708629
and https://github.com/apache/dolphinscheduler-website/pull/829
2022-09-26 21:46:18 +08:00
4269fa7ea7
[release][doc] Add release 3.0.1 ( #12139 )
...
* add release 3.0.1
* add 30x version in the github bug report
2022-09-26 16:18:31 +08:00
779a0b9c75
[Improvement-#11608][task-plugin] New time variables are added to facilitate business development ( #11667 )
...
Add new time expressions for users' convenience
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
Co-authored-by: David <dailidong66@gmail.com>
2022-09-26 16:01:32 +08:00
e6832220c3
[Improvement][SQL Task]use default sql segment separator ( #10869 )
2022-09-26 11:08:57 +08:00
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement ( #12121 )
...
* Add instructions for process execution type and data complement
* Fix and polish the docs
2022-09-24 09:59:02 +08:00
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2022-09-21 20:27:28 +08:00
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2022-09-21 10:45:05 +08:00
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2022-09-20 22:44:06 +08:00
8cddb10773
[Feat][UI] Update package. ( #12046 )
...
* [Feat][UI] Update package.
* [Feat][UI] Update package.
2022-09-19 20:58:41 +08:00
89d55bc9b7
Fix link errors in release documentation. ( #12049 )
2022-09-19 20:01:23 +08:00
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2022-09-17 11:33:32 +08:00
5b6bebf7d5
[fix][doc] Update the registry related configuration in values.yaml ( #11444 )
2022-09-16 10:38:27 +08:00
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena ( #11157 )
2022-09-16 09:59:20 +08:00
b73a9511a7
Remove sensitive configs from dolphinscheduler_env.sh ( #11917 )
2022-09-15 19:03:47 +08:00
a88cb02ee8
[improve][Doc] Put default task parameters in a new file ( #11776 )
...
* Put default task parameters in a new file
* Add links to task plugin default parameters appendix docs
* Update Chinese docs
2022-09-15 10:32:10 +08:00
0deafba12c
fix procedure task param pass ( #11919 )
2022-09-14 13:44:01 +08:00
892d867270
[Doc][Task Plugin] Fix MLflow task plugin doc ( #11905 )
...
* update mlflow doc
* fix punctuations
2022-09-13 16:20:03 +08:00
070b8c2546
[fix-#11830]fix doc about sub-process's child node describe ( #11837 )
...
* [fix-#11830]fix doc
* Update docs/docs/en/guide/task/sub-process.md
2022-09-13 10:05:59 +08:00
105773f54d
Remove htrace dependencies ( #11881 )
...
* Remove htrace dependencies
* Update pom.xml
2022-09-10 22:54:38 +08:00
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2022-09-09 10:37:24 +08:00
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2022-09-08 09:05:05 +08:00
f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc ( #11804 )
2022-09-07 09:45:51 +08:00
c76301ab51
[Fix-11217] [Doc] add postgresql config in doc: datasource-setting ( #11326 )
...
* add postgresql config for datasoruce-setting
* Update docs/docs/en/guide/howto/datasource-setting.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-05 10:54:01 +08:00
31ba49ac02
Update doc according to recent update of Spring / Swagger ( #11755 )
2022-09-02 19:06:15 +08:00
277f137358
Add Kubernetes configmap reload to all components ( #11730 )
2022-09-02 12:03:19 +08:00
5fabce783a
[DOC] improve zk digest doc ( #11703 )
2022-08-30 21:07:04 +08:00
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2022-08-30 10:45:51 +08:00
6e4d974b91
[doc] Correct E2E Doc, fix WorkerGroupPage typo ( #11629 )
2022-08-28 17:44:06 +08:00
eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 ( #11621 )
2022-08-26 10:58:56 +08:00
ce8db1c5fb
[improvement-#11630]fix document about common.properties ( #11653 )
2022-08-26 10:50:31 +08:00
b96d69701a
[Improvement-#11613] Add spi priority factory ( #11614 )
...
* Add spi priority factory
* Add doc
* Add override log
* Use lombok
* Add comment
2022-08-24 19:51:47 +08:00
3e73829924
Fix homepage email subscription link ( #11622 )
...
* Fix homepage email link bug
* Replace dev with latest
2022-08-24 09:25:23 +08:00
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode ( #11600 )
...
* Fix resource center docs for standalone mode
* Remove useless images
2022-08-23 09:46:01 +08:00
5813a61f09
feat: update slack ( #11578 )
2022-08-22 11:03:50 +08:00
3e360a8ecb
[Improvement-11550] [Doc]Document content update ( #11577 )
...
* [Improvement-11550] [Doc]Document content update
* Update pictures
* fix
* Update Process word to Workflow
Co-authored-by: David <davidzollo365@gmail.com>
2022-08-22 00:00:42 +08:00
277c78010f
Enable spotless to fix markdown checkstyle and refactor faq.md as an example ( #11384 )
2022-08-18 16:48:22 +08:00
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
8ec2f79248
[DS-11481][docs] Add log specification document to contribution guidelines. ( #11484 )
2022-08-17 21:57:02 +08:00
e5d06c40a5
[Feature-10182][task-datax] ( #11387 )
...
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2022-08-17 10:01:20 +08:00
9330d6cfcd
[Doc][Security] Update instructions on worker groups ( #11483 )
...
* Update instructions on worker groups
2022-08-15 17:44:00 +08:00
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster ( #10951 )
...
* [doc] Use Rainbond deployment DolphinScheduler Cluster
Signed-off-by: Qi Zhang <smallqi1@163.com>
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* [doc] modify rainbond doc and add image
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: img link
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: modify proposal
Signed-off-by: Qi Zhang <smallqi1@163.com>
* docs: move rainbond docs to integration
Signed-off-by: Qi Zhang <smallqi1@163.com>
Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost ( #11368 )
...
* Add waiting strategy to support master/worker can recover from registry lost
* throw exception when zookeeper registry start failed due to interrupted
2022-08-13 09:52:03 +08:00
e3c6ace81d
[Doc][DSIP] Move DSIP docs to the right place ( #11442 ) ( #11443 )
2022-08-12 11:20:12 +08:00
9d6fc92af9
[Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local ( #11435 )
...
* [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11427 )
* Remove dead link in pyds README
* Add hyperlinks for docs
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-08-12 00:18:43 +08:00
de4e4af844
feat: Modifying Slack Links ( #11416 )
...
* feat: Modifying Slack Links
* append
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-11 13:11:23 +08:00
26afd655cb
[python] Add multiple version of document ( #11391 )
...
* Using sphinx-multiversion to support multiple version
of python api document
* change python api sidebar link
* fix whitelist_externals deprecated and add git
close : #8227
2022-08-11 12:02:29 +08:00
50380e008f
[doc] Add how obtain IP address from network card in FAQ ( #11311 )
...
This pull request update the FAQ doc (faq.md) by adding how to obtain the IP address
from the specified network card, which is part of relevant information created when
the master service and worker service are registered with zookeeper.
2022-08-11 09:49:47 +08:00
278371bcb9
[doc] Recover traffic configuration ( #11288 )
...
some config about traffic is deleted by
accident in #11113 this patch recover it
2022-08-11 09:46:43 +08:00
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-08-10 21:44:43 +08:00
e9ccaffbe0
[doc] Refine the deployment documentation ( #11361 )
2022-08-09 19:35:49 +08:00
8ad6e10da5
[doc] Improve the document introduction of complement ( #11275 )
2022-08-09 19:35:25 +08:00
c4fdfc7a55
[doc] Fixed hadoop link to avoid dead link ( #11363 )
...
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html#jar
point to the latest docs and will be changed more frequent than fixed link
https://hadoop.apache.org/docs/r3.2.4/hadoop-project-dist/hadoop-common/CommandsManual.html#jar .
So I change to the fixed link
2022-08-09 13:34:49 +08:00
2865b17ed4
[release] New release version 3.0.0 ( #11356 )
2022-08-09 09:47:15 +08:00
983f9b41bf
[Doc] Add tools/libs to the init database steps ( #11345 )
2022-08-08 21:53:23 +08:00
d16c63528f
[community] Remove stackoverflow ref link in website ( #11342 )
...
* Our community do not have official support for stack overflow any more
* Change the order side for Slack and mailing list, to avoid some users
just want to ask question but join mailing list, and then unsubscribe
found there are too many emails in mailing list
2022-08-08 11:24:09 +08:00
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail ( #11333 )
...
* [Bug][Doc] Fix typo in docs
* Remove dead links and update related docs
2022-08-06 20:50:48 +08:00
6a02870926
[Feature][style] Add spotless maven plugin for automatic style fix. ( #11272 )
...
* [Feature][style] Add spotless maven plugin for automatic style fix (#10963 )
* Fix spotless ratchet configuration
* Remove license-check and decrease line length threshold value
* Update related docs
* Remove checkstyle and add pre-commit hook
* Test updated pre-commit hook
* Replace checkstyle with spotless in CI
* Remove reviewdog
2022-08-06 19:29:23 +08:00
bf5f7a88c5
[doc] migrate community and development docs into main repo ( #11313 )
2022-08-05 17:58:39 +08:00
39186b1a6d
[Doc] update the configuration doc ( #11113 )
2022-08-04 11:55:05 +08:00
dc3ab6af11
[doc] Add notice when environment can not select ( #11276 )
...
ref: #11249
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-04 11:08:11 +08:00
9ca1eb96c4
[Improvement][Metrics] Add metrics for alert server ( #11240 )
...
* [Improvement][Metrics] Add metrics for alert server (#11131 )
* Update related docs of metrics
* Add grafana demo dashboards for alert server metrics
* Refactor metric classes with UtilityClass annotation
* Refactor meter names in camelCase for checkstyle
2022-08-03 15:42:06 +08:00
01fc6c8a3a
[doc] Fix installation typo ( #11220 )
...
Co-authored-by: xiangzihao <460888207@qq.com>
2022-08-01 10:03:53 +08:00
d73ad2e7d5
[BUG-11181] [Document] text check ( #11183 )
2022-07-29 23:49:46 +08:00
513f336015
[Feature] Add new task type chunjun ( #10937 )
2022-07-28 19:25:29 +08:00
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js ( #11173 )
...
add Feishu alert doc and configure email alert doc to the docsdev.js
2022-07-28 17:21:32 +08:00
de5c22b276
[doc] Add new page incompatible change ( #11153 )
...
Add incompatibles and give some hint to user when then
want to upgrade to specific version.
ref: #10607
2022-07-27 11:15:09 +08:00
8b50578bdb
[doc] Fix bugs in doc installation, design and glossary ( #11084 )
2022-07-26 18:08:19 +08:00
c28774e5dd
[Doc]Chinese translation updated ( #11146 )
...
* Update python.md Chinese translations
* Update zeppelin.md Chinese translations
2022-07-26 14:33:38 +08:00
0e15ce3389
[Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics ( #11128 )
...
* [Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#10867 )
* Update docs and grafana demo dashboards
2022-07-26 13:44:02 +08:00
952aee80e7
[fix] py sagemaker doc ( #11109 )
2022-07-22 22:57:50 +08:00
5b429d29b8
add oracle dependency ( #11095 )
2022-07-22 09:49:20 +08:00
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production ( #11010 )
...
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584 )
* Add front-end and update docs for the production mode of zeppelin task
* Fix minor front-end bug of zeppelin task plugin
* Refactor ZeppelinParameters with lombok
* Fix formatting
* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
2022-07-20 14:16:47 +08:00
a38fa34d43
[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks ( #10925 )
...
* [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814 )
2022-07-15 09:26:28 +08:00
08cfbc73e0
[doc] Add missing doc change by snehal ( #10892 )
2022-07-12 14:16:00 +08:00
2f7281c2d2
[Feature][Metrics] Add resource download related metrics for workers ( #10749 )
...
* [Feature][Metrics] Add resource download related metrics for workers (#9324 )
* [Feature][Metrics] Fix bugs and add grafana demos for worker resource download metrics (#9324 )
* [Feature][Metrics] Add docs to resource related metrics (#9324 )
* [Feature][Metrics] Use tags to indicate status in metrics (#9324 )
* [Feature][Metrics] Fix demos, docs and remove redundant code (#9324 )
* [Feature][Metrics] Remove .pnpm-debug.log (#9324 )
* [Feature][Metrics] Fix style check (#9324 )
* [Feature][Metrics] Replace KB with bytes for the unit of resource file size in metrics (#9324 )
* [Feature][Metrics] Make code neat (#9324 )
2022-07-12 11:44:34 +08:00
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster ( #10657 )
...
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
057a9f6b24
[Fix-10830][Doc] Change the start or install script command sh in the document to bash ( #10831 )
...
* Change sh to bash
Change the script execution command sh to bash
* Change sh to bash
Change the script execution command sh to bash
* Change sh to bash
Change the script execution command sh to bash
* Change sh to bash
Change the script execution command sh to bash
* Change sh to bash
Co-authored-by: luke <luke.yan@china-entercom.net>
2022-07-09 15:41:56 +08:00
1387fb3ccf
[Doc][Upgrade] Fix tiny error in upgrade docs ( #10847 )
...
* [Doc][Upgrade] Fix tiny error in upgrade docs (#10846 )
* [Doc][Upgrade] Add useSSL=false and fix typo in upgrade docs (#10846 )
2022-07-09 14:53:05 +08:00
503cf179eb
[doc] 206 drop down doc not work ( #10855 )
2022-07-08 23:24:34 +08:00
d29592da1d
New version release 2.0.6 ( #10851 )
...
* New version release 2.0.6
* remove verison 1.3.8 and 1.3.9
2022-07-08 20:34:14 +08:00
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster ( #10650 )
...
* server code
* namespace ui
* fix dao test
* fix test
* fix
* docs and image update
Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
71f0168510
[Feature] Enable users to create python env from requirements.txt ( #10658 )
2022-07-06 15:56:39 +08:00
2d8b4932b3
[doc] Correct custom jdbc driver for K8s Doc ( #10768 )
2022-07-06 10:57:14 +08:00
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. ( #10713 )
2022-07-05 21:58:05 +08:00
91b59dee54
[doc] Modified dq, monitor, security, resources ( #10715 )
2022-07-05 20:50:37 +08:00
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node ( #10480 )
2022-07-05 19:21:30 +08:00
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL ( #10640 )
2022-07-05 10:07:24 +08:00
7aad6a6515
[doc] Unify data source switching of the docs during installation ( #10688 )
2022-07-04 16:28:14 +08:00
6cf9d088ff
[doc] Change tasks docs ( #10751 )
2022-07-04 11:29:59 +08:00
423cc5b9be
[doc] Modified project doc. ( #10711 )
2022-07-04 10:23:25 +08:00
4f0a02eb43
[chore] update by release version ( #10742 )
...
* update 3.0.0-beta-2 doc
* update history-versions doc
2022-07-04 10:05:29 +08:00
fb8d0c858b
Merging general settings to faq ( #10716 )
...
* Merging general settings to faq
* also change the zh position
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-07-01 17:18:02 +08:00
fb90a0e558
[doc] Modify quick start. ( #10712 )
2022-07-01 16:51:07 +08:00
0cdae777ab
[doc] Modified alert doc files ( #10714 )
2022-07-01 16:29:00 +08:00
4a3c3e7797
[feature][task-flink] Support Flink application mode ( #9577 )
2022-07-01 12:20:38 +08:00
65ebdbef98
[doc] Change tasks doc ( #10639 )
2022-07-01 01:46:04 +08:00
7898f41dc0
[doc] Change datasource doc ( #10660 )
2022-06-30 23:33:59 +08:00
a45fc5b032
[doc] Add doc for pre-sql and post-sql ( #10685 )
2022-06-30 20:01:23 +08:00
c2f1886306
[doc] Update metadata and design doc ( #10600 )
2022-06-30 17:48:17 +08:00
1cdbbc1ba5
[doc] Modified parameter doc files. ( #10659 )
2022-06-29 14:42:37 +08:00
1f46078ab8
[doc] Change subprocess dependent ( #10637 )
2022-06-27 19:30:35 +08:00
a14b96b091
[doc] Modify Shell task file ( #10634 )
2022-06-27 17:22:09 +08:00
cd51a22940
[doc] Correct installPath when using related path ( #10597 )
...
correct the doc and add hint to setting
ref: #10511
2022-06-27 11:02:19 +08:00
16144a8858
[docs] Add links to metrics docs ( #10583 )
2022-06-24 17:27:40 +08:00
b2df357814
[doc] Add run the task alone doc. ( #10581 )
2022-06-24 16:59:22 +08:00
33cc68ed4a
[doc] Add doc about how to use healthcheck endpoints ( #10592 )
2022-06-24 16:56:26 +08:00
b21e211d2c
[doc] Add docs about complement dependent mode ( #10587 )
2022-06-24 16:33:10 +08:00
773ebc9e52
fix 10513 ( #10564 )
2022-06-23 13:44:22 +08:00
1b1a567fec
[doc] Correct the complement add docs ( #10521 )
2022-06-23 12:02:28 +08:00
3918140e7e
[fix][doc] Add DVC task plugin doc link ( #10529 )
2022-06-23 10:01:49 +08:00
0aba68f335
[Improvement][Metrics] Update some metrics names in grafana-demo dashboards ( #10432 ) ( #10552 )
2022-06-22 23:05:54 +08:00
cc06eaaf54
[Improvement][Metrics] Apply micrometer naming convention to metrics ( #10477 )
...
* Apply micrometer naming convention to worker metrics
* Apply micrometer naming convention all current metrics
* Fix remaining metrics names, update English docs and add Chinese docs
* Fix metrics names in grafana-demo dashboards
2022-06-21 14:27:06 +08:00
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario ( #10372 ) ( #10407 )
2022-06-21 13:13:46 +08:00
6e4b2e6992
[Fix]Recovery Traffic Control Config ( #10505 )
...
* recovery traffic config
* run ci
* update
2022-06-20 18:43:48 +08:00
64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task ( #10337 )
2022-06-20 14:47:44 +08:00
704e633659
[Doc] Add api test doc ( #10499 )
2022-06-19 13:55:23 +08:00
4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note ( #10434 )
2022-06-18 13:34:24 +08:00
2c227ab384
[Feature-10363][server] S3 Resource center supports bucket customization ( #10433 )
...
* [Feature-10363][server] S3 Resource center supports bucket customization
* Modify the configuration. Sort out HDFS and S3 configurations to distinguish them
* Modify the configuration comment to clarify the configuration meaning
* Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage
* Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties
* Modified code to support bucket customization
* Check that the bucket on personal permission, Otherwise, the startup fails
* S3 increase support resource. Storage. Upload. Base. The base path path
* Change S3Utils implementation style to be consistent with HadoopUtils
* [Feature-10363][server] S3 Resource center supports bucket customization
* Modify code review comments
2022-06-18 10:20:01 +08:00
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq ( #10401 )
2022-06-17 21:16:38 +08:00
6515c66208
[Improve] Add LDAP user not exsitst action config ( #10451 )
2022-06-17 14:18:05 +08:00
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type ( #10096 )
...
* service code
* [Feature][UI] Add front-end for cluster manage
* fix e2e
* remove comment on cluster controller
* doc
* img
* setting e2e.yaml
* test
* rerun e2e
* fix bug from comment
* Update index.tsx
use Nspace instead of css.
* Update index.tsx
Remove the style.
* Delete index.module.scss
Remove the useless file.
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
b655aa9b1f
[doc] Correct resource in HDFS HA cluster ( #10445 )
2022-06-15 11:08:18 +08:00
0efcd5c631
[Fix-10425]Recovery LDAP Config ( #10429 )
...
* recovery ladp code
* add ldap config in doc
2022-06-15 09:52:37 +08:00
8205444e0a
[DolphinScheduler] Fix wrong class name in doc ( #10438 )
2022-06-14 19:53:33 +08:00
f6fea06f10
[Improve] Enhance complement function transformation ( #10376 )
2022-06-12 12:35:08 +08:00
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose ( #10217 )
...
* [Feature] [MLOps] support mlflow deploy with docker compose
fix doc
Update docs/docs/en/guide/task/mlflow.md
fix doc
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
revert cancel modification
fix ENV name and docker compose command
* fix doc image link
* fix testModelsDeployDockerCompose
* add docker compose container health check and fix mlflow bug
* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
e21d7b1551
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
2022-06-09 10:55:39 +08:00
b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup ( #10373 )
2022-06-08 19:42:05 +08:00
7e39e0d48d
[doc] Add switch task demo ( #10247 )
...
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
da3c25dc67
[improve] Using create or replace function in sql task ( #10170 )
2022-06-06 10:33:24 +08:00
0c25d4a3ce
[Docs]Update Slack Invite Link ( #10362 )
2022-06-04 23:55:23 +08:00
12fdd9bbd9
[doc] Use related path for img ( #10325 )
...
Use related path in our docs for imgs, previous
can not use because website need the absolute path
from root directory, and after we merged
apache/dolphinscheduler-website#789 we have covert
function to do that
close : #9426
2022-06-02 23:28:53 +08:00
d1c47c99ad
fix bug_10343 ( #10344 )
2022-06-02 16:13:51 +08:00
6828c9e015
[doc] Add how to use resource in shell task ( #10308 )
2022-06-01 17:28:27 +08:00
442f93544e
[Bug][Api-Server]Fix bug when user without tenant uploads file in resource center ( #10303 )
2022-06-01 17:22:36 +08:00
a8a5da367a
[Feature][Task Plugin] Add support for dynamic form for zeppelin task plugin ( #9977 ) ( #10269 )
2022-05-31 11:19:41 +08:00
c5961aed25
[feat][task] Add OpenMLDB task plugin ( #10198 )
2022-05-31 11:00:21 +08:00
a241135cbc
[chore] update by release version ( #10299 )
2022-05-30 23:09:01 +08:00
12a09f6d5d
[doc] Fix api standard error ( #10292 )
...
* fix api standard error
* add patch method
2022-05-30 16:07:25 +08:00
8d26d4fe72
[doc] Update the development environment to build the software version ( #10246 )
2022-05-30 14:46:12 +08:00
2294160cdb
[docs] Added local file configuration guide for resource center ( #10264 )
...
* Added Local File Resource Configuration Guide to the document.
* Removed contents with windows features in the documents and improved expression.
* Specify `the user who deploy dolphinscheduler have read and write permissions` in en and zh docs.
Co-authored-by: xiangzihao <460888207@qq.com>
2022-05-30 12:07:29 +08:00
cd36401a6a
[doc] Refactor context parameter docment ( #10227 )
2022-05-30 11:44:10 +08:00
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document ( #10242 )
...
* fix issue-9898
* delete no use pictures
2022-05-30 11:04:42 +08:00
a0771541e5
[Fix-10181] Fix the logic of judging that the tenant does not exist ( #10185 )
...
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.
At present, considering that it is a distributed user, it should not be allowed to create users in linux
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Add test method
The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.
At present, considering that it is a distributed user, it should not be allowed to create users in linux
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Add parameter description to configuration.md
Add test method
The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.
At present, considering that it is a distributed user, it should not be allowed to create users in linux
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Add parameter description to configuration.md
Add test method
The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.
At present, considering that it is a distributed user, it should not be allowed to create users in linux
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
* [Fix-10181] Fix the logic of judging that the tenant does not exist
Add parameter description to configuration.md
Add test method
The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.
At present, considering that it is a distributed user, it should not be allowed to create users in linux
Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist in /etc/passwd file and ldap: id: test: no such user
Temporarily unable to test the system for windows and mac
Co-authored-by: ouyangl <ouyangl@tebon.com.cn>
2022-05-26 14:58:07 +08:00
e3579dd13d
[doc] Correct all setup documents ( #10074 )
...
* Correct the login page URL
* change version and database configuration
* change setup and upgrade
2022-05-26 14:53:47 +08:00
6d9bc0743b
[doc] Add setValue syntax in local param ( #10245 )
...
ref: #9576
same as： #9671
2022-05-25 21:53:41 +08:00
aba5f8a40e
[improve] Change Mysql Driver ( #10220 )
2022-05-25 14:09:15 +08:00
87d9ec1dee
[doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc ( #10228 )
2022-05-25 11:45:16 +08:00
5998c73aac
[doc] Refactor local parameter docment ( #10119 )
2022-05-24 17:16:08 +08:00
c12848a4ff
[doc] Update kubernetes' FAQ ( #10221 )
2022-05-24 17:00:57 +08:00
f4b7754952
[doc] Update task DataX document ( #10218 )
2022-05-24 13:45:26 +08:00
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component ( #10175 )
...
* Add MLflow Projects (custom project) component
* fix something
* update document
* update document
* Supplementary test cases
2022-05-24 09:42:46 +08:00
31cb485312
[doc] Update delete workflow description ( #10203 )
2022-05-23 20:59:19 +08:00
41a3183810
[Doc] Add complie supporting system ( #10188 )
2022-05-23 15:17:37 +08:00
7a8f3f1810
[doc] Update project directory structure in docs ( #10107 )
2022-05-23 11:11:45 +08:00
0abfb5e744
[doc] Refactor global parameter docment ( #10045 )
2022-05-23 10:46:11 +08:00
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) ( #10150 )
...
* Add backend of MLflow Moldes component
* Add front end of MLflow Moldes component
* [DOC] update mlflow document
* revert unnecessary
* fix doc image url
* Update docs/docs/en/guide/task/mlflow.md
Discard the lr abbreviation
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-20 19:41:22 +08:00
e2fac21399
[doc] Update website docs link ( #10161 )
2022-05-20 16:47:41 +08:00
7d5af7e7ec
[doc] Update editorial workflow content and images ( #10130 )
2022-05-20 16:44:56 +08:00
94c515555e
[doc] Remove flink call docs ( #10122 )
...
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
2022-05-19 16:41:33 +08:00
2eff5ee10c
[doc] change document structure ( #10124 )
...
This patch change the structure and make it more sense
* Remove dev doc in tab Docs, and for now you could only see it in
history-version page
* Move PyDolphinScheduler from tab DOCS to sidebar and combine with open
API
* Move installation after Functions
* Move data quality after HOW-TOS
2022-05-19 16:30:53 +08:00
73f13a9c9c
[doc] Show all the functions of the home page through screenshots ( #10118 )
2022-05-19 14:45:44 +08:00
243ee8ba70
[Bug][doc] Fix the open-api docs request error ( #10100 )
2022-05-19 11:28:33 +08:00
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. ( #10036 )
...
* [Feature][Task Plugin] Add mlflow task plugin (#9725 )
* [Feature][Task Plugin] Add mlflow task plugin UI (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] revert unnecessary
* [Feature][Task Plugin] add auto ml to mlflow task plugin
* [DOC] add mlflow document
* [DOC] fix mlflow docs imgs
* [DOC] fix dead link localhost:5000
* [DOC] fix dead link localhost:5000
* [DOC] remove dead link localhost:5000
* Update docs/docs/en/guide/task/mlflow.md
* Update docs/docs/zh/guide/task/mlflow.md
* [DOC] format ui code
* [DOC] remove dead link localhost:5000
* [Feature][Task Plugin] revert unnecessary
* fix some nits
* Move the personal repository to the public repository.
* Run the command directly instead of saving the file
* fix paramsMap initialize
* revert unnecessary
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-19 09:40:31 +08:00
63f835715f
[fix] Enhance name pre checker in resource center ( #10094 )
...
* [fix] Enhance name pre checker in resource center
Add file name and directory checker to avoid directory traversal
* add some missing change and change docs
* change var name in directoryTraversal
* Fix ci
2022-05-18 18:40:17 +08:00
5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin ( #9425 )
...
* [Feature][plugin] Add k8s task in task plugin
* [Feature][plugin] fix dos and code problems
* [Feature][plugin] refactor some code based on sonar
* [Feature][UI] front-end for k8s task plugin
* [Feature][plugin] delete some front files
* [Feature][plugin] update document
* Update docs/docs/zh/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* [Feature][UI] front-end change from review comments
* [Feature][UI] replace get namespace list api
* [Feature][plugin] change file name
* Add kubernetes to zh task list
Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-18 17:23:42 +08:00
cab46e6be5
[Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation ( #10084 )
...
* Change Docker cmd && Change WebexTeams Chinese Translation
* run ci
Co-authored-by: qingwli <qingwli@cisco.com>
2022-05-18 13:53:44 +08:00
3bca240446
fix issue-10061 ( #10062 )
2022-05-18 12:21:35 +08:00
225cb332d1
[Fix-10049] Conditions Task branch flow failed ( #10077 )
2022-05-18 11:40:32 +08:00
537c206c2d
[Fix][Docker] Support Multi-Architecture Docker Images ( #10052 )
...
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-05-18 10:20:24 +08:00
b1885c7a26
[Bug] fix run on docker and k8s ( #10026 )
...
* fix docker-compose init schema
* recovery depend on zk
* update doc and dockerfile
* fix run on k8s
* udpate doc
* add DOCKER flag & update doc
* remove repeat DOCKER env
2022-05-16 15:41:45 +08:00
f666c64946
[doc] Correct docs of development-environment-setup ( #9995 )
2022-05-16 09:53:45 +08:00
baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script ( #9997 )
...
* cluster test
* fix init db failed
* fix init db failed
* fix init db failed
* fix init db failed
* fix init db failed
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add sudo
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* remove cluster-test workflows
* add github actions
* add github actions
* refactor test to docker mode
* refactor test to docker mode
* refactor test to docker mode
* refactor test to docker mode
* remove create schema logic
* remove create schema logic
* remove create schema logic
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* add github actions
* add github actions
* add github actions
* add cluster test timeout
* add cluster start test loop check
* add cluster start test loop check
* optimize cluster start test loop check
2022-05-14 12:30:57 +08:00
ee2c516813
[doc] Correct kubernetes ( #9985 )
...
Co-authored-by: qingwli <qingwli@cisco.com>
2022-05-13 10:39:05 +08:00
80369363c9
[feat][task plugin] Add Jupyter task plugin ( #9872 )
...
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-05-12 19:55:49 +08:00
0fe75482a2
[doc] Add example and notice about task type Dependent ( #10001 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-12 18:23:43 +08:00
bce5a28440
[doc] Add the description about execute type in SQL task ( #9987 )
2022-05-12 14:42:39 +08:00
bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update ( #9881 )
...
* test
* test
* doc
* fix image error
* fix
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/zh/guide/security.md
* fix doc
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-11 16:40:30 +08:00
12a4b01268
[Doc] Add example and notice about task type Conditions ( #9945 )
2022-05-11 11:43:11 +08:00
f790bc25fd
[doc] Update the document picture to new UI ( #9953 )
2022-05-11 11:38:15 +08:00
2d36449444
[Feature- 9837][plugin/ui] support FlinkSQL Task ( #9840 )
...
* flink_sql
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* '[refactor]flinksql'
* [refactor] flinksql
* '[refactor]flinksql'
* [refactor] dolphinscheduler flinksql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* [refactor] flink sql
* Update docs/docs/en/guide/task/flink.md
* Update docs/docs/zh/guide/task/flink.md
* prettier front-end code
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-05-09 18:51:55 +08:00
691e8ab538
[Feature][doc] Refactor and separate the Resource Center Document ( #9658 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-07 18:07:35 +08:00
bb78ccb08e
[docs] Correct custom docker image in faq ( #9939 )
...
* [docs] Correct custom docker image in faq
* Correct the build command
* Correct English version of document
* remove Chinese document in En version
2022-05-07 18:04:21 +08:00
1f7884609a
[Feature][Doc] Add docs for zeppelin task plugin ( #9866 )
2022-05-06 15:04:52 +08:00
7a7807e520
[Feature] Remove old ui. ( #9909 )
...
* [Feature] Remove old ui.
* [Docs] Add license file for screenfull.
2022-05-06 14:04:35 +08:00
15a15de927
[bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs ( #9887 )
2022-05-06 08:55:00 +08:00
136a183018
[doc] Separate and correct getting start by docker ( #9862 )
...
* [doc] Separate and correct getting start by docker
* Correct content of starting docker
* Remove all FAQ in docker.md and only keep
build image by users themself in faq.md
* Separate how to use incompatible incompatible
datasource from docker.md to directory datasource
* correct disable flag
* fix download link
* fix wrong anchor
* remove not support anchor for zh docs
2022-05-05 10:57:46 +08:00
b1bb69c959
[Improve][docs] Add spark sql docs to task spark ( #9851 )
2022-05-05 10:48:17 +08:00
4f2b9ac886
[Improve][common] code clean in the common module ( #9435 )
2022-04-29 10:34:03 +08:00
4f596f362a
[doc] Fix syntax error cause website not work correctly ( #9826 )
2022-04-28 15:33:03 +08:00
d188f49b0e
[doc] Dir development should not ref other dirs content ( #9812 )
...
For now, development dir deploy in other place instead
of docs dir https://dolphinscheduler.apache.org/en-us/development/development-environment-setup.html
so could not ref markdown doc from other docs dir
2022-04-27 20:02:34 +08:00
7b0b4c126e
[Bug] [Website-9764]add http alert doc and change body param to unnecessary ( #9792 )
...
* add http alert doc and change body param to unnecessary
* submit http en doc and fix doc
* fix http doc
2022-04-27 17:26:58 +08:00
515c363148
[Feature][Deploy] Add missing default values in dolphinscheduler_env.sh ( #9733 )
...
* [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9675 )
* [Feature][Deploy] Restore dolphinscheduler_env.sh to avoid e2e failure (#9675 )
* [Feature][Deploy] Change mysql driver class name to com.mysql.cj.jdbc.Driver (#9675 )
* [Feature][Deploy] Remove redundant config file (#9675 )
2022-04-27 13:44:37 +08:00
71c1a31e63
[Feature-9566][Docs] Missing shell script application_id listening logic ( #9778 )
2022-04-27 09:51:25 +08:00
e3070d9fa3
[Bug] [Website-9764]add script doc to the alert function ( #9765 )
...
* add script doc to the alert function
* add script doc to the alert function modify docsdev.js
2022-04-26 17:43:46 +08:00
3a66f05baf
[doc] Add how to change standalone database type ( #9376 ) ( #9736 )
2022-04-26 09:47:22 +08:00
de50f43de6
[common] Make dolphinscheduler_env.sh work when start server ( #9726 )
...
* [common] Make dolphinscheduler_env.sh work
* Change dist tarball `dolphinscheduler_env.sh` location
from `bin/` to `conf/`, which users could finish their
change configuration operation in one single directory.
and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
when we start our sever instead of adding both
`$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
2022-04-25 15:35:43 +08:00
4799b27e33
[hotfix][docker] Removed extra equals in mail user ( #9677 )
2022-04-23 12:32:31 +08:00
072ba731a2
[Bug][Doc]Update database init instruction docs ( #9659 )
2022-04-22 23:56:00 +08:00
dde6d1f448
[doc] Add data quality to sidebar and correct docker resource path ( #9662 )
2022-04-22 14:45:07 +08:00
337696e258
[Docs][DataQuality]: Add DataQuality Docs ( #9512 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-21 14:54:38 +08:00
6155dc3dab
[Docs] enhance alert doc ( #9534 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-20 13:02:28 +08:00
930d12031a
[task-flink][docs] Corrected name ( #9600 )
2022-04-20 09:26:42 +08:00
000e96baec
[doc] Fix dead link after 3.0.0 release ( #9562 )
2022-04-18 18:30:34 +08:00
5529a23e5c
[doc] Add new release for 3.0.0-alpha ( #9519 )
2022-04-18 16:07:43 +08:00
7b907b854d
[Improvement][doc] update time zone doc ( #9503 )
...
* update time zone doc
* update time zone doc
* update time zone doc
2022-04-14 21:32:00 +08:00
df791a374e
[FIX][WEBSITE-9224]fix wechat doc and wechat form display ( #9439 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-04-13 23:35:05 +08:00
eb21b6cc52
[Feature][Doc] Switch shell task instruction screenshots to latest ( #9434 )
2022-04-13 14:13:42 +08:00
51c1d8f2aa
[doc] Migrate develop docs from website ( #9457 )
...
* [doc] Migrate develop docs from website
developer should also into main repo, because
development setup should follow with the latest
code
* Add missing change from website
2022-04-12 17:23:56 +08:00
9d7223b038
[doc] fix url wrong in zh doc ( #9421 )
...
Co-authored-by: xiaoliangyu <xiaoliangyu@bytedance.com>
2022-04-12 09:45:25 +08:00
62284ae689
[doc] Add some dev missing doc ( #9427 )
...
* [doc] Add some dev missing doc
Including general-setting, task-definition, audit-log
and they related img
* Change base on suggestion
Co-authored-by: Tq <tianqitobethefirst@gmail.com>
2022-04-11 21:46:40 +08:00
2c49c248f3
[doc] Remove observability ( #9402 )
...
SkyWalking v9 is coming soon and there are without
DolphinScheduler menus anymore, So we should remove
the SW agent to avoid confusion.
close : #9242
2022-04-08 15:52:57 +08:00
d23616fcbc
[CI] Enable CI to remove unexpected files in /docs/img dir ( #9393 )
2022-04-08 13:46:35 +08:00
c828809b46
[doc] Change get help from dev mail list to slack ( #9377 )
...
* Change all get help from dev mailing list to slack, because
we find out mailing list have many users ask for subscribe
and they maybe subscribe by accident.
* remove join dev mailing list in faq.md because we already
have it in https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
2022-04-08 10:56:35 +08:00
3457cee960
[python] Migrate pythonGatewayServer into api server ( #9372 )
...
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server
The distribute package size before and after this patch is:
```sh
# before
796M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
# after
647M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
2022-04-07 14:41:15 +08:00
950f32e1d6
[task-spark][docs] Corrected notice section ( #9375 )
2022-04-07 14:03:21 +08:00
ee0e3beb9d
[docs] Modifying site Configurations ( #9341 )
2022-04-03 21:48:22 +08:00
3c5568c16c
[Doc] There are some version errors in the 2.0.1-release ( #9335 )
2022-04-03 12:55:25 +08:00
9f84dbbda0
[doc] Migrate dev doc from website repository ( #9291 )
...
* [doc] Migrate dev doc from website repository
* Correct release language
* Fix license issue
* Add all images from website
* Delete unused images
* Add CI
* Fix ci
* fix ci
* Remove no need file
* Add latest commit from website
* correct img_utils.py script
* Remove unused imgs
2022-04-02 10:43:34 +08:00
Kerwin