Commit Graph

306 Commits

Author SHA1 Message Date
aiwenmo 5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640) 2022-07-05 10:07:24 +08:00
xiangzihao 7aad6a6515
[doc] Unify data source switching of the docs during installation (#10688) 2022-07-04 16:28:14 +08:00
sneh-wha 6cf9d088ff
[doc] Change tasks docs (#10751) 2022-07-04 11:29:59 +08:00
sneh-wha 423cc5b9be
[doc] Modified project doc. (#10711) 2022-07-04 10:23:25 +08:00
Devosend 4f0a02eb43
[chore] update by release version (#10742)
* update 3.0.0-beta-2 doc

* update history-versions doc
2022-07-04 10:05:29 +08:00
sneh-wha fb8d0c858b
Merging general settings to faq (#10716)
* Merging general settings to faq

* also change the zh position

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-07-01 17:18:02 +08:00
sneh-wha fb90a0e558
[doc] Modify quick start. (#10712) 2022-07-01 16:51:07 +08:00
sneh-wha 0cdae777ab
[doc] Modified alert doc files (#10714) 2022-07-01 16:29:00 +08:00
Paul Zhang 4a3c3e7797
[feature][task-flink] Support Flink application mode (#9577) 2022-07-01 12:20:38 +08:00
sneh-wha 65ebdbef98
[doc] Change tasks doc (#10639) 2022-07-01 01:46:04 +08:00
sneh-wha 7898f41dc0
[doc] Change datasource doc (#10660) 2022-06-30 23:33:59 +08:00
Stalary a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
caishunfeng c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
sneh-wha 1cdbbc1ba5
[doc] Modified parameter doc files. (#10659) 2022-06-29 14:42:37 +08:00
sneh-wha 1f46078ab8
[doc] Change subprocess dependent (#10637) 2022-06-27 19:30:35 +08:00
sneh-wha a14b96b091
[doc] Modify Shell task file (#10634) 2022-06-27 17:22:09 +08:00
Jiajie Zhong cd51a22940
[doc] Correct installPath when using related path (#10597)
correct the doc and add hint to setting

ref: #10511
2022-06-27 11:02:19 +08:00
Eric Gao 16144a8858
[docs] Add links to metrics docs (#10583) 2022-06-24 17:27:40 +08:00
Stalary b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
xiangzihao 33cc68ed4a
[doc] Add doc about how to use healthcheck endpoints (#10592) 2022-06-24 16:56:26 +08:00
xiangzihao b21e211d2c
[doc] Add docs about complement dependent mode (#10587) 2022-06-24 16:33:10 +08:00
xiangzihao 773ebc9e52
fix 10513 (#10564) 2022-06-23 13:44:22 +08:00
houshitao 1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
JieguangZhou 3918140e7e
[fix][doc] Add DVC task plugin doc link (#10529) 2022-06-23 10:01:49 +08:00
Eric Gao 0aba68f335
[Improvement][Metrics] Update some metrics names in grafana-demo dashboards (#10432) (#10552) 2022-06-22 23:05:54 +08:00
Eric Gao cc06eaaf54
[Improvement][Metrics] Apply micrometer naming convention to metrics (#10477)
* Apply micrometer naming convention to worker metrics
* Apply micrometer naming convention all current metrics
* Fix remaining metrics names, update English docs and add Chinese docs
* Fix metrics names in grafana-demo dashboards
2022-06-21 14:27:06 +08:00
JieguangZhou 36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
旺阳 6e4b2e6992
[Fix]Recovery Traffic Control Config (#10505)
* recovery traffic config

* run ci

* update
2022-06-20 18:43:48 +08:00
Eric Gao 64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task (#10337) 2022-06-20 14:47:44 +08:00
xiangzihao 704e633659
[Doc] Add api test doc (#10499) 2022-06-19 13:55:23 +08:00
Eric Gao 4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note (#10434) 2022-06-18 13:34:24 +08:00
guodong 2c227ab384
[Feature-10363][server] S3 Resource center supports bucket customization (#10433)
* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify the configuration. Sort out HDFS and S3 configurations to distinguish them
* Modify the configuration comment to clarify the configuration meaning
* Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage
* Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties
* Modified code to support bucket customization
* Check that the bucket on personal permission, Otherwise, the startup fails
* S3 increase support resource. Storage. Upload. Base. The base path path
* Change S3Utils implementation style to be consistent with HadoopUtils

* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify code review comments
2022-06-18 10:20:01 +08:00
liubo1990 b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00
旺阳 6515c66208
[Improve] Add LDAP user not exsitst action config (#10451) 2022-06-17 14:18:05 +08:00
qianli2022 ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
Jiajie Zhong b655aa9b1f
[doc] Correct resource in HDFS HA cluster (#10445) 2022-06-15 11:08:18 +08:00
旺阳 0efcd5c631
[Fix-10425]Recovery LDAP Config (#10429)
* recovery ladp code

* add ldap config in doc
2022-06-15 09:52:37 +08:00
阿福Chris 8205444e0a
[DolphinScheduler] Fix wrong class name in doc (#10438) 2022-06-14 19:53:33 +08:00
hstdream f6fea06f10
[Improve] Enhance complement function transformation (#10376) 2022-06-12 12:35:08 +08:00
JieguangZhou 3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217)
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
Wenjun Ruan e21d7b1551
[Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT
2022-06-09 10:55:39 +08:00
xiangzihao b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373) 2022-06-08 19:42:05 +08:00
chuxing 7e39e0d48d
[doc] Add switch task demo (#10247)
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
He Zhao da3c25dc67
[improve] Using create or replace function in sql task (#10170) 2022-06-06 10:33:24 +08:00
Kirs 0c25d4a3ce
[Docs]Update Slack Invite Link (#10362) 2022-06-04 23:55:23 +08:00
Jiajie Zhong 12fdd9bbd9
[doc] Use related path for img (#10325)
Use related path in our docs for imgs, previous
can not use because website need the absolute path
from root directory, and after we merged
apache/dolphinscheduler-website#789 we have covert
function to do that

close: #9426
2022-06-02 23:28:53 +08:00
xiangzihao d1c47c99ad
fix bug_10343 (#10344) 2022-06-02 16:13:51 +08:00
QuakeWang 6828c9e015
[doc] Add how to use resource in shell task (#10308) 2022-06-01 17:28:27 +08:00
Eric Gao 442f93544e
[Bug][Api-Server]Fix bug when user without tenant uploads file in resource center (#10303) 2022-06-01 17:22:36 +08:00
Eric Gao a8a5da367a
[Feature][Task Plugin] Add support for dynamic form for zeppelin task plugin (#9977) (#10269) 2022-05-31 11:19:41 +08:00