Commit Graph

224 Commits

Author SHA1 Message Date
xiangzihao 225cb332d1
[Fix-10049] Conditions Task branch flow failed (#10077) 2022-05-18 11:40:32 +08:00
旺阳 537c206c2d
[Fix][Docker] Support Multi-Architecture Docker Images (#10052)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-05-18 10:20:24 +08:00
caishunfeng b1885c7a26
[Bug] fix run on docker and k8s (#10026)
* fix docker-compose init schema

* recovery depend on zk

* update doc and dockerfile

* fix run on k8s

* udpate doc

* add DOCKER flag & update doc

* remove repeat DOCKER env
2022-05-16 15:41:45 +08:00
chuxing f666c64946
[doc] Correct docs of development-environment-setup (#9995) 2022-05-16 09:53:45 +08:00
xiangzihao baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
* cluster test

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add sudo

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* remove cluster-test workflows

* add github actions

* add github actions

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* remove create schema logic

* remove create schema logic

* remove create schema logic

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* add github actions

* add github actions

* add github actions

* add cluster test timeout

* add cluster start test loop check

* add cluster start test loop check

* optimize cluster start test loop check
2022-05-14 12:30:57 +08:00
旺阳 ee2c516813
[doc] Correct kubernetes (#9985)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-05-13 10:39:05 +08:00
Eric Gao 80369363c9
[feat][task plugin] Add Jupyter task plugin (#9872)
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-05-12 19:55:49 +08:00
QuakeWang 0fe75482a2
[doc] Add example and notice about task type Dependent (#10001)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-12 18:23:43 +08:00
Kerwin bce5a28440
[doc] Add the description about execute type in SQL task (#9987) 2022-05-12 14:42:39 +08:00
qianli2022 bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update (#9881)
* test

* test

* doc

* fix image error

* fix

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/zh/guide/security.md

* fix doc

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-11 16:40:30 +08:00
QuakeWang 12a4b01268
[Doc] Add example and notice about task type Conditions (#9945) 2022-05-11 11:43:11 +08:00
QuakeWang f790bc25fd
[doc] Update the document picture to new UI (#9953) 2022-05-11 11:38:15 +08:00
Dannila 2d36449444
[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840)
* flink_sql

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* [refactor] flinksql

* '[refactor]flinksql'

* [refactor] dolphinscheduler flinksql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* Update docs/docs/en/guide/task/flink.md

* Update docs/docs/zh/guide/task/flink.md

* prettier front-end code

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-05-09 18:51:55 +08:00
QuakeWang 691e8ab538
[Feature][doc] Refactor and separate the Resource Center Document (#9658)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-07 18:07:35 +08:00
Jiajie Zhong bb78ccb08e
[docs] Correct custom docker image in faq (#9939)
* [docs] Correct custom docker image in faq

* Correct the build command
* Correct English version of document

* remove Chinese document in En version
2022-05-07 18:04:21 +08:00
Eric Gao 1f7884609a
[Feature][Doc] Add docs for zeppelin task plugin (#9866) 2022-05-06 15:04:52 +08:00
songjianet 7a7807e520
[Feature] Remove old ui. (#9909)
* [Feature] Remove old ui.

* [Docs] Add license file for screenfull.
2022-05-06 14:04:35 +08:00
陈爽 15a15de927
[bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs (#9887) 2022-05-06 08:55:00 +08:00
Jiajie Zhong 136a183018
[doc] Separate and correct getting start by docker (#9862)
* [doc] Separate and correct getting start by docker

* Correct content of starting docker
* Remove all FAQ in docker.md and only keep
  build image by users themself in faq.md
* Separate how to use incompatible incompatible
  datasource from docker.md to directory datasource

* correct disable flag

* fix download link

* fix wrong anchor

* remove not support anchor for zh docs
2022-05-05 10:57:46 +08:00
sq-q b1bb69c959
[Improve][docs] Add spark sql docs to task spark (#9851) 2022-05-05 10:48:17 +08:00
Kerwin 4f2b9ac886
[Improve][common] code clean in the common module (#9435) 2022-04-29 10:34:03 +08:00
Jiajie Zhong 4f596f362a
[doc] Fix syntax error cause website not work correctly (#9826) 2022-04-28 15:33:03 +08:00
Jiajie Zhong d188f49b0e
[doc] Dir development should not ref other dirs content (#9812)
For now, development dir deploy in other place instead
of docs dir https://dolphinscheduler.apache.org/en-us/development/development-environment-setup.html
so could not ref markdown doc from other docs dir
2022-04-27 20:02:34 +08:00
Tq 7b0b4c126e
[Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
* add http alert doc and change body param to unnecessary

* submit http en doc and fix doc

* fix http doc
2022-04-27 17:26:58 +08:00
Eric Gao 515c363148
[Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9733)
* [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9675)

* [Feature][Deploy] Restore dolphinscheduler_env.sh to avoid e2e failure (#9675)

* [Feature][Deploy] Change mysql driver class name to com.mysql.cj.jdbc.Driver (#9675)

* [Feature][Deploy] Remove redundant config file (#9675)
2022-04-27 13:44:37 +08:00
xiangzihao 71c1a31e63
[Feature-9566][Docs] Missing shell script application_id listening logic (#9778) 2022-04-27 09:51:25 +08:00
Tq e3070d9fa3
[Bug] [Website-9764]add script doc to the alert function (#9765)
* add script doc to the alert function

* add script doc to the alert function modify docsdev.js
2022-04-26 17:43:46 +08:00
Eric Gao 3a66f05baf
[doc] Add how to change standalone database type (#9376) (#9736) 2022-04-26 09:47:22 +08:00
Jiajie Zhong de50f43de6
[common] Make dolphinscheduler_env.sh work when start server (#9726)
* [common] Make dolphinscheduler_env.sh work

* Change dist tarball `dolphinscheduler_env.sh` location
  from `bin/` to `conf/`, which users could finish their
  change configuration operation in one single directory.
  and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
  when we start our sever instead of adding both
  `$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
2022-04-25 15:35:43 +08:00
mans2singh 4799b27e33
[hotfix][docker] Removed extra equals in mail user (#9677) 2022-04-23 12:32:31 +08:00
Eric Gao 072ba731a2
[Bug][Doc]Update database init instruction docs (#9659) 2022-04-22 23:56:00 +08:00
Jiajie Zhong dde6d1f448
[doc] Add data quality to sidebar and correct docker resource path (#9662) 2022-04-22 14:45:07 +08:00
zixi0825 337696e258
[Docs][DataQuality]: Add DataQuality Docs (#9512)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-21 14:54:38 +08:00
wangyang 6155dc3dab
[Docs] enhance alert doc (#9534)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-04-20 13:02:28 +08:00
mans2singh 930d12031a
[task-flink][docs] Corrected name (#9600) 2022-04-20 09:26:42 +08:00
Jiajie Zhong 000e96baec
[doc] Fix dead link after 3.0.0 release (#9562) 2022-04-18 18:30:34 +08:00
Jiajie Zhong 5529a23e5c
[doc] Add new release for 3.0.0-alpha (#9519) 2022-04-18 16:07:43 +08:00
caishunfeng 7b907b854d
[Improvement][doc] update time zone doc (#9503)
* update time zone doc

* update time zone doc

* update time zone doc
2022-04-14 21:32:00 +08:00
Tq df791a374e
[FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439)
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-04-13 23:35:05 +08:00
Eric Gao eb21b6cc52
[Feature][Doc] Switch shell task instruction screenshots to latest (#9434) 2022-04-13 14:13:42 +08:00
Jiajie Zhong 51c1d8f2aa
[doc] Migrate develop docs from website (#9457)
* [doc] Migrate develop docs from website

developer should also into main repo, because
development setup should follow with the latest
code

* Add missing change from website
2022-04-12 17:23:56 +08:00
Lyle Shaw 9d7223b038
[doc] fix url wrong in zh doc (#9421)
Co-authored-by: xiaoliangyu <xiaoliangyu@bytedance.com>
2022-04-12 09:45:25 +08:00
Jiajie Zhong 62284ae689
[doc] Add some dev missing doc (#9427)
* [doc] Add some dev missing doc

Including general-setting, task-definition, audit-log
and they related img

* Change base on suggestion

Co-authored-by: Tq <tianqitobethefirst@gmail.com>
2022-04-11 21:46:40 +08:00
Jiajie Zhong 2c49c248f3
[doc] Remove observability (#9402)
SkyWalking v9 is coming soon and there are without
DolphinScheduler menus anymore, So we should remove
the SW agent to avoid confusion.

close: #9242
2022-04-08 15:52:57 +08:00
Eric Gao d23616fcbc
[CI] Enable CI to remove unexpected files in /docs/img dir (#9393) 2022-04-08 13:46:35 +08:00
Jiajie Zhong c828809b46
[doc] Change get help from dev mail list to slack (#9377)
* Change all get help from dev mailing list to slack, because
  we find out mailing list have many users ask for subscribe
  and they maybe subscribe by accident.
* remove join dev mailing list in faq.md because we already
  have it in https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
2022-04-08 10:56:35 +08:00
Jiajie Zhong 3457cee960
[python] Migrate pythonGatewayServer into api server (#9372)
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server

The distribute package size before and after this patch is:

```sh
# before
796M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz

# after
647M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
2022-04-07 14:41:15 +08:00
mans2singh 950f32e1d6
[task-spark][docs] Corrected notice section (#9375) 2022-04-07 14:03:21 +08:00
labbomb ee0e3beb9d
[docs] Modifying site Configurations (#9341) 2022-04-03 21:48:22 +08:00
xiangzihao 3c5568c16c
[Doc] There are some version errors in the 2.0.1-release (#9335) 2022-04-03 12:55:25 +08:00