Commit Graph

162 Commits

Author SHA1 Message Date
Jay Chung a645cb1c2a cherry-pick [chore] Separate Python API into another repository
#12779
2023-01-03 18:18:25 +08:00
Kerwin 58ef3cccd7
[3.1.1-prepare]cherry-pick [Improvement] remove log-server and server module #12206 (#12562) 2022-10-27 12:54:38 +08:00
Kerwin 2402b8a6ef
Use temurin Java docker images instead of deprecated ones (#12334) (#12421)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-10-18 18:51:14 +08:00
Daniel Y 2a437607ae [Improvement-11834] Upgrade docker base image to support python3.9 (#11835)
* use openjdk:8-jre-slim-bullseye instead of buster to support python3.9

* use openjdk:8-jre-slim-bullseye instead of buster across all components
2022-09-19 15:50:25 +08:00
xiangzihao 71eeab3d98
[CI] Fix cluster test abnormal (#11688)
* fix cluster test abnormal
2022-08-30 09:33:22 +08:00
xiangzihao a22b9271ff
add unit test ci timeout (#11655) 2022-08-26 11:45:49 +08:00
Jiajie Zhong 4d427ee215
[python] Add support interpreter version 310 and 311-dev (#11170)
* Change version of package
* Fix tox error
* Change dev status to beta
* py4j not work on py{10,11} OS Windows
2022-08-11 23:39:44 +08:00
Jiajie Zhong 26afd655cb
[python] Add multiple version of document (#11391)
* Using sphinx-multiversion to support multiple version
of python api document
* change python api sidebar link
* fix whitelist_externals deprecated and add git

close: #8227
2022-08-11 12:02:29 +08:00
Jiajie Zhong 93a73b1292
[ci] Make cluster test work on release branch (#11199)
When I try to release the 3.0.0 on branch `3.0.0-prepare`,
I find out cluster-test error due to version change of
tarball, I think we should make cluster test work on both
dev and prepare release branch, so I add this patch
2022-07-29 14:49:00 +08:00
Jiajie Zhong 502fbb0f1c
impv: not mark issue stale with security label (#10982) 2022-07-18 12:00:20 +08:00
Jiajie Zhong 81930e5420
[python] Fix tasks with multiple upstream and workflow query error (#10941)
* when task with more than one upstreams, mapper
   TaskDefinitionMapper method queryByName will return
   more than one record, and failed the mybatis result
   type, so we have to add `limit 1` to it to
* add multiple runs of example in integrate test
* Change from subprocess.Popen to subprocess.call_check
  in integrating test which will raise an error when failed
2022-07-14 22:06:07 +08:00
Jiajie Zhong 598290487c
[python] Integrate test run strategy change (#10825)
this patch change python integrate test strategy,
before that, only content change in dir
dolphinscheduler-python will run the test. And it
will fail our python api startter when some code
change in java gateway. So we should start the
integrate test except docs change.

and in the future, we may add python ci to
.asf.yaml to make sure it pass

close: #10488
2022-07-10 11:06:27 +08:00
xiangzihao 3af618d7a8
[CI] Try to fix label bot (#10852) 2022-07-09 10:11:56 +08:00
xiangzihao c829738e6c
[Improvement] [CI] Add label robot to pull request (#10848)
* add label robot to pull request
2022-07-08 18:29:08 +08:00
xiangzihao 5083e0be6a
add reviewdog token to enable checkstyle (#10819) 2022-07-07 11:10:51 +08:00
kezhenxu94 8320490da3
[CI] Fix checkstyle & review dog don't work (#10812) 2022-07-06 21:31:32 +08:00
xiangzihao 515b5e3ef6
[API-Test] [Checkstyle] Reformat api-test code and enable checkstyle (#10805)
* reformat api-test code

* reformat api-test code

* reformat api-test code

* reformat api-test code

* reformat api-test code

* reformat api-test code

* fix checkstyle
2022-07-06 14:24:13 +08:00
Wenjun Ruan cd62de968d
Add JDK11 on unit-test (#10364) 2022-06-28 14:21:51 +08:00
Wenjun Ruan 00f86da1da
Open checkstyle, change checkstyle severity from info to warning (#10492)
* Open checkstyle, change checkstyle severity from info to warning
2022-06-17 19:01:54 +08:00
xiangzihao e50739465d
[Feature-10411] Add tenant api test (#10442)
* add feature_10411

* add feature_10411

* update README.md

* fix README.md deadlink

* fix error log output

* fix comment
2022-06-15 16:29:36 +08:00
qianli2022 ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
Kirs 190f253083
[CI] Add OWASP Dependency Check (#10058) 2022-06-13 14:26:59 +08:00
Kirs 0c25d4a3ce
[Docs]Update Slack Invite Link (#10362) 2022-06-04 23:55:23 +08:00
Jiajie Zhong 12fdd9bbd9
[doc] Use related path for img (#10325)
Use related path in our docs for imgs, previous
can not use because website need the absolute path
from root directory, and after we merged
apache/dolphinscheduler-website#789 we have covert
function to do that

close: #9426
2022-06-02 23:28:53 +08:00
xiangzihao 50e9f2916a
[CI] bumping actions/cache to v3 to fix ci error (#10345)
* bumping actions/cache to v3

* fix JSONUtilsTest.java unit test error
2022-06-02 17:26:52 +08:00
旺阳 87d9ec1dee
[doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228) 2022-05-25 11:45:16 +08:00
ChunFu Wu cd1dcf1eba
[Feature][CI] Schedule Dead Link Checker (#10000) 2022-05-21 10:41:34 +08:00
xiangzihao 8fab224e0d
add_alert_server_cluster_test (#10125) 2022-05-19 18:14:11 +08:00
旺阳 537c206c2d
[Fix][Docker] Support Multi-Architecture Docker Images (#10052)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-05-18 10:20:24 +08:00
xiangzihao 2423fa50f7
[Feature-10034][CI] Add postgresql cluster test in CI (#10035)
* add postgresql cluster test

* add postgresql cluster test

* add postgresql cluster test

* add postgresql cluster test
2022-05-15 13:04:48 +08:00
xiangzihao baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
* cluster test

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add sudo

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* remove cluster-test workflows

* add github actions

* add github actions

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* remove create schema logic

* remove create schema logic

* remove create schema logic

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* add github actions

* add github actions

* add github actions

* add cluster test timeout

* add cluster start test loop check

* add cluster start test loop check

* optimize cluster start test loop check
2022-05-14 12:30:57 +08:00
Jiajie Zhong 8d17fd20f9
[ci] Dead link check all markdown file (#10004)
there are 162 markdown files in dir `docs`
and all file in project is 175 files, so I
think check all file will not add too much
load for our ci, but it could discovered
the dead link in time to avoid some thing
like #9998
2022-05-12 11:30:01 +08:00
songjianet 7a7807e520
[Feature] Remove old ui. (#9909)
* [Feature] Remove old ui.

* [Docs] Add license file for screenfull.
2022-05-06 14:04:35 +08:00
Jiajie Zhong d188f49b0e
[doc] Dir development should not ref other dirs content (#9812)
For now, development dir deploy in other place instead
of docs dir https://dolphinscheduler.apache.org/en-us/development/development-environment-setup.html
so could not ref markdown doc from other docs dir
2022-04-27 20:02:34 +08:00
xiangzihao d18cf184c6
[CI] Improve CI (#9436)
* test

* test

* test

* test

* test

* test

* test

* test

* test

* improve ci

* improve ci

* improve ci
2022-04-12 14:43:15 +08:00
kezhenxu94 14d71d1462
[UI] Migrate NPM to PNPM in CI builds (#9431) 2022-04-11 14:16:23 +08:00
Jiajie Zhong c828809b46
[doc] Change get help from dev mail list to slack (#9377)
* Change all get help from dev mailing list to slack, because
  we find out mailing list have many users ask for subscribe
  and they maybe subscribe by accident.
* remove join dev mailing list in faq.md because we already
  have it in https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
2022-04-08 10:56:35 +08:00
xiangzihao 80ea8049e0
[CI] try to fix ci (#9366)
* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci

* try to fix ci
2022-04-06 21:57:52 +08:00
xiangzihao 40b73f7962
[Improve][CI] improve ci checking (#9325) 2022-04-06 09:33:41 +08:00
Jiajie Zhong 9f84dbbda0
[doc] Migrate dev doc from website repository (#9291)
* [doc] Migrate dev doc from website repository

* Correct release language

* Fix license issue

* Add all images from website

* Delete unused images

* Add CI

* Fix ci

* fix ci

* Remove no need file

* Add latest commit from website

* correct img_utils.py script

* Remove unused imgs
2022-04-02 10:43:34 +08:00
Jiajie Zhong 30746d9762
[python] Add integrated test to python gateway server (#8966)
* [python] Add integrated test to python gateway server

* Build java code and create standalone server image in GA
* Add component start docker in python
* Run example to make sure it work to it

close: #8035

* Fix build docker image working directory

* Fix working directory
2022-03-18 16:24:40 +08:00
xiangzihao eefe7896c8
[Feature-8850][E2E] Restore project center e2e test cases in ui-next (#8909) 2022-03-15 22:07:30 +08:00
kezhenxu94 14bb722f6f
[CI] Require E2E to passed before merging (#8891) 2022-03-15 14:35:21 +08:00
Jiajie Zhong b04a535744
[ci] Add timeout to each job avoiding zombie process (#8886) 2022-03-14 22:34:44 +08:00
kezhenxu94 d3cbf8eeaf
[UI-NEXT] Fix wrong packaging locations (#8851) 2022-03-14 15:26:15 +08:00
xiangzihao 2335453482
[Feature-8844][E2E] Restore datasource center e2e test cases in ui-next (#8845) 2022-03-13 12:33:19 +08:00
Jiajie Zhong 90f9aed11d
[python] Add tox for out of box test (#8837)
* [python] Add tox for out of box test

* Add `tox` for easy and complete test
* Correct package data attribute
* Add more dirs in flake8 ignore

* Change GA from raw to tox

* Fix env setter

* Temp skip sanity

* Rm not exists job

* Add code test

* fix

* rm all need

* fix

* fix

* fix

* fix

* fix

* fix

* Migrate pip upgrede to tox setting

* Change install_commands to commands

* fix config of install command

* Add GA env to do that

* Fix env error

* Finial commit

* remove duplicate

* Change doc

* Change dependence of ci

* Change dependence of ci
2022-03-12 21:27:36 +08:00
xiangzihao 49b1a073dd
[Feature-8823][E2E] Restore resource center e2e test cases in ui-next (#8840) 2022-03-12 20:49:46 +08:00
xiangzihao 20dd0c12ce
[E2E] Restore security center e2e test cases in ui-next (#8815) 2022-03-10 21:49:04 +08:00
kezhenxu94 d2a360480a
[CI][UI NEXT] Package new UI into release tar and remove old UI from it (#8670)
* [CI][UI NEXT] Package new UI into release tar and remove old UI from it

* Update e2e.yml
2022-03-07 11:20:24 +08:00