Commit Graph

83 Commits

Author SHA1 Message Date
Kirs 2bf3b22d64
[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) (#7041)
* data source spi

* Fix datasource not work in tests and standalone server, and run all tests by default (#6743)

* Refactor alert plugins and simplify its usage (#6723)

* [Fix-6792] resolve API and alert port conflicts (#6792) (#6815)

* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)

* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828)

* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490)

* fix pom dep scope

* filter alert

* filter alert

* filter alert

* fix checkstyle

* remove hikaricp version

* update pom

* add properties

* add properties

* rename properties

* fix e2e fail

* rename properties

* [Fix-6792] resolve API and alert port conflicts (#6792) (#6815)

[Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)

* fix ut fail

* fix license

* fix license

* update package

* update package

* remove unused license

Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2021-11-30 14:03:21 +08:00
Kirs 3c8e7dd5b8
[2.0-prepare]delete microbench module (#6532)
* [2.0-prepare]delete microbench module
2021-10-15 10:08:36 +08:00
kezhenxu94 cfb03ce8ee
Reorganize CI workflows to fasten the wasted time and resources (#6011) 2021-08-22 07:01:42 +08:00
深刻 0b4a20251f
ci: improve maven connection in CI builds (#5924)
issue: #5921
2021-08-01 22:18:32 +08:00
深刻 4c0993cdf4
[Fix-5781][UT] Fix test coverage in sonar (#5817)
* build(UT): make jacoco running in offline-instrumentation

issue: #5781

* build(UT): remove the jacoco agent dependency in microbench

issue: #5781
2021-07-26 22:04:36 +08:00
Wenjun Ruan 16986c3c65
[Imporvement #5725][CheckStyle] upgrade checkstyle file (#5789)
* [Imporvement #5725][CheckStyle] upgrade checkstyle file
  Upgrade checkstyle.xml to support checkstyle version 8.24+

* change ci checkstyle version
2021-07-11 00:31:45 +08:00
xingchun-chen b436ef0a2c
modify issues translation robot (#5624)
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
2021-06-11 11:22:42 +08:00
xingchun-chen d70fdf2a65
modify issues translation robot (#5614)
* Add issue robot automatic reply and Translation
2021-06-10 15:24:47 +08:00
Shiwen Cheng b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393)
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
2021-05-24 00:03:35 +08:00
xingchun-chen 7c358690fb
Issue robot removes translation content (#5297)
Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-16 16:00:10 +08:00
xingchun-chen 029d3eb814
git actions add submodule (#5280)
* Add issue robot automatic reply and Translation

* add license

* git actions add submodule


Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-15 14:13:58 +08:00
xingchun-chen faa111674f
Add issue robot automatic reply and Translation (#5258)
* Add issue robot automatic reply and Translation

* add license

Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-12 21:41:30 +08:00
Shiwen Cheng 8c68e2c60b
[Fix][Worker] Fix worker cannot start and alertClientService NullPointerException (#4956)
* [Fix][Worker] Fix worker cannot start

* [Fix][Worker] Fix alertClientService NullPointerException

* [Fix][Worker] Improve ut coverage

* [Improvement][CI] Improve workflow ci
2021-03-05 09:50:49 +08:00
CalvinKirs 55389c0fb0 close e2e test 2021-03-04 11:01:26 +08:00
Shiwen Cheng f975489374
[Improvement][SQL] Place the upgraded schema to the correct version directory and check schema errors (#4806)
* [Improvement][sql] Keep same with 1.3.5-release

* [Improvement][sql] Move the sql at the wrong version to 1.4.0 and fix issue #4650

* [Improvement][sql] Fix ci error
2021-02-25 10:35:55 +08:00
Shiwen Cheng 8879d8ff60
[Improvement][*] Define version with revision globally and update version to 1.3.6-SNAPSHOT (#4773)
* [Improvement][*] Update version to 1.4.0-SNAPSHOT

* [Improvement][*] Update tab to space under checkstyle

* [Improvement][*] Define version with revision globally

* [Improvement][*] Update version to 1.3.6-SNAPSHOT
2021-02-20 14:22:49 +08:00
Shiwen Cheng d41dd10a16
[Fix][CI] Fix error: unable to resolve action apache/skywalking-eyes@9bd5feb (#4784) 2021-02-17 11:48:47 +08:00
Zhenxu Ke a6becd8c26
chore: set up license-eye to check license headers (#4453) 2021-01-15 11:18:37 +08:00
break60 e033f81e9d
[Feature-3878]Replace the page with element-ui (#4065)
* [Feature-3878]Introduce elment-ui and replace the security center module page with elment-ui

* Change node version

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Replace the page with element-ui

* Replace user management with elment-ui

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Repair the last Sunday of each month
2020-12-11 22:58:28 +08:00
felix.wang 4ed3638750
[Bug][server] fix 3629 pull request (#3706)
* fix 3629 pr

* fix e2e build
2020-09-09 22:09:49 +08:00
xingchun-chen 5888095502
[test][e2e]add timing testcase and modify chromeDriver (#3597)
* Add task connection 

* Optimize test cases
 

* Modify variable format
 
 

* Optimize test cases
 

* Update BrowserCommon.java

* Update BrowserCommon.java

* Update WorkflowDefineLocator.java

* Optimize waiting time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize project wait time
 

* Optimize wait time
 

* Optimize wait time
 

* open timing testcase 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

* Optimize wait time
 

Co-authored-by: chenxingchun <438044805@qq.com>
2020-08-26 15:33:18 +08:00
xingchun-chen 2e175ff3da
Update ci_e2e.yml 2020-08-26 13:35:08 +08:00
xingchun-chen f921fde1dd
Update ci_e2e.yml 2020-08-26 12:48:32 +08:00
xingchun-chen 8d18795555
Update ci_e2e.yml 2020-08-26 12:19:43 +08:00
break60 35d1372d01 fix 2020-08-26 11:54:04 +08:00
Jave-Chen 42b0d67cef
add checkstyle job in github action. (#3518) 2020-08-16 12:37:26 +08:00
xingchun-chen e97b4707a5
[Test-2995][e2e] run workflow and timing testCase (#3201)
* add LoginTest license

* Delete useless packages

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group

* Increase dataX environment variable, sslTrust default value

* modify dataX environment variable

* update e2e chrome version

* add alert manage testcase and Optimize test case execution order

* add e2e to create and to  edit  queue

* update e2e chrome version

* add e2e token testcase

* add e2e token testcase

* add e2e to run workflow testcase

* add e2e timing testcase

* add e2e timing testcase

* add e2e timing testcase

* add e2e timing testcase

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* Merge remote-tracking branch 'upstream/dev' into dev

# Conflicts:
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
#	e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java

* edit user

* edit user

* edit user

* edit user

* edit user

* Update TimingLocator.java

* modify ci log

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

modify artifact version

* Update ci_e2e.yml

* Update ci_e2e.yml

modify /var/lib/docker/volumes  permissions

* Update ci_e2e.yml

modify ci logs

* Update ci_e2e.yml

Modify log file permissions

* Update ci_e2e.yml

modify logs

* Update ci_e2e.yml

modify logs

* Update ci_e2e.yml

modify logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* Update ci_e2e.yml

modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* Update ci_e2e.yml

modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify ci logs

* modify tenant

* modify alert wait time

* modify queue wait time

* modify alert wait time

* modify alert wait time

* modify alert wait time

* modify alert wait time

* modify alert wait time

* modify alert wait time

* modify button xpath

* modify queue xpath

* Ignore edit user

* modify alert wait time

* print delete user log

* modify the xpath of delete user button

* modify timing wait time

Co-authored-by: chenxingchun <438044805@qq.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-07-14 11:48:13 +08:00
lenboo fd76f172c1 Merge remote-tracking branch 'upstream/dev' into dev-merge
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/TaskExecuteThread.java
2020-06-30 11:17:14 +08:00
Jave-Chen f1632e22c5
Set up JDK 11 for SonarCloud in github action. (#3052)
* Set up JDK 11 for SonarCloud in github action.

* Fix javadoc error with JDK 11.

* Prevent Javadoc from stopping if it finds any html errors.
2020-06-25 23:41:43 +08:00
lenboo 1904a7022a change 1.3.0 to 1.3.0-snapshot 2020-06-10 11:42:15 +08:00
CalvinKirs b21259d600
add MicroBenchMark model (#2851)
* add MicroBenchMark model

* add log

* fix propertyName

* small change

* add ut

* format

* add @Test

* fix maven compile error

* remove enum set method

* exclusion microbench ut

* small change

* Use assembly instead of shade

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-06-06 17:11:20 +08:00
khadgarmage 12c249ab47
fix ci log bug (#2901) 2020-06-04 23:13:43 +08:00
dailidong 12dc18bbac
add maven Xmx to 5g 2020-05-29 11:03:34 +08:00
xingchun-chen 714ad5d445
update e2e chrome version (#2778)
* add LoginTest license

* Delete useless packages

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group

* Increase dataX environment variable, sslTrust default value

* modify dataX environment variable

* update e2e chrome version

Co-authored-by: chenxingchun <438044805@qq.com>
2020-05-21 10:22:47 +08:00
xingchun-chen da533044a6
update e2e chrome version (#2775)
Co-authored-by: chenxingchun <438044805@qq.com>
2020-05-20 23:39:53 +08:00
xiaochun.liu c68785632f merge from dev-1.3.0 2020-05-13 23:31:36 +08:00
xiaochun.liu b9bc052abe merge from dev1.3.0 2020-05-12 20:35:38 +08:00
liwenhe1993 29a353e689
Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml (#2692)
* Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml

1. add initdb volume for pg service in docker-compose.yml
2. modify ci_ut.yml

* add sudo in ci_ut.yml

* Query the metadata of indexes is not correct in postgresql/dolphinscheduler_ddl.sql

1. replace information_schema.STATISTICS to pg_stat_all_indexes
2. modify ProcessDefinitionMapperTest.java

* Remove inner zk and pg

* add inner pg
2020-05-12 20:24:17 +08:00
xiaochun.liu c1215add7a alter dockerfile to docker/build dir 2020-05-12 00:21:21 +08:00
xiaochun.liu 39a281c543 ut docker 2020-05-12 00:10:52 +08:00
xiaochun.liu e35e4c0dd5 migrate docker composer and move dockerfile dir to docker/build 2020-05-12 00:05:36 +08:00
liwenhe1993 3c014c5a57
fix zookeeper health check and merge volumes into logs volume (#2674)
* fix zookeeper health check and merge volumes into logs volume

1. Fix zookeeper health check
2. Merge volumes into logs volume
3. Modify `dockerfile/hooks/build` script

* Modify ci_e2e and docker image registry

* Modify ci_e2e

* Modify ci_e2e

* Modify ci_e2e and move ./dockerfile/hooks/check to ./docker/docker-swarm/
2020-05-11 23:22:04 +08:00
kezhenxu94 91f64a1afa
Merge branch 'dev' into issue/1463 2020-05-02 22:51:18 +08:00
kezhenxu94 6e08b29254
Add a script to check the license (#2552)
* Add a script to check the license

### Motivation

Check licenses in the distribution package

### Modification

1. Add a script to check licenses, and list known licenses.
1. Remove unused dep license, lombok.
1. Remove unnecessary ignored patterns in .gitignore.
1. Add missing config items to apache-rat plugin, which just checked a small part of files before.
1. Add check to GitHub Actions process

### Result

1. Newly-added dependencies should be checked and confirmed.
1. Closes #1578

* Separate rat and dependency check

* Tee dependencies to stdout

* Add more debug messages

* Check light-weight task first
2020-05-02 22:19:20 +08:00
kezhenxu94 45d58cd984
Exclude i18n files from code analysis 2020-04-30 19:35:08 +08:00
kezhenxu94 ba8492f428
Reorder lint action 2020-04-30 00:01:57 +08:00
kezhenxu94 519e8c22ef
Add eslint to check frontend codes style, closes #1463 2020-04-29 23:59:30 +08:00
qiaozhanwei 2b7801090f modify ci_e2e.yml 2020-04-09 13:44:31 +08:00
qiaozhanwei 152c814126 test 2020-03-31 16:51:19 +08:00
khadgarmage 53b62d403f
add ds logs and server status check with e2e test (#2277) 2020-03-23 14:40:08 +08:00