Commit Graph

2952 Commits

Author SHA1 Message Date
lenboo b10a06b2bc add commons-compiler-3.0.12.jar 2020-06-10 14:21:08 +08:00
lenboo 4f2f474dbb delete duplicate codes 2020-06-10 14:19:26 +08:00
lenboo fe3021c386 add janino-3.0.12.jar 2020-06-10 14:14:26 +08:00
lenboo 20d8299a35 change 1.3.0 to 1.3.0-snapshot 2020-06-10 13:45:15 +08:00
lenboo 1904a7022a change 1.3.0 to 1.3.0-snapshot 2020-06-10 11:42:15 +08:00
xingchun-chen 2749c7e536
add alert manage testCase and optimize test case execution order   (#2941)
* add LoginTest license

* Delete useless packages

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* e2e add project and workflow case

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group in init.sql

* Update worker_group_id to worker_group

* Increase dataX environment variable, sslTrust default value

* modify dataX environment variable

* update e2e chrome version

* add alert manage testcase and Optimize test case execution order

Co-authored-by: chenxingchun <438044805@qq.com>
2020-06-10 10:22:27 +08:00
break60 464405f480
Python, sql, sqoop,datax task node editor adds zoom function #2929 (#2933)
* Python, sql, sqoop task node editor adds zoom function

* fix
2020-06-09 16:56:57 +08:00
dailidong 186ba3baab
fix oom when no master is active in dev-1.3.0 (#2918)
* fix worker group config no effect

* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2

* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0

# Conflicts:
#	dolphinscheduler-server/src/main/resources/config/install_config.conf

* datasource config

* Update datasource.properties

* fix RunConfig bug

* remove param monitor server state

* fix table T_DS_ALERT

* update h2 database

* fix #2910 master server will show exception for some time when it restart

* fix oom when no master is active

* fix worker oom when master server restart

* fix oom

* fix

* add UT

* fix worker group config no effect
2020-06-08 15:55:39 +08:00
bao liang 422fe5136d
[license] add license and notice (#2916)
* fix bug: send task result to master until success.

* fix bug: send task result to master until success.

* add sleep

* set null if send result failed

* set null if send result failed

* change max length of username to 39

* test for gc

* change version to 1.3.0

* check and add some license files

* check and add some license files

* revert

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2020-06-06 22:21:37 +08:00
Rubik-W 7c9f5960e5
Fixbug datax task (#2909)
* fix:  local param bug

* fix: UT bug

Co-authored-by: Rubik-W <whm_777@163.com>
2020-06-06 21:12:41 +08:00
dailidong 5c9b080ab8
fix #2910 master server will show exception for some time when it restart (#2913)
* fix worker group config no effect

* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2

* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0

# Conflicts:
#	dolphinscheduler-server/src/main/resources/config/install_config.conf

* datasource config

* Update datasource.properties

* fix RunConfig bug

* remove param monitor server state

* fix table T_DS_ALERT

* update h2 database

* fix #2910 master server will show exception for some time when it restart
2020-06-06 18:24:26 +08:00
CalvinKirs b21259d600
add MicroBenchMark model (#2851)
* add MicroBenchMark model

* add log

* fix propertyName

* small change

* add ut

* format

* add @Test

* fix maven compile error

* remove enum set method

* exclusion microbench ut

* small change

* Use assembly instead of shade

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-06-06 17:11:20 +08:00
dailidong 0de8e58965
fix create table sql exception (#2912)
fix create table sql exception
2020-06-06 16:38:40 +08:00
t1mon 8681036a49
Fix tasks not execute in sub-process when rerun scheduled process. #2903 (#2908) 2020-06-05 18:42:10 +08:00
lgcareer 3f731f7122
update how to build and remove docs link (#2906) 2020-06-05 18:04:01 +08:00
xingchun-chen dd7513d3d1
Merge pull request #2902 from break60/dev-1.3.0
Fixed selection of tenant value and defalut changed to lower case
2020-06-05 14:35:06 +08:00
break60 e8d9f5c2dd Fixed selection of tenant value and defalut changed to lower case 2020-06-05 11:52:33 +08:00
Yelli b5eb9fe475
fix bug: sqoop mysql import params error (#2896)
* fix bug: sqoop mysql import params error

* fix bug: sqoop mysql import params error
2020-06-05 10:32:35 +08:00
khadgarmage 12c249ab47
fix ci log bug (#2901) 2020-06-04 23:13:43 +08:00
gabry.wu ae9afcf77a
Merge pull request #2898 from 597365581/patch-6
merge method updateuser if and fix bug#2892
2020-06-04 17:26:59 +08:00
小清 3e7dc7da8d
merge method updateuser if and fix bug#2892
fix [BUG] When editing user information, clear the phone number, the database table t_ds_user.phone is not cleared #2892
2020-06-04 16:26:26 +08:00
lgcareer 4441d91dcf
Fix bug:If user didn't set the value of tenant,release process definition fail (#2885)
* copy resources need get top directory first

* copy resources need get top directory first

* fix #2860:copy files and create empty directory

* Fix bug:If user didn't set the value of tenant,release process definition online fail
2020-06-03 13:50:06 +08:00
lgcareer 31dca43cdb
fix #2860:copy files and create empty directory (#2876)
* copy resources need get top directory first

* copy resources need get top directory first

* fix #2860:copy files and create empty directory
2020-06-02 18:33:06 +08:00
lgcareer 6723454df9
copy resources need get top directory first (#2866)
* copy resources need get top directory first

* copy resources need get top directory first
2020-06-01 18:32:06 +08:00
bao liang 41e4986eb2
change max length of user name to 39 (#2856)
* fix bug: send task result to master until success.

* fix bug: send task result to master until success.

* add sleep

* set null if send result failed

* set null if send result failed

* change max length of username to 39

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2020-06-01 17:25:25 +08:00
Yelli 3cbe865776
modify t_ds_task_instance app_link change sql (#2861) 2020-06-01 17:21:23 +08:00
xingchun-chen 91cb709314
Merge pull request #2852 from break60/dev-1.3.0
mr resource display and create user username length cannot be less th…
2020-06-01 11:35:13 +08:00
break60 5922bcfaa1 fix 2020-06-01 11:15:07 +08:00
break60 ecb4df4051 fix 2020-06-01 11:14:46 +08:00
dailidong 6886ed51c5
fix table T_DS_ALERT (#2854)
* fix worker group config no effect

* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2

* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0

# Conflicts:
#	dolphinscheduler-server/src/main/resources/config/install_config.conf

* datasource config

* Update datasource.properties

* fix RunConfig bug

* remove param monitor server state

* fix table T_DS_ALERT
2020-06-01 11:11:34 +08:00
break60 098db69f69 fix 2020-06-01 11:09:54 +08:00
break60 2183e7e062 fix 2020-06-01 11:06:10 +08:00
break60 8f258370e0 fix 2020-06-01 10:54:38 +08:00
break60 b0fd387f0f mr resource display and create user username length cannot be less than 3 2020-06-01 10:41:07 +08:00
Han Gao 8f8ddae030
Using Jackson instead of Fastjson (#2850)
* Using Jackson instead of Fastjson

* Fix some json bugs

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-05-31 18:11:10 +08:00
CalvinKirs c8ab27acb0
Optimization of enumerated values method (#2677)
* The value method of enum is a deep copy. If there are many parameters, it is not recommended to use the value method. Specifically see jmh results

* beautiful misunderstanding

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-05-31 10:29:46 +08:00
yaoyao 009fd01047
fix [BUG] TaskExecutionContextCacheManagerImpl Do not execute removeByTaskInstanceId #2745 (#2754) 2020-05-30 23:23:01 +08:00
itbasketplayer 1513aae3ce
add job history to judge application status/2625 (#2848)
* job history status url when application number threshold is reached(default 10000,maybe it was set to 1000)

* job history status url when application number threshold is reached(default 10000,maybe it was set to 1000)

* job history status url when application number threshold is reached(default 10000,maybe it was set to 1000)

Co-authored-by: yuhaibin@lizhi.fm <35716fc5847f6d154cf556296453ca91>
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-05-30 23:07:17 +08:00
GabrielWithTina d00627ff77
Return ProcessDefinition ID when call ProcessController.createProject. (#2849)
Return Scheduler ID when call SchedulerController.createScheduler.

client need the created object ID to bind the relationship between client system and Dolphinscheduler system.
2020-05-30 17:07:22 +08:00
lgcareer 2d760cd311
change notice copyright date from 2019 to 2019-2020 (#2847)
* add source license full text into source license

* exclude ScriptRunner.java on rat check

* change notice copyright date from 2019 to 2019-2020
2020-05-30 15:10:11 +08:00
如梦技术 1c15345442
fix: Improve the security of datasource management (#2844)
Closes 2638

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-05-30 15:03:10 +08:00
Wuv1Up fbb8ff438a
fix return value of created project (#2804)
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-05-30 12:45:39 +08:00
Yelli 28e28caebd
fix table not exist when init db metadata (#2838)
* fix table not exist when init db metadata

* fix db init error

* fix ds-1.3.0 init db

* init db modify process instance json

Co-authored-by: eights <yelli.hl@foxmail.com>
2020-05-29 21:51:19 +08:00
xingchun-chen c2fbd6adaf
Merge pull request #2843 from break60/dev-1.3.0
Fix abnormal display of regular worker parameters
2020-05-29 20:52:52 +08:00
lgcareer ef4c1e7930
add source license full text into source license (#2840)
* add source license full text into source license

* exclude ScriptRunner.java on rat check
2020-05-29 17:23:34 +08:00
break60 a1576d1fa2 Fix abnormal display of regular worker parameters 2020-05-29 17:07:01 +08:00
liwenhe1993 6f6554ab9c
Fix errors when running on win10 (#2842)
1. DS cant run bat script
2. DS cant run python script
3. DS cant run datax script
2020-05-29 15:48:56 +08:00
bao liang 68bc59765b
fix bug: send task result to master until success. (#2839)
* fix bug: send task result to master until success.

* fix bug: send task result to master until success.

* add sleep

* set null if send result failed

* set null if send result failed

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2020-05-29 15:43:05 +08:00
dailidong 12dc18bbac
add maven Xmx to 5g 2020-05-29 11:03:34 +08:00
bao liang d67436ffad
[bug fix] fix: The workflow is fault-tolerant and 2 task instances are generated (#2833)
* feature: add number configuration for master dispatch tasks

* fix bug(#2762) the master would be blocked when worker group not exists

* fix bug(#2762) the master would be blocked when worker group not exists

* fix ut

* fix ut

* fix bug(2781): cannot pause work flow when task state is "submit success"

* fix code smell

* add mysql other param blank judge

* test

* update comments

* update comments

* add ut

* fix bug: Restart the worker service again, the previously submitted successful tasks are not executed

* update comments

* add sleep

* add null point check

* fix bug:After the master is fault-tolerant, it cannot resume operation

* fix bug: do not failover the host is 'NULL' process

* fix bug:worker failover error.

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2020-05-28 12:31:12 +08:00