natas_hw
/
dolphinscheduler
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,971 Commits 27 Branches 54 Tags 416 MiB
Commit Graph

6971 Commits

Author SHA1 Message Date
Tq 9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js (#11173) 
add Feishu alert doc and configure email alert doc to the docsdev.js
 2022-07-28 17:21:32 +08:00
caishunfeng 818648df7d
[Bug-11071] fix local params (#11184) 
* fix local params

* add CI case
 2022-07-28 15:07:04 +08:00
pinkhello 2e81f30298
[Fix] Parameter values disappear when editing Zeppelin task (#11115) 2022-07-28 15:03:26 +08:00
JiPeng Wang cd0c50f3f2
[Fix-11140] Added resource parameters for function verification (#11141) 
* Added resource parameters for function verification

* checkstyle fixed

* checkstyle fixed

* check style fixed for env test

* rerun

* rerun
 2022-07-28 14:03:12 +08:00
Wenjun Ruan 052ceaacd0
Add is success in loop task status (#11169) 2022-07-28 12:12:01 +08:00
fuchanghai 81fa09678c
[Improvement][ExecutorServiceImpl] remove some unnecessary (#11122) 2022-07-28 09:57:19 +08:00
SongTao Zhuang a52d1b4acd
[11130] Refactor alert-api with lombok (#11133) 2022-07-28 08:31:44 +08:00
Sheldon efd68f4805
[Fix-10665] [S3] Fix s3 download method (#10675) 
when overwrite param is true and dest file is exist, throw exception
make dirs for ancestor directories of the source file path if it is not exists
To describe the error more clearly, change "the file isn`t exists" to specific error message

Co-authored-by: sheldonliu <sheldonliu>
 2022-07-27 21:25:13 +08:00
caishunfeng 6c7e00c4aa
[Bug-11101] fix task failover NPE (#11168) 2022-07-27 19:21:21 +08:00
Lyle Shaw 181cd2ff79
[Feature] Add CURD to the project/tenant/user section of the API and add its tests. (#10913) 2022-07-27 14:33:33 +08:00
zhuxt2015 cc2f17ddcc
[Enhancement][API] Copy workflow with scheduler info (#10677) 
* support batch copy workflow with scheduler
 2022-07-27 13:45:45 +08:00
Jiajie Zhong de5c22b276
[doc] Add new page incompatible change (#11153) 
Add incompatibles and give some hint to user when then
want to upgrade to specific version.

ref: #10607
 2022-07-27 11:15:09 +08:00
caishunfeng b03f2e22cd
fix k8s master and worker start error (#11156) 2022-07-27 09:23:17 +08:00
xuhhui 8b50578bdb
[doc] Fix bugs in doc installation, design and glossary (#11084) 2022-07-26 18:08:19 +08:00
Assert cdfe115247
[Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter (#10960) 
* [Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter

* checkstyle
 2022-07-26 17:41:13 +08:00
xuhhui 8004e97b4b
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController (#10832) 
* [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController
 2022-07-26 15:24:48 +08:00
zhuxt2015 5ebd53893c
[Feature-10604] Task name in the copied and imported workflow without copy suffix (#10607) 
* fix

* remove imported task suffix
 2022-07-26 15:21:33 +08:00
Wenjun Ruan c7789bf049
Add base loop task execotor and http template parser (#11137) 
* Add base loop task execotor and http template parser

* Add JsonPathUtils
 2022-07-26 14:51:50 +08:00
qinchaofeng c28774e5dd
[Doc]Chinese translation updated (#11146) 
* Update python.md Chinese translations

* Update zeppelin.md Chinese translations
 2022-07-26 14:33:38 +08:00
Eric Gao 0e15ce3389
[Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#11128) 
* [Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#10867)

* Update docs and grafana demo dashboards
 2022-07-26 13:44:02 +08:00
Devosend d76d6da734
[Fix][UI] Add duplicate of file suffix (#11136) 2022-07-26 11:25:33 +08:00
zhuxt2015 4d9db3451e
[Bug] [API] If the single log length is long, it will causes the View Log page to hang (#10612) 2022-07-26 10:14:45 +08:00
songjianet fbfaca3dbd
[Refactor][UI] Refactor resource manage using NSpace component. (#11098) 
* [Refactor][UI] Refactor resource manage using NSpace component.

* [Refactor][UI] Refactor resource manage using NSpace component.
 2022-07-26 10:07:00 +08:00
liyangyang 6f0a609793
[Improvement 11072][common] Added HTTPS request support in kerberos environment (#11127) 
* [Improvement-11072][dolphinscheduler-common] Added HTTPS request support in kerberos environment

* [Improvement-11072][dolphinscheduler-common] supplement

Co-authored-by: liyangyang <liyangyang@bizseer.com>
 2022-07-25 23:21:42 +08:00
songjianet 7ed1e7cd74
[Refactor][UI] Refactor function manage using NSpace component. (#11124) 2022-07-25 22:22:04 +08:00
Devosend 011040f90e
[Fix][UI] fix bug where The Gantt chart does not show the execution status (#11135) 
* fix bug where The Gantt chart does not show the execution status of all components

* modify round method
 2022-07-25 15:53:57 +08:00
JieguangZhou 764a24384f
[python] add import SageMaker task (#11121) 2022-07-25 15:46:36 +08:00
liyangyang f13e7a95ae
[Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support (#11017) 
* [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] code format

* [Improvement-11013][dolphinscheduler-common] add hadooputils test code

* [Improvement-11013][dolphinscheduler-common] remove extra blank lines

* [Improvement-11013][dolphinscheduler-common] adjusts test code

* [Improvement-11013][dolphinscheduler-common] remove useless import

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] shortened string

* [Improvement-11013][dolphinscheduler-common]  format test code style

Co-authored-by: liyangyang <liyangyang@bizseer.com>
 2022-07-25 11:07:40 +08:00
jackfanwan ccb7641468
修改数据质量查询的权限判断 (#10977) 
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
 2022-07-25 09:35:53 +08:00
Wenjun Ruan 71cf7e1baa
[Fix-10918] Close datasource when expire from guava cache (#11120) 
* Close datasource when expire from guava cache
* Remove duplicate datasource in HiveDataSourceClient
 2022-07-23 20:43:37 +08:00
JieguangZhou 952aee80e7
[fix] py sagemaker doc (#11109) 2022-07-22 22:57:50 +08:00
Devosend 2f2de7f90e
fix space validate for create folder bug (#11106) 2022-07-22 17:08:12 +08:00
zhuxt2015 3701a24d15
[Improvement][Task Log] Task status log print description instead of code (#11009) 
* use execution status instead of status code
 2022-07-22 13:34:31 +08:00
songjianet de6e58ec1b
[Fix][UI] Fix the problem of too large spacing in operation. (#11090) 
* [Fix][UI] Fix the problem of too large spacing in operation.

* [Fix][UI] Fix the problem of too large spacing in operation.
 2022-07-22 11:52:41 +08:00
Devosend 7227acd653
fix view variable display bug (#11100) 2022-07-22 11:52:25 +08:00
Amy0104 79cec27423
[Fix][UI] Widen the segment separator input box. (#11096) 2022-07-22 11:02:25 +08:00
JieguangZhou cc088e0f54
[python] Support SageMaker task type (#11002) 2022-07-22 10:47:08 +08:00
xiangzihao 5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
xiangzihao c34fe4f9b3
Try to fix filemanage e2e flaky test (#11097) 2022-07-22 05:51:26 +08:00
songjianet 445e830a84
[Refactor][UI] Refactor file manage using NSpace component. (#11073) 2022-07-21 21:19:23 +08:00
JieguangZhou af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935) 
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-07-21 18:16:58 +08:00
Devosend 594f00512b
[Refactor][UI] Refactor time display use datatable render function (#11078) 2022-07-21 15:57:08 +08:00
xiangzihao 72d29971bf
[E2E] [CI] Fix flaky e2e test (#11077) 
* fix flaky e2e test

* fix flaky e2e test

* fix flaky e2e test
 2022-07-21 15:43:24 +08:00
songjianet 25ded1e81b
[Refactor][UI] Refactor rule manage using NSpace component. (#11069) 2022-07-20 19:39:00 +08:00
旺阳 28b40da1b1
[Improve] Hide Change Pwd Page When Login With LDAP (#11041) 
* hide-change-pwd-page-when-ldap-login

* add unit test
 2022-07-20 18:48:16 +08:00
WangJPLeo fd59f0bb32
[Fix-11031] AccessToken can only be used by the creator. (#11032) 
* AccessToken can only be used by the creator.

* supplement ut

* checkstyle fix
 2022-07-20 16:32:03 +08:00
fuchanghai 1a08f3970d
[fix-10729]The request's url given by the test case looks different f… (#10734) 
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
 2022-07-20 15:42:45 +08:00
Eric Gao f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production (#11010) 
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584)

* Add front-end and update docs for the production mode of zeppelin task

* Fix minor front-end bug of zeppelin task plugin

* Refactor ZeppelinParameters with lombok

* Fix formatting

* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
 2022-07-20 14:16:47 +08:00
xuhhui 35f32cd16e
[Improvement][Task]Improve seatunnel task command log (#11027) 2022-07-20 11:06:10 +08:00
Eric Gao 2f0d907bcb
[Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045) 
* [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11040)
 2022-07-20 11:02:47 +08:00