113dc4b5c5
[Feature-10273][Datasource] Add dataSource for AWS Athena ( #11157 ) ( #12039 )
...
Co-authored-by: ZhaoGuodong <guodongym@163.com>
2022-09-19 13:45:19 +08:00
dde6f63c31
[Feature][PyDolphinScheduler] Support DVC task in pyds #11922 ( #11941 )
...
* add dvc task in pyds
* add BaseDVC class
(cherry picked from commit bbc228e93f
2022-09-18 16:49:34 +08:00
cb063732d7
[feat][python] Support MLflow task in python api ( #11962 )
...
(cherry picked from commit ad683c3c42
2022-09-18 16:46:45 +08:00
f66dedc9da
[feat][python] Support OpenMLDB task in python api ( #11944 )
...
Using the whole word zookeeper instead of short cut zk
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
(cherry picked from commit e50a32d9cc
2022-09-18 16:43:36 +08:00
1ac2e4a8f3
[feat][python] Add sagemaker yaml example ( #11925 )
...
(cherry picked from commit e05f14ba23
2022-09-18 16:43:24 +08:00
6f3b4c1624
[feat][python] Support Pytorch task in python api ( #11975 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
(cherry picked from commit 5202e5cfc6
2022-09-18 16:43:08 +08:00
e462918ac9
[Feat][python] Add parameter environment to task ( #11763 ) ( #11989 )
...
(cherry picked from commit 8988492c43
2022-09-17 10:24:07 +08:00
1ea2e848cd
[Feature][Registry] Support etcd as registry ( #10981 ) ( #11997 )
...
(cherry picked from commit 2eb8b9f7f0
2022-09-17 09:01:24 +08:00
8eadf5e5aa
Fix insertOrUpdate plugin may failed due to concurrent operation ( #11471 ) ( #11996 )
...
(cherry picked from commit 864a90820d
2022-09-17 08:59:45 +08:00
5e42f52bdf
[3.1.0-prepare][cherry-pick][DSIP-11][python] create workflows from YAML configuration ( #11988 )
...
* [DSIP-11][python] create workflows from YAML configuration (#11611 )
(cherry picked from commit 38ee91fb1e#11817 )
(cherry picked from commit c41fa5a8b1
2022-09-17 08:56:37 +08:00
c4953e8660
Example Change the regular expression of the data source password ( #11459 ) ( #11990 )
...
Co-authored-by: jackfanwan <61672564+jackfanwan@users.noreply.github.com>
2022-09-16 15:16:05 +08:00
951f707b61
[fix][doc] Update the registry related configuration in values.yaml ( #11444 ) ( #11981 )
...
Co-authored-by: rickchengx <38122586+rickchengx@users.noreply.github.com>
2022-09-16 11:17:33 +08:00
cd8f32d876
[Bug][Workflow Definition] fix ordinary users can not create depend task ( #11961 ) ( #11977 )
2022-09-16 09:42:59 +08:00
f034a09d25
[Bug-11650][worker] #11650 fix SQL type task, stop task cause NPE ( #11668 ) ( #11958 )
...
Co-authored-by: 冯剑 <35831367+fengjian1129@users.noreply.github.com>
2022-09-15 14:24:34 +08:00
0647b3e10c
[Cherry-pick][Improvement] [Doc] Put default task parameters in a new file #11776 ( #11957 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-15 14:21:05 +08:00
27b69e608a
[Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838 ( #11864 ) ( #11950 )
...
* [Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838
Co-authored-by: Yann Ann <2993643785@qq.com>
2022-09-15 10:39:00 +08:00
0f6cc4fe33
[Fix][db] fix init&upgrade mysql-meta-schema bugs ( #11887 ) ( #11935 )
...
Co-authored-by: wendongdi <49931055+wendongdi@users.noreply.github.com>
2022-09-14 18:49:49 +08:00
8d1c2d3eeb
cherry-pick [Bug] Fix procedure task param pass #11919 ( #11926 )
2022-09-14 15:44:01 +08:00
c76301ab51
[Fix-11217] [Doc] add postgresql config in doc: datasource-setting ( #11326 )
...
* add postgresql config for datasoruce-setting
* Update docs/docs/en/guide/howto/datasource-setting.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-05 10:54:01 +08:00
f8b9aad239
[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames ( #11696 )
2022-09-05 09:54:18 +08:00
554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. ( #11697 )
2022-09-05 09:15:58 +08:00
d0d481d10f
[Fix][UI] Add the task name entry when the workflow instance detail page goes to the task instance page. ( #11761 )
2022-09-03 11:57:02 +08:00
f8d46a26c1
[Feature-11530] add state history for process instance ( #11757 )
...
* [Feature] add state history for process instance (#97 )
* add state history for process instance
* upsertProcessInstance
* remove unuse method
* fix UT
Co-authored-by: caishunfeng <534328519@qq.com>
2022-09-03 10:14:05 +08:00
31ba49ac02
Update doc according to recent update of Spring / Swagger ( #11755 )
2022-09-02 19:06:15 +08:00
277f137358
Add Kubernetes configmap reload to all components ( #11730 )
2022-09-02 12:03:19 +08:00
b3cc8a55b9
[feature][API]feature: add task type list and enable user to add task type to fav ( #11727 )
...
* feature: add task type list and enable user to add task type to fav
* make DependentExecute.java variable protected
* add standalone server fileSet
2022-09-02 11:40:23 +08:00
f95cdd350a
reduce task dependencies ( #11731 )
2022-09-01 17:04:07 +08:00
d0f5e7edf3
optimize the process instance query, change the date time range ( #11719 )
2022-08-31 19:53:41 +08:00
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize ( #11702 )
...
* Refactor heart beat task, use json to serialize/deserialize
2022-08-31 16:20:23 +08:00
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11701 )
...
* Fix kill job may cause worker oom
2022-08-31 15:25:01 +08:00
5fabce783a
[DOC] improve zk digest doc ( #11703 )
2022-08-30 21:07:04 +08:00
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2022-08-30 10:45:51 +08:00
71eeab3d98
[CI] Fix cluster test abnormal ( #11688 )
...
* fix cluster test abnormal
2022-08-30 09:33:22 +08:00
145e441afb
[Fix-11633] The data type of the PostgreSQL database column is wrong. ( #11633 ) ( #11634 )
2022-08-29 16:33:16 +08:00
6a5367fd57
[Improvement-11662][dao] fix foreach null items in mapper.xml
2022-08-28 20:58:12 +08:00
6e4d974b91
[doc] Correct E2E Doc, fix WorkerGroupPage typo ( #11629 )
2022-08-28 17:44:06 +08:00
4dca488cd5
[python] Auto location when create process definition ( #11681 )
...
* Add auto format when submit process definition from python api
* add UPDATING.md
close : #8254
2022-08-27 23:38:46 +08:00
635fde1981
[bug][python] Fix task switch error when default branch not defined last ( #11606 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-27 18:48:09 +08:00
564a815d21
[fix][python] Sql pattern add truncate. ( #11666 )
2022-08-27 12:17:06 +08:00
769a20e986
[Fix][UI] Fix bug where crontab special of month and year ( #11661 )
2022-08-26 23:04:29 +08:00
23d8aaf735
[Feature][UI] Enable highlight and auto-complete for SQL scripts ( #11659 )
2022-08-26 19:03:44 +08:00
cccbd27c58
[Fix][UI] Fix the problem that the pagination component is not centered in the environment management. ( #11646 )
2022-08-26 14:50:46 +08:00
f28a39f984
[Docs] Update README. ( #11641 )
2022-08-26 14:50:32 +08:00
1b120e3a59
Refactor worker execute task process ( #11540 )
...
* Refactor worker execute task process
2022-08-26 13:33:51 +08:00
a22b9271ff
add unit test ci timeout ( #11655 )
2022-08-26 11:45:49 +08:00
eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 ( #11621 )
2022-08-26 10:58:56 +08:00
ce8db1c5fb
[improvement-#11630]fix document about common.properties ( #11653 )
2022-08-26 10:50:31 +08:00
cf3b4424d7
[Fix-11616] Workflow Definition Name Change Validation Optimization. ( #11617 )
...
* Workflow Definition Name Change Validation Optimization
* [Fix][UI] Add the workflow code entry to the verify name interface.
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionService.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* processDefinitionCode param name change
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-08-24 19:59:38 +08:00
b96d69701a
[Improvement-#11613] Add spi priority factory ( #11614 )
...
* Add spi priority factory
* Add doc
* Add override log
* Use lombok
* Add comment
2022-08-24 19:51:47 +08:00
096fae77f4
feat: Locations Formats the layout if it does not exist ( #11535 )
2022-08-24 18:59:14 +08:00
caishunfeng