Commit Graph

1265 Commits

Author SHA1 Message Date
Wenjun Ruan 9df89cf0cf
Use bootstrap user as the default tenant (#13825) 2023-03-30 14:11:23 +08:00
Rick Cheng 85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target (#13654) 2023-03-30 12:07:58 +08:00
Wenjun Ruan 68660ec96b
Refactor remote command (#13809)
* Refactor remote command

* Rename Command to Message
2023-03-29 17:54:57 +08:00
lxorc 4e2c22061a
[Fix-11583][UI] Fix the API usage of gantt graph (#13778) 2023-03-28 17:17:10 +08:00
Aaron Wang 8895921d87
[Improvement-13651] Remove useless resources_task (#13721) 2023-03-23 22:52:23 +08:00
xuhhui 1075be6e62
[Improvement] Test DataSource connection return msg may not internationalization (#13767)
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2023-03-21 09:58:24 +08:00
Wenjun Ruan 1f365819a6
Ignore unknown VM options in start.sh (#13719) 2023-03-10 17:34:09 +08:00
Eric Gao 394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640)
* Tag workflow related metrics with process definition code (workflow id)

* Clean up related metrics when deleting workflow definition

* Add license headers

* Update related UT cases

* Add an example in grafana-demo

* Add related docs
2023-03-09 11:30:21 +08:00
朱通通 76f3076481
[Bug] Fix ResourcesServiceImpl.java pageInfo (#13709) 2023-03-09 11:05:52 +08:00
Jay Chung 30fd43e32b
feat: Python add online_schedule for workflow control schedule state (#13551)
related: apache/dolphinscheduler-sdk-python#73
2023-03-07 11:35:01 +08:00
Jay Chung 512899ed14
feat: Python return datasource object and allow filter by type (#13616)
related: https://github.com/apache/dolphinscheduler-sdk-python/pull/75
2023-03-07 11:34:28 +08:00
陈家名 a8e3deca8b
[Improvement][api] Remove unless code in ResourcesServiceImpl (#13676)
* remove unless code in ResourcesServiceImpl

---------

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2023-03-06 10:40:17 +08:00
Rick Cheng 7c97febefb
[Improvement-12697][UT] Improve the ProjectServiceTest (#12698) 2023-03-01 11:37:52 +08:00
Rick Cheng eb4cba8884
[Improvement-12782][UT] Add UT for the 13 implementations of ResourceAcquisitionAndPermissionCheck (#12784) 2023-03-01 11:37:19 +08:00
Wenjun Ruan 4351a25f2a
Add execute function to handle the workflow instance operation (#13610) 2023-02-24 13:47:41 +08:00
caishunfeng df963f8393
[Improvement] Add call cost time for api (#13518) 2023-02-09 14:29:23 +08:00
seedscoder 8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
Rick Cheng 8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
xiaojingXU 3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api (#13475)
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool

* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
旺阳 0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
dddyszy 19ffd64e23
Fix complement data date order will change due to use set (#13487) 2023-02-03 19:44:45 +08:00
Rick Cheng 80da35e39c
[Fix-12828][api] Add permission check when query specific datasource (#12830) 2023-02-01 10:41:05 +08:00
Tq 78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
Wenjun Ruan 713fdbc444
Split the upgrade code (#13436)
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2023-01-20 20:48:07 +08:00
jackfanwan 3b54de0c90
fix when the task details are not modified, the predecessor node cannot be modified (#13422)
* fix when the task details are not modified, the predecessor node cannot be modified

* deleted useless code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-01-18 20:08:28 +08:00
qianli2022 8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId (#13184)
* add sql

* add mapper

* add dao

* add excutor


Co-authored-by: qianl4 <qianl4@cicso.com>
2023-01-18 17:58:32 +08:00
Wenjun Ruan 01f4fb26f0
Change remove task instance log to async request (#13399) 2023-01-16 15:49:23 +08:00
jackfanwan 8439b5dc69
[fix-12721] Fix cannot modify the upstream task in task definition page. (#12722) 2023-01-15 19:58:47 +08:00
Wenjun Ruan 98dfd64444
Clear the task group data when delete a project/workflowInstance (#13383) 2023-01-12 21:51:51 +08:00
fuchanghai 7027d3d768
[improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList``` (#13057)
* [improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList```

* [improve-#13053] format

* [improve-#13053] fix UT

* Update Status.java

update description

* [improve-#13053] add parameter ```version ```

* [improve-#13053] format

* [improve-#13053] version is not necessary

* [improve-#13053] format

* Update use-form.ts

change  ```version``` default vaule to ``` null```

* [improve-#13053] format

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* Update ExecutorServiceImpl.java

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-01-07 20:49:59 +08:00
Wenjun Ruan a074f7e2e6
Delete workflow will delete workflow instance (#13336) 2023-01-04 22:22:03 +08:00
Wenjun Ruan 8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join (#13284) 2023-01-03 09:52:28 +08:00
Jay Chung d42f576268
[fix][python] schedule unexpect offline each time update from api (#13301)
* Alway set workflow online before set schedule online
* Avoid return map in interface setScheduleState
2022-12-30 09:59:16 +08:00
Wenjun Ruan 04ea8f7e28
Revert "[Bug] [Server] Once click online schedule time, task will be automatically scheduled (#13092)" (#13295)
This reverts commit 7497b26979.
2022-12-28 22:02:48 +08:00
Aaron Wang 7497b26979
[Bug] [Server] Once click online schedule time, task will be automatically scheduled (#13092)
* fix bug that trigger mis-fire strategy when setting start time earlier than current time

* update ut

* add warning msg

* add check start time when set schedule online
2022-12-28 14:51:59 +08:00
Wenjun Ruan df32ef0efb
Fix when update scheduler will execute workflow (#13285) 2022-12-28 14:33:38 +08:00
Wenjun Ruan fd3afd84ad
Remove alert when delete workflow instance (#13281) 2022-12-28 11:40:12 +08:00
XCL a75a69f3ec
[Improvement][api]Start the downstream workflow when it is online (#13257)
Start the downstream workflow when it is online
2022-12-26 11:58:37 +08:00
陈家名 8870464c02
[Improvement][api] Optimize batch query in process-list interface (#13222)
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-23 23:33:42 +08:00
calvin a98cae7065
[Fix-13260][API] Ironed out the issue with lacking the value of user's name when querying the list of workflow definitions. (#13261)
* fix the issue with lacking user name
2022-12-23 19:22:08 +08:00
calvin a235d3cd6a
[Improvement][UI] Support to display extra columns such as 'Worker Group' and 'Environment Name' on the page of cron manage. (#13267) 2022-12-23 15:24:59 +08:00
Wenjun Ruan 14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00
Jay Chung 5cd8a02f87
[fix] Remove tenant arg in workflow definition (#13212)
current tenant in workflow only work when the first time
user do not exist, when user change the tenant in workflow
but tenant exist, it will be ignore, so we try to remove it
from workflow, and in #40 we try to create both user and tenant
vis cli instead of auto create
2022-12-19 16:06:41 +08:00
JieguangZhou 66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194)
* Supports task instance cache operation

* add task plugin cache

* use SHA-256 to generate key

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Optimizing database Scripts

* Optimize clear cache operation

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2022-12-18 18:17:09 +08:00
youzipi 042ec74a24
[refactor] cache compiled regex pattern (#13208)
* [refactor] cache compiled regex pattern

* [refactor] cache compiled regex pattern

* [refactor] cache compiled regex pattern
2022-12-18 11:24:11 +08:00
insist777 0e3a924a37
move v2folder (#13192) 2022-12-16 10:30:01 +08:00
insist777 ca5af013ae
[Fix] openapi version inconsistency when updating workflows, tasks and relationship (#13094)
Co-authored-by: xiangzihao <460888207@qq.com>
2022-12-14 14:57:57 +08:00
insist777 631e3a81d1
[Feature][API] New restful API for taskInstance (#13070) 2022-12-14 14:47:36 +08:00
JieguangZhou e4b9b67255
Allow execute task in workflow instance (#13103) 2022-12-13 16:43:44 +08:00
xuhhui 0db1bb6ba8
[Improvement][ApiServer]Task defination list paging sorted by updateTime not effect (#12622) 2022-12-13 16:35:54 +08:00