bc4326125d
Fix session/thread leak at ssh datasource ( #14859 )
2023-09-07 11:55:31 +08:00
11c8e0bdf1
[Improve] Fix placeholders should match arguments in log statement ( #14850 )
2023-09-06 13:32:26 +08:00
974d700984
Revert "fix: Local resource error in some entrypoint ( #14826 )" ( #14838 )
...
This reverts commit 9e60632201
2023-09-05 12:41:04 +08:00
adf49fd23f
[Feature-14802][api] Use Casdoor SSO to log in, add admin user configuration ( #14814 )
...
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration
Use Casdoor SSO to log in, add admin user configuration
This closes #14802
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration
Use Casdoor SSO to log in, add admin user configuration
This closes #14802
* update doc
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration
Use Casdoor SSO to log in, add admin user configuration
This closes #14802
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
2023-09-04 13:25:40 +08:00
9e60632201
fix: Local resource error in some entrypoint ( #14826 )
...
Fix createResource, queryResourceListPaging, onlineCreateResource
resource error in local resource
2023-08-28 21:16:16 +08:00
d223d654cc
Add rpc benchmark test ( #14797 )
2023-08-27 20:59:55 +08:00
d62ce25a01
Remove `@AccessLogAnnotation` annotation, replace with built-in access log ( #14803 )
2023-08-24 15:19:01 +08:00
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
2023-08-23 09:43:17 +08:00
70731a1617
[Feature][Authentication] support oauth2 login ( #14743 )
...
* support oauth2 login
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-21 15:57:30 +08:00
e2b97c026e
[Improvement][UI] Support to disable or enable the project preferences. ( #14756 )
2023-08-16 20:20:48 +08:00
a826ed2c1a
[Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format ( #14680 )
...
* [Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format
Signed-off-by: Gallardot <gallardot@apache.org>
* [Improvement][security] list-paging API endpoint should not return the user's password in MD5 format
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-08-14 18:28:11 +08:00
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
2023-07-28 14:41:58 +08:00
5ccc4cc889
[Improvement-4375][api] cannot delete yarn queue ( #13046 )
...
* [Bug-12833][api]
delete api
* [Bug-12833][api]
delete yarn queue
* [Bug-12833][api]
add Unit Test
* Repair the failed CI
* Repair the failed UT
* Repair the failed Docs
* Repair the failed Doc
---------
Co-authored-by: amao <Guoqing.Mao@Yumchina.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-26 11:52:57 +08:00
4aab0b234f
Use AdHoc datasource client in sqlTask ( #14631 )
...
* Use AdHoc datasource client in sqlTask
* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
2023-07-26 08:58:50 +08:00
759756ae80
[Improvement-14269][API] Bind task group with project ( #14392 )
...
* [Improvement-14269][API] Bind task group with project
* remove comment
* add project permission check for task group operation
* add doc
2023-07-23 12:11:37 +08:00
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict ( #14561 )
2023-07-21 18:17:53 +08:00
1e31327418
[Improvement][K8S] Disable delete namespaces in the K8S cluster ( #14597 )
...
* [Improvement][K8S] Disable all namespaces operations in the K8S cluster
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-21 10:28:20 +08:00
3d033da55d
[Improvement] Dataquality code style enhance ( #14592 )
...
* code style enhance
* update
---------
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 20:02:51 +08:00
de2d215aee
impv: Correct datax execute and python execute script name ( #14523 )
...
* impv: Correct datax execute and python execute script name
we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name
* Add pr number
* fix ut
* style
---------
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
8505f1878d
Expose swagger.properties to release ( #14590 )
2023-07-19 22:24:42 +08:00
93c3871925
Support parse ipv6 ( #14584 )
2023-07-19 17:25:58 +08:00
20cf4ad4e6
[Feature-14505][UI] Support to set project-level preferences ( #14573 )
...
* add a few codes about the project preferences
2023-07-19 15:35:54 +08:00
804b715643
[Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user ( #14577 )
...
* [Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user
Signed-off-by: Gallardot <gallardot@apache.org>
* [Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-19 12:58:00 +08:00
1ba0aecc71
[Bug][api] An error occurred while trying to access the Postgres database ( #14574 )
...
Signed-off-by: hoey94 <cnnqjban521@gmail.com>
2023-07-18 17:22:27 +08:00
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
2023-07-14 18:40:01 +08:00
484f8419c4
[FIX-14299][api]: check schedule exists ( #14430 )
...
* fix: check schedule exists
* put error message in result
---------
Co-authored-by: lutong <lutongtong211027@credithc.com>
2023-07-13 16:21:07 +08:00
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database ( #14406 )
...
* add dataquality database api
* change ui
* api change
* update
* fix spotless
* fix h2
* fix pg
* fix-dead-line
* update
* fix-spotless
* update pg sql
* add ut
* fix ut
2023-07-12 09:00:28 +08:00
0246327083
Polish config, expose rpc config in application.yml ( #14501 )
2023-07-11 09:29:31 +08:00
406aeaf659
Use jvm_args_env.sh to set JVM args ( #14487 )
2023-07-10 17:39:57 +08:00
3de0b5a38c
[Feature-14339][Parameter] Add parameter combining of project-level parameters ( #14452 )
2023-07-10 10:17:46 +08:00
d6735e8ecc
[Improvement][API] Fix some nits in apis ( #14481 )
...
* Fix some nits in apis
2023-07-07 18:19:01 +08:00
68a3a75211
[Improvement-14457][UT] Improve the expected and actual value of Assertions ( #14459 )
2023-07-06 13:12:48 +08:00
76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date ( #14450 )
2023-07-05 14:35:18 +08:00
d8cf0f8b85
fix issue#14441 ( #14441 ) ( #14444 )
...
alert-plugin-instances api, if no alert-plugin-instances, it will response an empty list, but not null
Co-authored-by: ligen60 <ligen60@jd.com>
2023-07-04 16:20:14 +08:00
f186cd5dab
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration ( #14349 )
2023-06-29 16:14:37 +08:00
bcd1df19b8
[Improvement-14393][Resource Center] Remove deprecated resource description in api and UI page ( #14394 )
2023-06-28 14:13:20 +08:00
5250b253eb
[Improvement-14311][Permission]Remove duplicate checkProjectAndAuth ( #14313 )
2023-06-27 14:01:37 +08:00
221df4a278
revert: Datasource need test binding to create prod ( #14381 )
...
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible
related to https://github.com/apache/dolphinscheduler/pull/11670
2023-06-27 10:59:17 +08:00
d4921fa2dd
[Feature][UI] Support CRUD of project-level parameters. ( #14344 )
2023-06-13 18:54:41 +08:00
61118d4467
[fix-14123] remove the equals and hashcode in Project pojo ( #14167 )
...
* [fix] remove the equals and hashcode in Project pojo
* [fix]fix the Strict Problem in Mockito by using `doReturn()` instead of `when()` functionw
---------
Co-authored-by: xuankun zheng <zhxuankun@gmail.com>
2023-06-13 11:19:04 +08:00
1c935d901e
[Feature-14214][Parameter] Support CRUD of project-level parameters ( #14264 )
2023-06-12 13:35:38 +08:00
aa2d9a7f05
Add baseDao ( #14316 )
2023-06-09 19:02:50 +08:00
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
767331281a
[Improvement-14255][Project] Remove userName when update project ( #14256 )
2023-06-02 09:58:22 +08:00
d67fe52c33
Fix the perm setting for the process definition import function ( #14239 )
...
* Fix the perm setting for the process definition import function
* fix the style issue
2023-06-01 15:59:02 +08:00
8aec3846b4
[Improvement-14243][Metrics] Add user tag of response time of api server ( #14248 )
2023-06-01 15:13:28 +08:00
b8748e29ae
Fix TreeView "Task Status" not show bug and compatibility with older versions ( #14207 )
...
use WorkflowExecutionStatus.name()
2023-05-29 13:39:38 +08:00
4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. ( #14178 )
2023-05-24 08:50:53 +08:00
5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server ( #14177 )
2023-05-23 12:22:49 +08:00
428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS ( #14084 )
2023-05-22 20:44:43 +08:00
503d54aff9
Fix dependent task nodes in workflow instances cannot display data ( #14141 )
2023-05-18 19:24:53 +08:00
1e3ae7b942
[improv][Resource Center] Implement getResourceFileName in StorageOperator ( #14097 )
2023-05-15 14:02:30 +08:00
d2f83ee8cf
[Feature] Support run all level dependent when complement ( #11778 )
...
* ADD: support all level dependent
* MOD: delete log
* MOD: format
* FIX: ut
* ADD: ut
* format
2023-05-05 14:52:27 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2023-05-05 14:43:06 +08:00
cf91544b99
Refactor logic task ( #13948 )
2023-04-26 10:01:51 +08:00
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-04-24 21:28:14 +08:00
73b505f639
[Bug][API] update processInstance bug ( #13991 )
2023-04-24 11:44:45 +08:00
7835ddfdb7
[Fix-13780][api] Fix the problem of process instance DAG can't show dependent task ( #13823 )
2023-04-19 15:40:51 +08:00
dc4cd976c1
add return success judge ( #13873 )
...
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-04-19 10:23:20 +08:00
45586f71d5
[BUG][Resource Center] Task can not select main JAR ( #13536 )
2023-04-18 18:38:16 +08:00
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters ( #13935 )
...
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2023-04-18 14:56:38 +08:00
119f08d2ba
[Bug-13882][Worker] Upgrade kubernetes-client version to 6.0.0 ( #13891 )
2023-04-17 12:04:36 +08:00
4bf097ee40
[Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath ( #13848 )
...
* [Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath
* remove semicolon
* set null in some specific scenario
* remove useless console.log
2023-04-17 11:56:42 +08:00
51afbfe159
Fix schedule time data primary key conflict when importing workflow definition ( #13926 )
2023-04-13 17:01:10 +08:00
2177d70150
Set user default tenant ( #13909 )
2023-04-13 15:43:24 +08:00
bae8df6aa1
[Improvement-13911][JSON] Improve the readability of workflow exported json files ( #13912 )
2023-04-13 11:15:07 +08:00
61637cc0a3
[Bug] [Cron] Parse corn expression error ( #13841 )
...
* fix-cron
* update catch exception
2023-04-09 12:50:42 +08:00
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2023-04-06 17:49:33 +08:00
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
8f3a23dae5
[Fix-13828][api] Fix the problem of work groups have two defult records ( #13829 )
2023-03-31 11:18:17 +08:00
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin ( #13801 )
2023-03-30 20:17:28 +08:00
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2023-03-30 14:11:23 +08:00
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2023-03-30 12:07:58 +08:00
68660ec96b
Refactor remote command ( #13809 )
...
* Refactor remote command
* Rename Command to Message
2023-03-29 17:54:57 +08:00
4e2c22061a
[Fix-11583][UI] Fix the API usage of gantt graph ( #13778 )
2023-03-28 17:17:10 +08:00
8895921d87
[Improvement-13651] Remove useless resources_task ( #13721 )
2023-03-23 22:52:23 +08:00
1075be6e62
[Improvement] Test DataSource connection return msg may not internationalization ( #13767 )
...
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2023-03-21 09:58:24 +08:00
1f365819a6
Ignore unknown VM options in start.sh ( #13719 )
2023-03-10 17:34:09 +08:00
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) ( #13640 )
...
* Tag workflow related metrics with process definition code (workflow id)
* Clean up related metrics when deleting workflow definition
* Add license headers
* Update related UT cases
* Add an example in grafana-demo
* Add related docs
2023-03-09 11:30:21 +08:00
76f3076481
[Bug] Fix ResourcesServiceImpl.java pageInfo ( #13709 )
2023-03-09 11:05:52 +08:00
30fd43e32b
feat: Python add online_schedule for workflow control schedule state ( #13551 )
...
related: apache/dolphinscheduler-sdk-python#73
2023-03-07 11:35:01 +08:00
512899ed14
feat: Python return datasource object and allow filter by type ( #13616 )
...
related: https://github.com/apache/dolphinscheduler-sdk-python/pull/75
2023-03-07 11:34:28 +08:00
a8e3deca8b
[Improvement][api] Remove unless code in ResourcesServiceImpl ( #13676 )
...
* remove unless code in ResourcesServiceImpl
---------
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2023-03-06 10:40:17 +08:00
7c97febefb
[Improvement-12697][UT] Improve the ProjectServiceTest ( #12698 )
2023-03-01 11:37:52 +08:00
eb4cba8884
[Improvement-12782][UT] Add UT for the 13 implementations of ResourceAcquisitionAndPermissionCheck ( #12784 )
2023-03-01 11:37:19 +08:00
4351a25f2a
Add execute function to handle the workflow instance operation ( #13610 )
2023-02-24 13:47:41 +08:00
df963f8393
[Improvement] Add call cost time for api ( #13518 )
2023-02-09 14:29:23 +08:00
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2023-02-07 20:32:53 +08:00
8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center ( #13435 )
2023-02-07 11:55:07 +08:00
3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api ( #13475 )
...
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool
* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
0ee82c5492
[doc] Update LDAP config doc ( #13507 )
2023-02-04 11:05:51 +08:00
19ffd64e23
Fix complement data date order will change due to use set ( #13487 )
2023-02-03 19:44:45 +08:00
80da35e39c
[Fix-12828][api] Add permission check when query specific datasource ( #12830 )
2023-02-01 10:41:05 +08:00
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
713fdbc444
Split the upgrade code ( #13436 )
...
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2023-01-20 20:48:07 +08:00
3b54de0c90
fix when the task details are not modified, the predecessor node cannot be modified ( #13422 )
...
* fix when the task details are not modified, the predecessor node cannot be modified
* deleted useless code
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-01-18 20:08:28 +08:00
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
2023-01-18 17:58:32 +08:00
01f4fb26f0
Change remove task instance log to async request ( #13399 )
2023-01-16 15:49:23 +08:00
8439b5dc69
[fix-12721] Fix cannot modify the upstream task in task definition page. ( #12722 )
2023-01-15 19:58:47 +08:00
98dfd64444
Clear the task group data when delete a project/workflowInstance ( #13383 )
2023-01-12 21:51:51 +08:00
7027d3d768
[improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList``` ( #13057 )
...
* [improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList```
* [improve-#13053] format
* [improve-#13053] fix UT
* Update Status.java
update description
* [improve-#13053] add parameter ```version ```
* [improve-#13053] format
* [improve-#13053] version is not necessary
* [improve-#13053] format
* Update use-form.ts
change ```version``` default vaule to ``` null```
* [improve-#13053] format
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* Update ExecutorServiceImpl.java
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-01-07 20:49:59 +08:00
a074f7e2e6
Delete workflow will delete workflow instance ( #13336 )
2023-01-04 22:22:03 +08:00
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
2023-01-03 09:52:28 +08:00
d42f576268
[fix][python] schedule unexpect offline each time update from api ( #13301 )
...
* Alway set workflow online before set schedule online
* Avoid return map in interface setScheduleState
2022-12-30 09:59:16 +08:00
04ea8f7e28
Revert "[Bug] [Server] Once click online schedule time, task will be automatically scheduled ( #13092 )" ( #13295 )
...
This reverts commit 7497b26979
2022-12-28 22:02:48 +08:00
7497b26979
[Bug] [Server] Once click online schedule time, task will be automatically scheduled ( #13092 )
...
* fix bug that trigger mis-fire strategy when setting start time earlier than current time
* update ut
* add warning msg
* add check start time when set schedule online
2022-12-28 14:51:59 +08:00
df32ef0efb
Fix when update scheduler will execute workflow ( #13285 )
2022-12-28 14:33:38 +08:00
fd3afd84ad
Remove alert when delete workflow instance ( #13281 )
2022-12-28 11:40:12 +08:00
a75a69f3ec
[Improvement][api]Start the downstream workflow when it is online ( #13257 )
...
Start the downstream workflow when it is online
2022-12-26 11:58:37 +08:00
8870464c02
[Improvement][api] Optimize batch query in process-list interface ( #13222 )
...
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-23 23:33:42 +08:00
a98cae7065
[Fix-13260][API] Ironed out the issue with lacking the value of user's name when querying the list of workflow definitions. ( #13261 )
...
* fix the issue with lacking user name
2022-12-23 19:22:08 +08:00
a235d3cd6a
[Improvement][UI] Support to display extra columns such as 'Worker Group' and 'Environment Name' on the page of cron manage. ( #13267 )
2022-12-23 15:24:59 +08:00
14ec4a2398
Remove dao module in worker ( #13242 )
2022-12-22 12:25:29 +08:00
5cd8a02f87
[fix] Remove tenant arg in workflow definition ( #13212 )
...
current tenant in workflow only work when the first time
user do not exist, when user change the tenant in workflow
but tenant exist, it will be ignore, so we try to remove it
from workflow, and in #40 we try to create both user and tenant
vis cli instead of auto create
2022-12-19 16:06:41 +08:00
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2022-12-18 18:17:09 +08:00
042ec74a24
[refactor] cache compiled regex pattern ( #13208 )
...
* [refactor] cache compiled regex pattern
* [refactor] cache compiled regex pattern
* [refactor] cache compiled regex pattern
2022-12-18 11:24:11 +08:00
0e3a924a37
move v2folder ( #13192 )
2022-12-16 10:30:01 +08:00
ca5af013ae
[Fix] openapi version inconsistency when updating workflows, tasks and relationship ( #13094 )
...
Co-authored-by: xiangzihao <460888207@qq.com>
2022-12-14 14:57:57 +08:00
631e3a81d1
[Feature][API] New restful API for taskInstance ( #13070 )
2022-12-14 14:47:36 +08:00
e4b9b67255
Allow execute task in workflow instance ( #13103 )
2022-12-13 16:43:44 +08:00
0db1bb6ba8
[Improvement][ApiServer]Task defination list paging sorted by updateTime not effect ( #12622 )
2022-12-13 16:35:54 +08:00
ab96a3d0c0
Fix datasource jdbc url param doesn't work ( #13098 )
2022-12-12 11:46:40 +08:00
f5801a0e1c
Fix task group might be rob by multiple task ( #13115 )
2022-12-11 22:58:21 +08:00
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2022-12-10 23:50:19 +08:00
f9cf9331a6
Throws the correct exception for the updateResource interface ( #13120 )
...
Co-authored-by: rqyin <rqyin@easipass.com>
2022-12-09 16:17:20 +08:00
cb8d125e0f
[Improvement] optimization task definition & fix in the task definition list, if one task have more pre task, the task list can't show all task ( #13106 )
...
* fix in the task definition list, if one task have more pre task, the task list can't show all task
* modify code style
* in the task definition, delete search workflow name filter, and fix in the task definition list, if one task have more pre task, the task list can't show all task
* modify code style
* modify code style
* delete useless select sql
* add annotation
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-12-07 09:52:53 +08:00
8a152aebc7
Fix task log file might not be clear ( #13102 )
2022-12-06 11:23:20 +08:00
fed1e85fb8
Fix the invalidate task instance never be deleted ( #13091 )
2022-12-04 18:38:54 +08:00
169168ef34
Add plugin-all module ( #13079 )
2022-12-02 23:19:08 +08:00
1192720ddc
[ci] Update skywalking-eye and fix block CI ( #13076 )
2022-12-02 17:54:00 +08:00
f5a59982b3
[fix] Python gateway can not upload to resource center ( #13042 )
...
in #12076 we refactor our resource center, remove the resource table,
it is a good refactor but it failed python api upload, this patch try
to fix python api upload function
ref: #12076
2022-12-02 10:11:57 +08:00
1064680ded
[feat][API] New restful API for workflow state ( #13031 )
2022-12-01 14:21:01 +08:00
c2ae76c0bd
Expand all static imports and add CI check to block wildcard static imports ( #13067 )
2022-12-01 14:15:28 +08:00
ffc9fb280a
Add gc timestampt ( #13059 )
2022-12-01 10:00:27 +08:00
a0eb45b9e4
[Feature][API] New restful API for workflowInstance ( #12990 )
2022-11-28 12:58:46 +08:00
7336afaa65
[Fix-12916] Add permission check when query or download log ( #12917 )
2022-11-25 17:59:28 +08:00
d09e02e5a9
[Improvement-12804][UT] Remove the unused method in DataAnalysisControllerTest ( #12805 )
2022-11-21 20:59:30 +08:00
20518682bb
[Improvement-12853][UT] Improve the ut of ResourcePermissionCheckServiceTest ( #12854 )
2022-11-19 15:12:12 +08:00
528f45acc5
[improve]Source skip check ( #12900 )
...
* Source skip check
2022-11-17 14:23:12 +08:00
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis ( #12693 )
2022-11-17 10:14:36 +08:00
f20c9b3102
[chore][python] Change name from process definition to workflow ( #12918 )
...
only change its name in python gateway server code, incluing
* Function name: all related to process definition
* Parameter name and comment related
ref: apache/dolphinscheduler-sdk-python#22
2022-11-16 21:23:39 +08:00
0186413a9f
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController ( #11747 )
...
* Feature ：Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController
2022-11-16 18:32:42 +08:00
6d8befa075
[fix] Add token as authentication for python gateway ( #12893 )
...
separate from #6407 . Authentication, add secret to ensure only trusted people could connect to gateway.
fix : #8255
2022-11-14 18:43:08 +08:00
d324cce6f1
[Feature-12526][Api] add dynamic task function: shell task ( #12840 )
...
* submit dynamic task code
* submit shell.json
* add dynamic-task-type-config.yaml to standalone server
2022-11-14 13:52:44 +08:00
813c44b22b
[Improvement-12838][UT] Improve the ut of datasource ( #12839 )
2022-11-14 11:30:10 +08:00
e3cf72cbcd
[Fix-12832][API] Fix update worker group exception group name already exists. ( #12874 )
2022-11-14 11:20:51 +08:00
87a88e3662
[feat] Support set execute type to pydolphinscheduler ( #12871 )
...
Up to now, we can only submit workflow with parallel mode. this patch give users ability specific execute type to workflow
2022-11-12 10:31:08 +08:00
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario ( #12843 )
2022-11-11 16:08:38 +08:00
1347a8f94c
[chore] Separate Python API into another repository ( #12779 )
...
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2022-11-09 21:20:15 +08:00
641a2559ea
[fix-12687]when timeout_notify_strategy is null, modify timeout_notify_strategy ( #12689 )
...
* According to timeoutFlag, assign timeoutNotifyStrategy value
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-09 11:48:12 +08:00
Wenjun Ruan
Bingchang Chen