Commit Graph

1382 Commits

Author SHA1 Message Date
Jay Chung 8a4f111fd4 [maven-release-plugin] prepare release 3.2.1 2024-02-07 11:09:56 +08:00
Jay Chung d5c543f467
Revert some incompatible change for 3.2.1 (#15580)
* Revert "Fix k8sTaskExecutionContext setting configYaml (#15116)"

This reverts commit ce11674668.

* Revert "[Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977)"

This reverts commit c532fea00e.
2024-02-07 10:41:04 +08:00
Jay Chung 7a1be3f329 [maven-release-plugin] prepare for next development iteration 2024-02-07 00:15:26 +08:00
Jay Chung ba5ec7375c [maven-release-plugin] prepare release 3.2.1 2024-02-07 00:15:25 +08:00
旺阳 0b722999d3 [Fix] Fix WorkflowInstance batch start failed will throw incorrect exception. (#15577)
(cherry picked from commit 73a5a77db2)
2024-02-06 18:24:50 +08:00
Wenjun Ruan 52d315d3ca Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused (#15574)
(cherry picked from commit 43a06525a2)
2024-02-06 18:24:39 +08:00
小可耐 7d660ec2f9 [Bug][force-success] force success add end time (#15144)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
(cherry picked from commit e5a208f363)
2024-02-06 18:24:26 +08:00
Wenjun Ruan c8f120a60a Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time (#15528)
(cherry picked from commit 89742332a8)
2024-02-06 18:22:34 +08:00
John Huang d9529d95f3 refactor comments & function name for confuse (#15546)
Co-authored-by: fuchanghai <changhaifu@apache.org>
(cherry picked from commit 2f66a667ba)
2024-02-06 18:22:32 +08:00
Wenjun Ruan be58ba69a9 Exit JVM when OOM (#15538)
(cherry picked from commit 25810a81dc)
2024-02-06 18:21:56 +08:00
Jay Chung 898b001608
cp: Reduce the size of tarball to continue ASF release (#15004) (#15540)
* Reduce the size of tarball to continue ASF release

for more detail you can see https://lists.apache.org/thread/rmp7fghlj0n7h9y2v3p8gkw9f9qbo6qt
2024-02-06 18:15:57 +08:00
sunsongyang 95ae0036f6
[improvement][api] Fix typo for controllers (#15438)
Co-authored-by: fuchanghai <changhaifu@apache.org>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2024-01-24 10:39:35 +08:00
Wenjun Ruan 308e4fb4a6
Directly Throw exception when taskInstancy log path is empty which log need to be queried (#15511) 2024-01-20 16:40:30 +08:00
Wenjun Ruan 0dc373df2a
Set TaskGroupQueue updateTime when force start (#15510) 2024-01-18 22:11:50 +08:00
silenceland 16c97ef44d
[DS-15489][style]rename the vo object suffix (#15504)
- the naming suffix of the objects under the package dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/vo is not unified, such as AlertPluginInstanceVO and ScheduleVO, etc.
- this issue solve it, and uniformly modified to the VO suffix

Co-authored-by: fuchanghai <changhaifu@apache.org>
2024-01-18 17:13:53 +08:00
Wenjun Ruan 64e1e67581
Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496)
Co-authored-by: fuchanghai <changhaifu@apache.org>
2024-01-18 14:59:17 +08:00
sunsongyang e1fcd4e485
[Bug][Api] Fix NPE when deleting a workflow instance (#15485) (#15488) 2024-01-17 22:03:33 +08:00
AliceXiaoLu cb5317f7ca
[bug] Exception when using host in ipv6 format (#14040)
* DB2 edit again, no username.

* [bug] db2's jdbcUrl should be like this "jdbc:db2://localhost:50000/sample:currentSchema=DB2INST1;characterEncoding=UTF-8;".should be ":"

* Update Db2DataSourceProcessor.java

* Update Db2DataSourceProcessorTest.java

* 【Bug】OracleSource edit again, ConnectionType is null

* when user inputs ipv6,checkhost will return "!IPV4_PATTERN.matcher(host).matches()";
I think we should use isInetAddress to check the host is isValid

* Update AbstractDataSourceProcessor.java

* Update DatabendDataSourceProcessorTest.java

last week other modified this

* Update MySQLDataSourceProcessorTest.java

* Update DataSourceUtilsTest.java

* Update MySQLDataSourceProcessorTest.java

* Update KyuubiDataSourceProcessorTest.java

* Update AbstractDataSourceProcessor.java

if host is ipv6 or ipv4 will OK; if not check other

* Update AbstractDataSourceProcessor.java

* Update AbstractDataSourceProcessor.java

* Update DataSourceUtilsTest.java

增加ipv6数据源验证

* [Bug] [dolphinscheduler-api] queryDataSource'password should be hidden.

---------

Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2024-01-15 09:33:08 +08:00
liyou 0f7081be10
[Feature] timed scheduler Improvement (#15449) (#15450) 2024-01-11 17:25:31 +08:00
Wenjun Ruan d6dea4633c
Optimize server startup log (#15362) 2023-12-27 20:20:21 +08:00
Wenjun Ruan 5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355) 2023-12-23 22:47:59 +08:00
Wenjun Ruan 43f5f24529
Add dolphinscheduler-extract-common module (#15266) 2023-12-05 21:06:39 +08:00
zhanqian 7bfc6dc3cf
[Bug-15215][Api] non-admin should not modify tenantId and queue (#15254)
* bugfix-15215:Users are not allowed to modify the default tenant and queue through the update API
* fix: #15215
2023-12-04 10:20:34 +08:00
Wenjun Ruan 12f8138167
Expire session when update user password (#15219) 2023-11-26 18:53:44 +08:00
Wenjun Ruan 1d23e4fe5d
Remove spring cache for dao (#15184) 2023-11-24 14:54:05 +08:00
Wenjun Ruan 9c7ad6df0a
[Improvement] Clean up Scheduler logic (#15198)
* Clean up Scheduler logic

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java

Co-authored-by: 旺阳 <wang@lqwang.net>

---------

Co-authored-by: 旺阳 <wang@lqwang.net>
2023-11-24 10:53:23 +08:00
Wenjun Ruan df656a7671
Fix home page workflow instance miss status (#15193) 2023-11-22 10:33:24 +08:00
xiangzihao 7308888c70
fix security issue (#15192) 2023-11-21 11:07:13 +08:00
Wenjun Ruan 9be81be328
Remove API Result in Service (#15181) 2023-11-20 17:04:03 +08:00
旺阳 6aa6e114a5
[Improvement][Alert] Add a test send feature when creating an alert instance (#15163)
* add alert test send feature

* update doc

* add alarm instance test send ui

* update

* fix mvn

* fix test

* update

* update

* change to rpc

* fix ut

* fix ut

* update

* update

* change result

* update

* Update docs/docs/en/guide/alert/alert_plugin_user_guide.md

Co-authored-by: Aaron Wang <wangweirao16@gmail.com>

---------

Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-11-20 10:03:37 +08:00
旺阳 5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992)
* change data quality field name

* fix-dao

* fix-dao

* fix-dao

* fix-dao

* update

* test

* update

* update
2023-11-13 11:04:30 +08:00
Gallardot 8c01fcf14b
[Improvement][K8S] Remove ResourceQuota (#14991)
* [Improvement][K8S] Remove ResourceQuota

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: fix pg

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: Clean up unused code

Signed-off-by: Gallardot <gallardot@apache.org>

* chore: naming conventions

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-11-03 15:18:50 +08:00
Aaron Wang dc503b0e00
[Fix-15072][Resource Center] Non-admin user can not query resource recursively (#15097) 2023-11-02 13:34:30 +08:00
Wei Xiaonan c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism (#14981)
* first commit

* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java

* test case

* frontend: remove unnecessary console

* fix unit test

* remove log depends on user-provided value

* fix dolphinscheduler_postgresql.sql

* sync database schema

* fix unit test

* fix unit test

* fix some NIT.

* extract GLOBAL_ALERT_GROUP_ID into variable

* fix ddl bug

* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema

* add unit test
2023-10-29 20:28:05 +08:00
Wenjun Ruan a5284e4024
Remove mapper usage in tools (#15073) 2023-10-25 22:58:47 +08:00
小可耐 ae847ba331
[Fix-15036] [API] Fix task definition edit doesn't work (#14801)
* [Bug] [task definition] 修复任务定义修改,工作流无法生效问题

* [Bug] [API] Fix task check apply

* [BUG][API] fix updateTaskDefinition method ut

* [BUG][API] fix updateTaskDefinition method code specification

* [BUG][API] fix one task corresponds to multiple workflow problems

* [BUG][API] queryProcessTaskRelationByTaskCodeAndTaskVersion method adjust

* [BUG][API] fix updateTaskDefinition method update

---------

Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-10-25 20:25:02 +08:00
Wenjun Ruan 33084d281f
Add dolphinscheduler-dao-plugin module (#15019) 2023-10-14 17:58:40 +08:00
Kerwin 1f67e68400
Revert "[Bug] [Resource] fix resource delete bug (#15003)" (#15020)
This reverts commit d6a900667a.
2023-10-12 04:28:11 -05:00
liyou d6a900667a
[Bug] [Resource] fix resource delete bug (#15003) 2023-10-12 03:28:23 -05:00
旺阳 8cb765bdcb
[Bug] [Api] Logback file STDOUT duplicate (#14966) 2023-09-26 20:19:43 +08:00
AmriStrong b303648752
[Improvement][Api]Change default zookeeper timeout setting (#14940)
* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* Local running api project connection remote zookeeper always reported connection timeout #14939  Adjust the connection zookeeper timeout time

* reported connection timeout #14939  Adjust the connection  timeout time use the curator default setting

---------

Co-authored-by: AmriStrong <wanggang1@baseus.com>
2023-09-21 15:50:22 +08:00
Aaron Wang 2f2884fd6b
[Fix-14895][API] Keep printing null if task log file not exist (#14912) 2023-09-19 18:29:33 +08:00
Kerwin 4938470d20
[Fix-14907]Fix click to view the history in the task node of the workflow instance (#14909) 2023-09-13 11:17:10 +08:00
calvin a070aa93a7
[Improvement][API] Support to check if the worker group has been used by any tasks or schedulers when users delete or rename it. (#14893) 2023-09-13 10:34:59 +08:00
gaopeng 5062aa12da
[Fix-14811][fix] Fix when using Casdoor SSO, ldap, OAuth2 to log in, the tenant problem of not specifying the currently logged in user (#14812) 2023-09-07 19:56:38 +08:00
Aaron Wang b12df72a0c
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default (#14661) 2023-09-07 14:09:15 +08:00
Wenjun Ruan bc4326125d
Fix session/thread leak at ssh datasource (#14859) 2023-09-07 11:55:31 +08:00
lamberken 11c8e0bdf1
[Improve] Fix placeholders should match arguments in log statement (#14850) 2023-09-06 13:32:26 +08:00
Jay Chung 974d700984
Revert "fix: Local resource error in some entrypoint (#14826)" (#14838)
This reverts commit 9e60632201.
2023-09-05 12:41:04 +08:00
gaopeng adf49fd23f
[Feature-14802][api] Use Casdoor SSO to log in, add admin user configuration (#14814)
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* update doc

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
2023-09-04 13:25:40 +08:00