Commit Graph

7639 Commits

Author SHA1 Message Date
shenyun 8fa90c2d8f
feature flinksql support standalone deploy mode (#13495) 2023-02-05 20:37:56 +08:00
旺阳 0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
dddyszy 19ffd64e23
Fix complement data date order will change due to use set (#13487) 2023-02-03 19:44:45 +08:00
Wenjun Ruan 5a9cb7ee64
Fix task log might delay until task finished due to batch flush (#13502) 2023-02-02 21:48:03 +08:00
yangyang zhong 615b1dbb37
[bug][UI]Fixed a bug where the environment name of a task could not be changed when a workflow was created(issue-12457) (#13148) 2023-02-02 14:53:21 +08:00
Stalary b9ef4a7177
FIX: qrtz table use uppercase (#13494)
* FIX: use uppercase
2023-02-02 11:25:27 +08:00
Wenjun Ruan 6300a9b8de
Fix serial wait will go into block when there is no task need to submit (#13486) 2023-02-02 11:10:37 +08:00
Stalary 5fb6035f0d
fix: 3.1.1_schema mysql ddl sql error (#13485) 2023-02-01 21:11:05 +08:00
Wenjun Ruan b11431db95
Use single thread to refresh kerberos (#13456) 2023-02-01 20:41:05 +08:00
Wenjun Ruan af9091a98a
Use convert to set the exist column collate to utf8_bin (#13479) 2023-02-01 18:40:18 +08:00
Wenjun Ruan 12dd60fa46
Fix task wake up failed will block the event (#13466) 2023-02-01 15:31:04 +08:00
Wenjun Ruan d10eaa8d81
Change mysql COLLATE to utf8_bin (#13469) 2023-02-01 14:08:31 +08:00
Rick Cheng 80da35e39c
[Fix-12828][api] Add permission check when query specific datasource (#12830) 2023-02-01 10:41:05 +08:00
Jay Chung 78e5569afd
[feat] Add type local turn on resource center by default (#13303) 2023-01-31 17:39:20 +08:00
Tq 78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
imizao 23c7363f64
[Refactor][UI]Add a back button when viewing an error file (#13354)
Co-authored-by: imizao <lai.jinwen@vpclub.cn>
2023-01-30 10:06:56 +08:00
Aaron Wang 802bf4a2e0
[Fix-13418][UI] Remove move-task-definition code (#13441)
* remove move task definition

* remove unused DragOutlined
2023-01-30 10:01:59 +08:00
Eric Gao 385d781ebc
Fix minor spelling and punctuation errors (#13452) 2023-01-29 16:51:03 +08:00
Wenjun Ruan ce34e21960
Task instance failure when worker group doesn't exist (#13448) 2023-01-29 16:27:56 +08:00
Wenjun Ruan 45694aa697
Fix MessageSender may be null due to class initialize late (#13446) 2023-01-28 20:53:32 +08:00
Wenjun Ruan ef47e7efeb
Use parallelStream to improve the performance of upgrade (#13442) 2023-01-23 13:59:20 +08:00
Wenjun Ruan 713fdbc444
Split the upgrade code (#13436)
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2023-01-20 20:48:07 +08:00
jackfanwan 3b54de0c90
fix when the task details are not modified, the predecessor node cannot be modified (#13422)
* fix when the task details are not modified, the predecessor node cannot be modified

* deleted useless code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-01-18 20:08:28 +08:00
qianli2022 8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId (#13184)
* add sql

* add mapper

* add dao

* add excutor


Co-authored-by: qianl4 <qianl4@cicso.com>
2023-01-18 17:58:32 +08:00
Tq 3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379)
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
2023-01-16 16:21:26 +08:00
Wenjun Ruan 01f4fb26f0
Change remove task instance log to async request (#13399) 2023-01-16 15:49:23 +08:00
jackfanwan 8439b5dc69
[fix-12721] Fix cannot modify the upstream task in task definition page. (#12722) 2023-01-15 19:58:47 +08:00
kezhenxu94 a843e0b96d
Add documentation to release Helm Chart (#13385) 2023-01-15 10:10:31 +08:00
Wenjun Ruan 483330273d
Remove entity in QueryWrapper constructor (#13396) 2023-01-14 20:57:03 +08:00
v-wx-v e39bf59b4b
[fix][data quality] fix when running data quality task with Error "No main class set in JAR" (#13360) 2023-01-14 14:50:50 +08:00
Eric Gao 366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367)
* Add keda autoscaler support for worker deployment when deployed in K8S cluster

* Add mysql scaler for worker autoscaling

* Add docs for worker autoscaler

* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
Wenjun Ruan e660f7fc2d
Use spotless upToDateChecking (#13394) 2023-01-13 21:59:05 +08:00
Wenjun Ruan 98dfd64444
Clear the task group data when delete a project/workflowInstance (#13383) 2023-01-12 21:51:51 +08:00
LiXuemin a5c6748202
[doc] Remove excess space (#13388)
Remove excess space,from `127.0. 0.1` to `127.0.0.1`
2023-01-12 18:42:15 +08:00
v-wx-v 3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163)
* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [improvement][install.sh] fix the install Error "Command not found rmr" &  support ZooKeeper (3.4.6+)
* update known-dependencies.txt

* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt

Co-authored-by: wangxx <wangxx@kcwl.com>
2023-01-12 18:07:58 +08:00
Eric Gao dd0d73036e
Fix minio version in helm chart (#13368) 2023-01-11 00:40:17 +08:00
Kerwin 22958682c4
add 3.1.3 release (#13357) 2023-01-10 17:17:51 +08:00
Donald Yang 8f7b141fe7
[Fix-13287][doc]Fix Chinese workflow-definition.md duplication description in execution-type (#13361) 2023-01-10 11:33:42 +08:00
calvin 4f73fe1bd8
fix this issue with missing a comma in the TaskInstanceMapper.xml (#13359) 2023-01-09 14:43:34 +08:00
tog 2a44a7f36a
rename: WorkflowDefinitionTree component rename (#13134) 2023-01-08 20:42:21 +08:00
imizao 1edee6224c
[fix][UI]Add render to projects-overview table (#13305)
Co-authored-by: Jinwen Lai <lai.jinwen@vpclub.cn>
2023-01-07 22:56:54 +08:00
fuchanghai 7027d3d768
[improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList``` (#13057)
* [improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList```

* [improve-#13053] format

* [improve-#13053] fix UT

* Update Status.java

update description

* [improve-#13053] add parameter ```version ```

* [improve-#13053] format

* [improve-#13053] version is not necessary

* [improve-#13053] format

* Update use-form.ts

change  ```version``` default vaule to ``` null```

* [improve-#13053] format

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* Update ExecutorServiceImpl.java

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-01-07 20:49:59 +08:00
LucasClt a1f5675012
[Bug][TaskPlugin] Task execution error occurs when the Zeppelin task zeppelinNoteId parameter value is an empty string (#13162)
* [Bug] [TaskPlugin-Zeppelin] Task execution error occurs when the Zeppelin task zeppelinNoteId parameter value is an empty string. #13161
2023-01-06 19:29:05 +08:00
caishunfeng ba0a253f09
fix k8s task run fail (#13348) 2023-01-06 09:44:12 +08:00
calvin 313ba4444f
[Fix-13341][Improvement][UI] Worked out the issue with the long name overflowing on the table. (#13342) 2023-01-05 14:40:45 +08:00
Kerwin fde2c8073e
Fix that when the timing data is not configured with environmental information, the timing management does not display the data. (#13339) 2023-01-05 12:15:02 +08:00
Wenjun Ruan a074f7e2e6
Delete workflow will delete workflow instance (#13336) 2023-01-04 22:22:03 +08:00
Wenjun Ruan 6634ff98af
Add source env list in common.properties (#13317) 2023-01-04 20:53:52 +08:00
lenian bcf03ad4d1
[Feature-9467] add DAMENG DataSource (#12860)
* [Feature-9467][DataSource] add DAMENG (达梦) data source

* [Feature-9467] add DM datasource doc (Issue #9467)

* [Feature-9467] add DM IDataBaseOptionKeys

* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method

* [Feature-9467] modification package dm to dameng;

* [Feature-9467] add Dameng DmJdbcDriver18 License

* [Feature-9467] add DM DataSource: remove DruidDataSourceClient

Co-authored-by: lenian <yuenian@mananacare.com>
2023-01-04 15:00:24 +08:00
hokie-chan 3b980cb06a
[fix][worker][bug] master/worker crash when registry recover from SUSPENDED to RECONNECTED (#13328) 2023-01-03 19:24:11 +08:00