natas_hw
/
dolphinscheduler
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,221 Commits 27 Branches 54 Tags 416 MiB
Commit Graph

30 Commits

Author SHA1 Message Date
Jay Chung 8a4f111fd4 [maven-release-plugin] prepare release 3.2.1 2024-02-07 11:09:56 +08:00
Jay Chung d5c543f467
Revert some incompatible change for 3.2.1 (#15580) 
* Revert "Fix k8sTaskExecutionContext setting configYaml (#15116)"

This reverts commit ce11674668.

* Revert "[Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977)"

This reverts commit c532fea00e.
 2024-02-07 10:41:04 +08:00
Jay Chung 7a1be3f329 [maven-release-plugin] prepare for next development iteration 2024-02-07 00:15:26 +08:00
Jay Chung ba5ec7375c [maven-release-plugin] prepare release 3.2.1 2024-02-07 00:15:25 +08:00
Jay Chung c2ff260c1a fix: Resource relate path invalid when tenant change (#15581) 
* fix can not get correct resource related path when
  user run workflow with differnet tenant of resource
  created
* also fix can not get correct related path when we
  use `resource.storage.type=LOCAL`

(cherry picked from commit bd83631955)
 2024-02-06 23:57:28 +08:00
Wenjun Ruan a76b4662be Fix createFile with permission will not work (#15556) 
(cherry picked from commit 4d15932ede)
 2024-02-06 18:22:47 +08:00
Jay Chung 898b001608
cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 
* Reduce the size of tarball to continue ASF release

for more detail you can see https://lists.apache.org/thread/rmp7fghlj0n7h9y2v3p8gkw9f9qbo6qt
 2024-02-06 18:15:57 +08:00
Wenjun Ruan 5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355) 2023-12-23 22:47:59 +08:00
Aaron Wang b12df72a0c
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default (#14661) 2023-09-07 14:09:15 +08:00
Luke Yan 6e5870d711
[DS-14830][dolphinscheduler-storage-s3] Allow customization of s3 regions (#14831) 
Replace `Regions. fromName (region). getName() ` with the `region ` variable

Co-authored-by: xiangzihao <460888207@qq.com>
 2023-08-31 17:53:30 +08:00
Edison Catto 25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS (#14643) 
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center

* add license and add doc

* add 3-party dependency license

* Update LICENSE

* fix

* Update pom.xml

* fix

* fix

---------

Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
 2023-08-14 13:25:48 +08:00
Aaron Wang 2314b67870
[Fix-14715] [Resource Center] Modify default fs of local storage plugin (#14716) 
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-08-10 19:15:09 +08:00
Wenjun Ruan 9ce8871158
Support get property from env/jvm/common.properties (#14645) 2023-07-28 14:41:58 +08:00
zhangkuantian 6f90156577
oss avoid listBuckets permission in bucket check (#14414) 
---------

Co-authored-by: kuantian.zhang <kuantian.zhang@inceptio.ai>
 2023-06-28 14:21:17 +08:00
Aaron Wang bcd1df19b8
[Improvement-14393][Resource Center] Remove deprecated resource description in api and UI page (#14394) 2023-06-28 14:13:20 +08:00
Rick Cheng 4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082) 2023-06-12 12:05:49 +08:00
Zzih 43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() (#14188) 
* optimize checkBucketNameExists

* fix code style

---------

Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
 2023-05-24 13:43:44 +08:00
Rick Cheng 428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
Aaron Wang 74ed7856bc
[Bug-14105][Task] Replace default tenant when downloading resource (#14106) 2023-05-16 18:11:58 +08:00
Aaron Wang 1e3ae7b942
[improv][Resource Center] Implement getResourceFileName in StorageOperator (#14097) 2023-05-15 14:02:30 +08:00
liyou f269ccbd4a
[Fix-13989] Fix resource center path validation (#14021) 2023-05-06 16:59:29 +08:00
zhaifengbing 3305d6d127
[Improvement-13804] Optimal HDFS configuration acquisition (#13804) (#13811) 
defaultFS key from FS_DEFAULT_FS to HDFS_DEFAULT_FS
 2023-04-20 14:24:22 +08:00
Aaron Wang 4bf097ee40
[Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath (#13848) 
* [Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath

* remove semicolon

* set null in some specific scenario

* remove useless console.log
 2023-04-17 11:56:42 +08:00
Rick Cheng 2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Rick Cheng 0db916473e
[Improvement-13437][UT] Add UT for S3StorageOperator (#13530) 2023-02-22 19:57:18 +08:00
Aaron Wang 966201af86
[BUG][Resource Center] NPE caused by uninitialized hdfsProperties (#13540) 
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties

* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
 2023-02-11 13:12:44 +08:00
seedscoder 8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
Rick Cheng 8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
Jay Chung 78e5569afd
[feat] Add type local turn on resource center by default (#13303) 2023-01-31 17:39:20 +08:00
Wenjun Ruan 14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00