natas_hw
/
dolphinscheduler0701
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,054 Commits 28 Branches 59 Tags 445 MiB
Commit Graph

90 Commits

Author SHA1 Message Date
Jay Chung f64b254809 [maven-release-plugin] prepare release 3.2.0 2023-10-11 16:59:08 +08:00
Wenjun Ruan 121bb3d854 Fix session/thread leak at ssh datasource (#14859) 
(cherry picked from commit bc4326125d)
 2023-10-11 15:41:52 +08:00
Wenjun Ruan 92146ddc2d Support get property from env/jvm/common.properties (#14645) 
(cherry picked from commit 9ce8871158)
 2023-08-30 17:01:06 +08:00
Wenjun Ruan 5f48b01591 Use AdHoc datasource client in sqlTask (#14631) 
* Use AdHoc datasource client in sqlTask

* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient

(cherry picked from commit 4aab0b234f)
 2023-08-30 16:59:38 +08:00
Wenjun Ruan e13466b343 Revert "datasource test and sql task Remove connection pool issues is #14179 (#14193)" (#14626) 
This reverts commit e4fb5b30a4.

(cherry picked from commit 6617e3fb72)
 2023-08-30 13:59:27 +08:00
xuhui1231 24857751ed datasource test and sql task Remove connection pool issues is #14179 (#14193) 
* datasource test and sql task Remove connection pool issues is #14179

* datasource test and sql task Remove connection pool issues is #14179 uniform style

* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720

* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720

---------

Co-authored-by: xuhui <xuhui@3h1china.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
(cherry picked from commit e4fb5b30a4)
 2023-08-30 13:58:22 +08:00
Xinxing b6313e1cc7 [Feature] doris add datasource (#14391) 
* Added doris data source plug-in

* Update DbType.java

* XML configuration

* doc and ui

* Missing catch of NumberFormatException

* code format

---------

Co-authored-by: xiangzihao <460888207@qq.com>
(cherry picked from commit 1d0d85b988)
 2023-08-30 13:54:25 +08:00
Rick Cheng 01a2f734c2 [Improvement-14457][UT] Improve the expected and actual value of Assertions (#14459) 
(cherry picked from commit 68a3a75211)
 2023-07-20 11:26:43 +08:00
IT-Kwj b0a7e15e3e [Feature-14404][datasource-plugin] add HANA datasource (#14404) 
---------

Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
(cherry picked from commit 7a24be0672)
 2023-07-20 11:24:09 +08:00
Jay Chung 5b84de8b33 revert: Datasource need test binding to create prod (#14381) 
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible

related to https://github.com/apache/dolphinscheduler/pull/11670

(cherry picked from commit 221df4a278)
 2023-07-20 11:23:45 +08:00
Zinway cd486aa652 feat: Introduce new datasource vertica (#14232) 
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
(cherry picked from commit 18d176c5f4)
 2023-07-20 09:53:20 +08:00
He Zhao f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729) 
---------

Co-authored-by: weitong <weitong@cisco.com>
 2023-05-06 19:30:50 +08:00
Jeremy db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin (#13866) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-04-24 21:28:14 +08:00
AliceXiaoLu dcf0109db3
【Bug】 OracleSouce edited again, ConnectionType is null (#13881) 2023-04-19 15:57:29 +08:00
He Zhao c0126b7f30
[Feature][plugin] Support Kyuubi datasource (#13642) 
---------

Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
 2023-04-18 11:12:39 +08:00
JieguangZhou 273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin (#13801) 2023-03-30 20:17:28 +08:00
AliceXiaoLu ad7ce2db56
fix: DB2 username can not be save (#13764) 
db2's jdbcUrl should be like this "jdbc:db2://localhost:50000/sample:currentSchema=DB2INST1;characterEncoding=UTF-8;".should be ":"
 2023-03-30 18:59:21 +08:00
Jrebel-i 3630b00c9f
Fix Bug [Athena Datasource] datasource other params illegal (#13032) 2023-03-30 16:15:29 +08:00
He Wang 35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-03-07 10:12:58 +08:00
seedscoder 8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
Wenjun Ruan b11431db95
Use single thread to refresh kerberos (#13456) 2023-02-01 20:41:05 +08:00
Tq 3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379) 
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
 2023-01-16 16:21:26 +08:00
lenian bcf03ad4d1
[Feature-9467] add DAMENG DataSource (#12860) 
* [Feature-9467][DataSource] add DAMENG （达梦） data source

* [Feature-9467] add DM datasource doc (Issue #9467)

* [Feature-9467] add DM IDataBaseOptionKeys

* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method

* [Feature-9467] modification package dm to dameng;

* [Feature-9467] add Dameng DmJdbcDriver18 License

* [Feature-9467] add DM DataSource: remove DruidDataSourceClient

Co-authored-by: lenian <yuenian@mananacare.com>
 2023-01-04 15:00:24 +08:00
Wenjun Ruan 14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00
Wenjun Ruan b2336b0ce9
Remove datasource in procedure task (#13198) 2022-12-19 17:14:59 +08:00
Tq f0dd4f081f
[Feature][task-plugins-12820] azure azure-sql datasource plugins (#13209) 
* submit azure sql code

* change mssql-jdbc version

* merge changes to delete other

* merge changes to delete other

* add dependencies
 2022-12-19 10:27:03 +08:00
Wenjun Ruan 5c75d312fa
Add StarRocks datasource (#13204) 2022-12-17 08:44:39 +08:00
Wenjun Ruan ab96a3d0c0
Fix datasource jdbc url param doesn't work (#13098) 2022-12-12 11:46:40 +08:00
insist777 b40c63f02d
[Feature][DataSource]Add trino datasource plugin (#12911) 2022-11-23 10:09:02 +08:00
simsicon 43d69ae157
Upgrade clickhouse jdbc driver (#12639) 2022-11-11 13:38:58 +08:00
caishunfeng dedff70f90
[Improvement] Merge spi.utils into common.utils (#12502) 
* improve JSONUtil

* merge spi.utils into common.utils

* split constants && remove some copy utils method

* remove StringUtils
 2022-10-23 21:23:54 +08:00
Eric Gao d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports (#12412) 
* Fix remaining style errors and wildcard imports

* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link

* Fix spotless matching scope of markdown files
 2022-10-19 11:08:04 +08:00
Eric Gao 2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311) 
* move mockito dependencies from sub-modules to root pom

* Add check in CI to block the usage of powermock
 2022-10-14 12:06:51 +08:00
Eric Gao ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352) 
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules

* Fix etcd registry test
 2022-10-14 08:08:20 +08:00
kezhenxu94 db1d319159
Reorganize some classes in common module, remove duplicate classes (#12321) 2022-10-13 10:23:27 +08:00
rickchengx 05099bd8f7
[Improvement-12296][Test] Close static mock (#12300) 2022-10-11 16:13:05 +08:00
Wenjun Ruan 0a44107bf9
Fix hive datasource connection leak (#12226) 2022-10-01 06:57:12 +08:00
Eric Gao 585efe3ad5
[Improvement][Test] Remove the usage of powermock in datasource-plugin module (#12194) 
* Remove the usage of powermock in datasource-plugin module

* Switch datasource-plugin module to use PropertyUtils in common module
 2022-09-30 17:38:24 +08:00
Tq cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts (#12126) 
* fix htrace dependency conflicts

* replace htrace-core with hbase-noop-htrace
 2022-09-26 13:49:08 +08:00
insist777 5b384f3fab
[Feature-11473][Task]Support test task (#11670) 
* [improve] support test tasks

* [improve] support test tasks

* [improve] support test tasks

* [improve] support test tasks

* [improve] support test tasks

* Update TaskExecuteThread.java

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* try solve e2e q

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* Update DataSource.java

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* Update messages_zh_CN.properties

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* Update messages.properties

* Update messages_en_US.properties

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks

* [Feature] support test tasks
 2022-09-17 13:40:56 +08:00
sgw 1a7c6eabf3
[Improvement-11773][api] Optimize the log printing of the api module according… (#11782) 
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Resolve conflict.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- fix ProcessDefinitionServiceImpl.java dependency

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Accept proposed change in ResourcePermissionCheckServiceImpl.java

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Update the UT case in TenantServiceTest.java, UsersServiceTest.java, TaskGroupServiceTest.java.
- Update log printing in TaskGroupServiceImpl.java.
- Fix NPE of log parameter in ExecutorServiceImpl.java when call python api.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix NPE of log in WorkerGroupServiceImpl.java.
- Fix log parameter missing bug in ResourcesServiceImpl.java.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix bugs and handle some vulnerability codes.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix bugs and handle some vulnerability codes.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix e2e User test.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix codeQL check & SonarCloud Code Analysis.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Resolve import conflict.

* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix codeQL check & SonarCloud Code Analysis.
 2022-09-17 11:28:04 +08:00
kezhenxu94 5811b84fcc
Add validations of possible malicious keys (#11966) 2022-09-16 13:32:59 +08:00
ZhaoGuodong 86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) 2022-09-16 09:59:20 +08:00
caishunfeng 2e61c76c22
[Improvement] Add remote task model (#11767) 2022-09-08 13:41:36 +08:00
Kengo Seki 444c7e6eb7
[Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810) 
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
 2022-09-07 13:48:09 +08:00
fuchanghai 554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. (#11697) 2022-09-05 09:15:58 +08:00
Wenjun Ruan b96d69701a
[Improvement-#11613] Add spi priority factory (#11614) 
* Add spi priority factory

* Add doc

* Add override log

* Use lombok

* Add comment
 2022-08-24 19:51:47 +08:00
Wenjun Ruan 71cf7e1baa
[Fix-10918] Close datasource when expire from guava cache (#11120) 
* Close datasource when expire from guava cache
* Remove duplicate datasource in HiveDataSourceClient
 2022-07-23 20:43:37 +08:00
xiangzihao 5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
Wenjun Ruan 5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version (#11025) 2022-07-20 10:37:31 +08:00