bf2cdc5300
Use Druid to split sql ( #15367 )
2024-01-02 12:00:53 +08:00
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
2023-12-23 22:47:59 +08:00
f921457a55
Set maxRows in SqlTask ( #15342 )
...
(cherry picked from commit b6b88e3e62d8245e08408fb60c48d23c0bd0bb46)
2023-12-21 20:51:49 +08:00
71ee1f0c3d
Support parse task output params under multiple log ( #15244 )
2023-12-01 10:16:36 +08:00
99214d0fc3
Fix SqlTask cannot split the given sql when browser in windows ( #15062 )
2023-10-26 19:50:32 +08:00
f6a6794289
[Bug][Worker] Global and local parameters are not replaced in SQL components ( #14926 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
2023-09-15 10:31:14 +08:00
4aab0b234f
Use AdHoc datasource client in sqlTask ( #14631 )
...
* Use AdHoc datasource client in sqlTask
* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
2023-07-26 08:58:50 +08:00
b49b91c45d
[Improvement-14331][common] Remove the duplicate ParameterUtils ( #14332 )
2023-06-14 15:00:54 +08:00
1011852ab2
[Improvement-14195][Parameter] remove misleading comment of combining local and global parameter ( #14196 )
2023-05-26 09:29:09 +08:00
606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql ( #13378 )
...
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .
for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})
after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
2023-05-22 11:19:30 +08:00
34f5b009e1
[Fix 13941]Fix replace time variable ( #13975 )
...
* fix replace time variable
Co-authored-by: <ziheng.zhan@longbridge.sg>
2023-04-21 14:37:52 +08:00
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2023-02-07 20:32:53 +08:00
70ccffeee2
Format task parameter as pretty json ( #13173 )
2022-12-13 16:30:21 +08:00
a2ff140f43
Fix sql task will send alert if we don't choose the send email ( #12984 )
2022-11-24 21:26:52 +08:00
489e7fe4e2
[Feature-10495][Resource Center] Resource Center Refactor ( #12076 )
...
* resource center refactor - S3 services connection
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-10-26 13:53:44 +08:00
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2022-10-23 21:23:54 +08:00
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
c87f6d89a4
[fix#12195] Change date to timestamp to support cross diff time zones ( #12239 )
...
* fix DS support cross time zone, use timestamp replace date
2022-10-01 12:50:42 +08:00
e6832220c3
[Improvement][SQL Task]use default sql segment separator ( #10869 )
2022-09-26 11:08:57 +08:00
9b3b4e22b4
[Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported ( #12059 )
...
* [Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
2022-09-22 09:39:02 +08:00
b3bbf69b2e
[Improvement-11291][sql] Improvement the log output while executing multiple sql statements ( #11292 )
2022-09-20 09:30:27 +08:00
5b384f3fab
[Feature-11473][Task]Support test task ( #11670 )
...
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* Update TaskExecuteThread.java
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update DataSource.java
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages_zh_CN.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages.properties
* Update messages_en_US.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
2022-09-17 13:40:56 +08:00
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2022-09-08 13:41:36 +08:00
1b120e3a59
Refactor worker execute task process ( #11540 )
...
* Refactor worker execute task process
2022-08-26 13:33:51 +08:00
6345a13cdc
[Fix-10392][SqlTask]: Fix list param error when use sql task ( #11285 )
...
* FIX: fix list param in.
* FIX: code bug
* FIX: fix one value
* FIX: header
* FIX: ci
* FIX: fix ci
* MOD: for review
* MOD: for review
2022-08-11 09:24:44 +08:00
8f621ff98b
[Optimization] Calculate global parameter and local parameter at master. ( #10704 )
...
* Global parameter and local parameter calculation external expansion.
* k8s task ut fix.
* TimePlaceholderUtils import DateUtils fix
* follow the review comments to fix.
* follow the review comments to fix.
* e2e rerun
2022-06-30 22:45:25 +08:00
7e7df1d8ff
[Bug] [Task] SQL task no exception stack trace in task log ( #10656 )
2022-06-29 09:57:05 +08:00
da3c25dc67
[improve] Using create or replace function in sql task ( #10170 )
2022-06-06 10:33:24 +08:00
0bf4043d5f
Move datasource params to datasouce plugin module ( #10353 )
...
* Move datasource params to datasouce plugin module
2022-06-03 12:15:53 +08:00
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
2022-05-31 15:22:41 +08:00
df04c4aef0
[fix-9991][worker]fix statement is closed before resultSet.getMetaData() ( #10014 )
2022-05-15 10:24:31 +08:00
0e7c98d465
[Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements ( #9917 )
...
* Support sql segmentation to execute multiple functions.
2022-05-08 15:04:35 +08:00
923f3f38e3
[Fix-9316] [Task] Configure DB2 data source SQL script execution report ResultSet has been closed exception in SQL task ( #9317 )
...
* fix db2 error in the sql task
* update limit in sql task
2022-04-11 13:19:48 +08:00
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
2022-04-07 18:15:19 +08:00
a1bef43981
[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module ( #8584 )
...
* Task plug-in optimization, task-related classes are migrated to the task plugin module
* remove tasktype enum class.
* fix code style.
* fix code style
* fix code style
* fix ProcessServiceTest.testUpdateResourceInfo test class
* fix code style
* fix test task plugin manager check parameters null
* fix test ut
* update aws license
* change TaskTimeoutStrategy class
2022-03-15 15:16:36 +08:00
103ccb01da
change version to 2.0.4-SNAPSHOT ( #8188 )
2022-01-25 15:17:17 +08:00
e4cdd82b7c
[Improvement][TaskLog] Unified task log ( #7831 )
...
* task logger
* update
* log format
* remove master config task-logger
* udpate log level
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-07 21:04:54 +08:00
cc77963522
[FIX-#6727][worker-server] Fix procedure params bug ( #7680 )
...
* fix Procedure param error
* code style
Co-authored-by: wangxj <wangxj31>
2021-12-28 19:19:30 +08:00
0b9792db76
[Refactor]Rename class file, DatasourceUtil to DataSourceUtils. ( #7181 )
...
* Rename class file, DatasourceUtil to DataSourceUtils.
2021-12-07 18:49:05 +08:00
463fc76bb7
[Fix-6809][dolphinscheduler-task-sql] Fix sql task can't send alert ( #7089 )
2021-12-01 14:08:40 +08:00
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
2021-11-10 18:29:17 +08:00
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
2021-11-09 20:20:07 +08:00
9b1984c244
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
2021-10-21 15:23:49 +08:00
09657d8576
[ #6337 ]When the SQL result reaches the limit value, increase the log result prompt ( #6528 )
2021-10-20 14:58:46 +08:00
67508d8d1b
update project version to 2.0.0-SNAPSHOT ( #6383 )
2021-09-28 12:00:43 +08:00
a62a7a7216
[Fix][Task] sql limit param no default value ( #6337 ) ( #6387 )
...
* add default query sql limit
2021-09-28 11:38:22 +08:00
61c6461994
[BUG-6331][WorkerServer] fix preparedStatement auto close by try with resource ( #6334 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
2021-09-24 18:39:04 +08:00
7e8febed4d
[Plugin][Task]Fix Sql Task NPE ( #6290 )
2021-09-22 18:07:29 +08:00
b90152fc2e
[SPI][Task]add SQL Task ( #6237 )
...
Add Sql Task And Fix Task Parse Err
2021-09-17 13:10:44 +08:00
5a12e00cbe
[Feature][Task]Task plugin spi ( #6084 )
2021-09-02 10:08:38 +08:00
Wenjun Ruan