jffwang
/
hetu-core
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,403 Commits 27 Branches 57 Tags 68 MiB
Commit Graph

88 Commits

Author SHA1 Message Date
NeerajUnnikrishnan 1d6207faba Fix for timestamp semantics 2021-06-07 11:21:38 -04:00
nitin.kashyap 0de42742d7 [I3SI4C] added config for batch size in config 2021-05-28 19:15:20 +05:30
i-robot c6a3412e76 !881 Support Hudi MOR table Snapshot/Read-Optimized queries 
Merge pull request !881 from Maxiaoqi/hudi_mor_support
 2021-05-26 09:35:58 +08:00
NeerajUnnikrishnan 01b224af0c Predicate pushdown for CTE 2021-05-25 03:24:40 -04:00
maxiaoqi2020 e3eb3a6ac6 Support Hudi COW/MOR table Snapshot/Read-Optimized queries 
Update Presto-hive UT tests
 2021-05-24 20:20:41 +08:00
SURYA SUMANTH N d379529ac3 Query Concurrency Code Optimizations 2021-05-23 23:28:45 +05:30
SURYA SUMANTH N d0225487ef URI Special Character Escape Fix 2021-04-08 10:32:02 +05:30
Raghunandan 34b34313b3 [maven-release-plugin] prepare for next development iteration 2021-03-31 11:15:11 +05:30
sandeep aefdec17be 742 [I3C8RG] bugfix in carbondata when task_writer_count is set more than 1 2021-03-20 08:23:10 +05:30
i-robot f9721639d1 !713 Handle CVEs for libraries and carbondata module 
Merge pull request !713 from NeerajUnnikrishnan/fix/cve
 2021-03-18 11:40:12 +08:00
Neerajunnikrishnan 5feccafb74 Handle CVEs for libraries and carbondata module 2021-03-17 19:27:39 +05:30
chenpingzeng cd08c3dbfb upgrade spring-context (used by hetu-hazelcast) version to lastest 
upgrade scala(used by hetu-carbondata/presto-kafka) version to latest of subversion

Signed-off-by: chenpingzeng <chenpingzeng@huawei.com>
 2021-03-16 20:12:30 +08:00
Sandy Gao 4eff6fc753 Snapshot - various other changes 
- Support snapshot in Hive connector (ORC only)
- Update query editor to support new query states
- Update TPC-H and TPC-DS connectors to support rescheduling of splits
 2021-03-15 13:08:23 -04:00
pradeep 34020b5cb0 [I3AS86] unify vacuum throwing staging Exception after manual full Vacuum 2021-03-11 15:06:29 +05:30
sandeep 672b3f679f !652 [I39S0A] synchronize issue & Crabondata UT fix 2021-03-03 12:22:13 +05:30
Vinayakumar B e42eca000d [I27RR5] Skip stats update in Metastore on Vacuum Merge 
Partition column based partitioning for writes & parallel metastore operations using threadpool

Reduce redundant HMS calls

Fixed multiple writers with non-partitioned table

Adding VACUUM FULL MERGE Command

Using bulk APIs to update the partition column statistics

Fixing various issues

Using partition column for partitioning update/delete

Using the local sorting instead of Global orderby

Using threadpool for adding partitions, connecting in round-robin to multiple HMSs.

UT and Fixes for DM Optimzations for Insert Update Delete Vacuum

MERGE name conflict resolved

Skip Stats collection for delete and parallelize commit preparation operations

review comment fixes
 2021-03-01 19:07:46 +05:30
Surya Sumanth cfd6fe41a0 !625 Direct Delete and DM optimizations for Delete 
* Failed UT fixes
* I26UAJ-Provide-option-to-delete-transactional-table-or-partition-directly
 2021-03-01 16:37:28 +08:00
luodan000 e9794f493e add new push down framework and modify existing connector using new push down framework, including dc, Oracle, hana, mysql connector. 
co-author: guojunfei <970763131@qq.com>
co-author: zoujiaotong <zoujiaotong@163.com>
co-author: wuyuye <531938832@qq.com>
 2021-02-25 19:49:40 +08:00
i-robot 35400ef6f5 !521 Add auto catalog configuration for webui dynamic catalog adding 
Merge pull request !521 from Peikun Chen/feature/webui
 2021-01-30 11:02:14 +08:00
Peikun Chen 68e87e0491 Support auto connector config for webui 2021-01-22 15:30:23 +08:00
i-robot 693c198d50 !516 [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog other than hive 
Merge pull request !516 from RajeevRastogi/reuse_unsupported_catalog
 2021-01-05 18:20:59 +08:00
Raghunandan 592b5cbc9d [maven-release-plugin] prepare for next development iteration 2020-12-30 19:16:54 +05:30
rajeevrastogi ddfd0f6408 [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog other than hive 2020-12-30 14:43:15 +05:30
DiagonAlley 1f3693ee4c Merge branch 'master' of gitee.com:openlookeng/hetu-core into hive-metastore-impersonation-product-test 2020-12-18 09:23:49 +08:00
SiddharthJaiswal 7c10653d26 !462 [I29O3L] Adding Copyright information to self developed java files 
* Added copyright information to self developed java files.
 2020-12-17 13:00:30 +08:00
DiagonAlley 4a32ec36b5 Support Hive metastore impersonation 2020-12-17 09:39:39 +08:00
rajeevrastogi 6f4d3f9001 Additional Fixes for ReuseExchange 2020-12-11 19:55:54 +05:30
i-robot 675d233fa6 !388 Auto cleanup UT Not stable 
Merge pull request !388 from sandeep/bugfix-CarbondataAutocleanupUtNotStable
 2020-11-29 21:56:42 +08:00
ZhanLu00 c7a6bb6dbb improve dynamic filtering blocking mechanism 2020-11-26 13:15:11 -05:00
sandeep 684e72e62d 388 [I25VGI] Auto Cleanup UT not stable 2020-11-18 11:02:15 +05:30
sandeep 269f5481ee !155 [I1SSRN] CarbondataAutoVacuum 2020-11-08 15:31:53 +05:30
Aman Omer e6f674d187 Json Injection Fix 2020-10-16 13:45:37 +05:30
i-robot e2b0556180 !308 update or filter module‘s’ components for cves 
Merge pull request !308 from bryanwong/fixed-cves
 2020-09-29 21:50:11 +08:00
bryanwongsz 6e4a4d3712 update or filter component for cves 2020-09-29 16:07:00 +08:00
Aman Omer e7fe14b6df Fix for Insert Overwrite on Non partitioned table 2020-09-29 10:42:59 +05:30
Aman Omer 1f24fb79f0 User group issue fix 2020-09-22 18:36:26 +05:30
Raghunandan a9ca254fb6 Change OpenLooKeng version number to have snapshot 
Change OpenLooKeng version numbers to have correct convention and dependency
 2020-09-23 09:15:10 +05:30
Jiwen 55ca84e741 update the presto-maven-plugin version from 9-SNAPSHOT to 9. 2020-09-22 16:45:30 +08:00
Yize Li 67cf390e0e remove redundent code 2020-09-21 15:11:53 +08:00
Aman Omer 5610f17c71 Put min constraint on Hive property 2020-09-17 17:28:35 +05:30
rajeevrastogi 39794a0e4f pushdown to disable for carbon data storage 2020-09-16 14:56:39 +05:30
sandeep b2c6d812f6 !230 [I1QDJP] fix UnKnownHostException select & vacuum 2020-09-14 13:41:06 +05:30
Aman Omer f0d79dde12 ORC auto cleanup issue fix 2020-09-11 21:45:19 +05:30
NeerajUnnikrishnan 707da0d8b9 [I1PO50] Remove segment when all elements are deleted in the segment 2020-09-09 17:17:15 +05:30
sandeep 466f6b655b !198 [I1U26E] optimization of Auto-cleanup UT 2020-09-09 15:43:02 +05:30
i-robot a39243f0b8 !200 Carbondata create table should be block for partitioned table 
Merge pull request !200 from sandeep/bugfix-blockPartitionTable
 2020-09-09 11:21:05 +08:00
sandeep e98e7a37d6 Carbondata Partition table blocking 2020-09-08 18:56:55 +05:30
i-robot 31e2434fed !124 Fixed filter with char and varchar datatypes for carbondata 
Merge pull request !124 from NeerajUnnikrishnan/fix/filterCharDatatype
 2020-09-07 22:19:01 +08:00
i-robot 51c51a6f8b !193 Added yarn dependencies for Carbondata 
Merge pull request !193 from amanomer/QA-338
 2020-09-04 20:26:49 +08:00
NeerajUnnikrishnan bd09dca954 [I1PGMI] Fixed filter with char and varchar datatypes 2020-09-04 16:59:26 +05:30