jffwang
/
hetu-core
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,403 Commits 27 Branches 57 Tags 68 MiB
Commit Graph

68 Commits

Author SHA1 Message Date
i-robot 06df7c1c2c !903 Fix for timestamp semantics 
Merge pull request !903 from NeerajUnnikrishnan/timestamp
 2021-06-07 23:46:43 +08:00
NeerajUnnikrishnan 1d6207faba Fix for timestamp semantics 2021-06-07 11:21:38 -04:00
farhan3 2a90ed2e9d Fix bug with Bitmap index + orc_predicate_pushdown_enabled 2021-06-02 17:35:02 -04:00
farhan3 83fa7e341d Move BitmapIndex cursor forward when row group has been filtered out 2021-05-31 11:08:54 -04:00
i-robot 23d7f57b7a !833 Fix for class initialization deadlock in TupleDomainFilter 
Merge pull request !833 from NeerajUnnikrishnan/fix/query_hang
 2021-04-14 18:21:21 +08:00
NeerajUnnikrishnan 044c52140a Fix for class initialization deadlock in TupleDomainFilter 2021-04-14 01:21:13 -04:00
nitin.kashyap 89ffaf3c44 [I3E3LE] matching positions updated for all nulls case 2021-04-14 10:51:02 +05:30
nitin.kashyap 8aae9cf253 [I3E3LE] handle all null rows in longSelective reader 2021-04-01 18:34:25 +05:30
i-robot faaac3549c !799 [I3E3LE] handle all nulls in sliceDictionarySelectiveReader 
Merge pull request !799 from Nitin-Kashyap/defectfix.dictionarySelectiveRead
 2021-03-31 16:05:51 +08:00
Raghunandan 34b34313b3 [maven-release-plugin] prepare for next development iteration 2021-03-31 11:15:11 +05:30
nitin.kashyap ff4ad1520b [I3E3LE] handle all nulls in sliceDictionarySelectiveReader 2021-03-29 17:00:46 +05:30
jiahao 81c93fbd44 add last modified time as part of OrcCacheKey 2021-03-20 17:29:30 -07:00
farhan3 5a6c1a5e4b fix bitmap performance issue when debug logging enabled; add bitmap lookup caching 2021-03-19 17:14:55 -04:00
i-robot 7131053dd0 !734 Improve btree index lookup performance 
Merge pull request !734 from Han_Weng/fix-btree
 2021-03-19 11:41:24 +08:00
Han Weng e3ace5d58b Improve btree index creation and lookup performance 2021-03-18 18:35:06 -04:00
Neerajunnikrishnan 5feccafb74 Handle CVEs for libraries and carbondata module 2021-03-17 19:27:39 +05:30
bryanwongsz 9e049f386a Refactor function metadata manager; 
Support registry external function in connector and implement a example in the mysql jdbc connector;
store external function stored in memory;
Support push external function push down to jdbc connector and add mysql connector example.

Co-Author: bryawongsz <bryanwangsz@163.com>
Co-Author: Yize Li <liyizeyouxiang@live.cn>
Co-Author: chenpingzeng <chenpingzeng@huawei.com>
Co-Author: wyy566 <531938832@qq.com>
 2021-03-13 11:01:59 +08:00
Han Weng 23c14ca518 Fix bitmap issue when the operator in predicate is not supported 2021-02-25 15:16:29 -05:00
luodan000 e9794f493e add new push down framework and modify existing connector using new push down framework, including dc, Oracle, hana, mysql connector. 
co-author: guojunfei <970763131@qq.com>
co-author: zoujiaotong <zoujiaotong@163.com>
co-author: wuyuye <531938832@qq.com>
 2021-02-25 19:49:40 +08:00
Han Weng d41859ebc9 Refactor BTree index, indexFilter and split filtering 2021-02-12 12:55:28 -05:00
nitin.kashyap 446621c51a [I2E4X7] fixed nulls handling in predicate pushdown flow 2021-01-21 12:56:18 +05:30
Han Weng 7a14985885 Add index record cache back, check filesystem time precision and improve performance 2021-01-12 12:09:47 -05:00
Raghunandan 592b5cbc9d [maven-release-plugin] prepare for next development iteration 2020-12-30 19:16:54 +05:30
Han Weng 69c7911b65 Fix hindex QA issues 2020-12-22 17:08:21 -05:00
farhan3 d9e8b7c09f add bitmap index to hindex 2020-11-26 21:18:18 -05:00
farhan3 9ed84036dc Improve heuristic index design for better extensibility 2020-11-25 16:30:25 -05:00
i-robot 4b9d2848e5 !390 Optimize stripe persisting logic to save index writing memory 
Merge pull request !390 from Han_Weng/index-mem-fix
 2020-11-21 04:01:09 +08:00
Han Weng 7bf046f806 Optimize stripe persisting logic to save index writing memory 
- Update ORC Reader flagging to accurately reflect stripe finishing
- Make addData in index writer thread-safe
- Persist stripe index when finished in index writer to save memory used by index creation
 2020-11-20 10:14:46 -05:00
i-robot b413626e80 !330 [I1X8NQ] Performance optimization for the case where IN clause has multiple values (For datatype double, float and decimal). 
Merge pull request !330 from RajeevRastogi/pushdown.otherdtype.in.perf
 2020-11-18 13:07:23 +08:00
i-robot 973b277986 !370 Create/Show/Drop index from server 
Merge pull request !370 from Han_Weng/create-index-han
 2020-11-13 22:38:06 +08:00
tushengxia 1adfd96a45 Support hindex creation and management through operators 
- remove presto-cli's direct dependency on hindex
- add new CreateIndexOperator
    - when a CREATE INDEX statement is received, rewrite the query as a TableScan and use the data from TableScan to create index
    - hindex no longer has a direct dependency on hive packages, it now uses the hive connector
- support index creation at different levels, e.g. file level or partition level
- remove BitmapIndex support, the previous version had issues; a new version will be added later
- add metadata to Pages, currently only enabled for hindex usecase
 2020-11-12 16:03:23 -05:00
nitin.kashyap c0effeb1ab [I23M6L] 1) added filter method for timestamp, which was missing for cached data filtering 
2) also added fix for space in the split file path in case of indexCache:: splitFiltering
3) included varbinarytype in tuple domain filter range generation.
 2020-11-10 09:17:30 +05:30
rajeevrastogi 53ea71beb8 [I1X8NQ]: Optimization of IN clause with multiple values for Float, Double, Decimal datatypes 
Optimization of IN clause with multiple values
 2020-11-04 12:39:18 +05:30
i-robot 1f3f030902 !325 Introduce new Index API - Refactoring and new implementations 
Merge pull request !325 from Han_Weng/index-new-api
 2020-10-15 04:18:30 +08:00
Han Weng de95345f3a Introduce new Index API - Refactoring and new implementations 2020-10-14 15:09:26 -04:00
rajeevrastogi ba553dceb1 Optimization of IN clause with multiple values 2020-09-29 19:40:35 +05:30
Raghunandan a9ca254fb6 Change OpenLooKeng version number to have snapshot 
Change OpenLooKeng version numbers to have correct convention and dependency
 2020-09-23 09:15:10 +05:30
Yize Li 67cf390e0e remove redundent code 2020-09-21 15:11:53 +08:00
i-robot bfa7194a1a !256 [I1VP9O] Fix the bitmap scan with pushdown enabled exception 
Merge pull request !256 from Nitin-Kashyap/bitmap.selectiveScan
 2020-09-17 21:21:33 +08:00
nitin.kashyap 015ddda9e4 [I1VP9O] Fixed positions initialization on rowFiltering using bitmap index within rowGroup 2020-09-17 17:40:11 +05:30
rajeevrastogi 191a12a3ee additional comments for selective read flow 2020-09-17 17:13:57 +05:30
nitin.kashyap 168cd5929d Code review comments fixes 2020-09-15 16:06:10 +05:30
rajeevrastogi 0539e8f843 offset array size issue. 2020-09-15 14:17:02 +05:30
nitin.kashyap 996a4cdaec Fixes for IS NULL Operator OR pushdown issues 2020-09-14 09:48:02 +05:30
Nitin-Kashyap 50cf84159b !222 [I1UTVH] Fix for ORC pushdown with partition and Non-partitioned column in OR predicate. 
* [I1UTVH] OR predicates on partition column doesnot works properly
 2020-09-12 12:26:16 +08:00
rajeevrastogi c85a0864bf Select issue with Alter add support 2020-09-11 13:17:53 +05:30
nitin.kashyap 7b443a7a5d [I1TKNH]Added merge pages in case of TableScanOperator when in page filtering happening within page source 
fix for null matches in pushdown
 2020-09-10 14:46:59 +05:30
i-robot 0c718947ec !201 Fix: Codex Issue 
Merge pull request !201 from RajeevRastogi/security.issue.fix
 2020-09-08 16:55:02 +08:00
rajeevrastogi 55fd37831c Codex issue fix 2020-09-08 13:45:31 +05:30
i-robot d7a0f7465f !131 Graceful handling of coercion for Non-partitioned table. 
Merge pull request !131 from RajeevRastogi/coerce_nonpartitonkeyerror
 2020-09-08 11:13:02 +08:00