Commit Graph

50 Commits

Author SHA1 Message Date
Raghunandan 630bf19d05 [maven-release-plugin] prepare for next development iteration 2022-03-30 09:14:32 +05:30
mahtabahmed 479e1a36a1 support for reload cube 2022-02-18 16:48:32 -05:00
chenyidao1 24113c7444 openlookeng clean_code 2022-02-09 17:33:14 +08:00
zhousipei e2de0da06f Clean code according to the community rule 2022-01-29 11:39:39 +08:00
Raghunandan e1043f02a2 [maven-release-plugin] prepare for next development iteration 2021-12-29 13:20:26 +05:30
Debasatwa Dutta 81163123f6 commit for optimizing the star tree index
fix the isseue with grouping match

added average aggregation column

changes to support avg for group by columns match

added the changes for average

removed the avg changes

average table scan optimization

fix UTs

fix UTs

add UTs

added UTs

fix UTs

added UT

added UTs

changed the UTs

edited UTs

edited UTs

added the session startree false in UTs

changes for group by match prior to cube scan node

avg aggregator source symbol changes

segregated the unit tests

checkstyle fixes

changes for Unit Tests, lineitem table replace the nation table

UTs are divided into smaller methods

added documentation comments for test method

changed the UT tests

changes for group match

updated hetu-docs

edits the create cubes of the UTs

fixes for avg aggregation

fix uts
2021-10-29 21:45:15 -04:00
i-robot a525dc3878 !1195 Added Support for Show Views
Merge pull request !1195 from i-robot/pull113
2021-10-22 08:43:00 +00:00
Debasatwa Dutta e987270b8a Added the fix for case senstivitiy and aggregation function issue
checkstyle fix

fix the average aggregation function issue

added unit tests

unit test fixex

fix for symbol assignments

added ut tests, removed the conditions for checking duplicate symbol in AggregationRewriteWithCube

Added UT

code clean up

changed the UT with table scan aserts

edited the UTs

fixed cube name

removed duplicates

fix UTs

edited UTs

edited UTs

edit UTs
2021-10-20 12:09:29 -04:00
Nikhil Sinha 7ed56e41cb Added Support for Show Views 2021-10-20 12:44:41 +05:30
Raghunandan 3793aa170a [maven-release-plugin] prepare for next development iteration 2021-10-01 13:13:30 +05:30
Lilian Yuan 61ee03600b Update copyright 2021-09-27 14:16:18 -07:00
Ayush Gupta 2679b8a7cc Add support for UPDATE INDEX 2021-07-30 16:44:21 -04:00
Raghunandan ed881ae4f2 [maven-release-plugin] prepare for next development iteration 2021-06-30 11:28:55 +05:30
SURYA SUMANTH N 514fea339b Fix Adding Cluster Name for Refresh Meta Cache 2021-06-25 17:55:45 +05:30
Surya Sumanth 7b3b1ce4d0 !934 [I3VMHP] Support Refresh Meta Cache for specific catalog and Document Update for Refresh Meta Cache SQL support
* Support Refresh Meta Cache for specific catalog and Document Update fo…
2021-06-19 19:58:34 +08:00
SURYA SUMANTH N 6997bfad67 Support for Flushing Metastore cache 2021-06-14 16:06:44 +05:30
Sundar Annamalai d8a35a09f4 Add support for filtering source data when creating cube. 2021-06-08 00:20:09 -04:00
Debasatwa Dutta 3c8aaec9c3 The startree changes for CLI
Hetu cube cli initial commit

Initial commit cube cli changes with memory efficiency changes

comparison expressions changes commit

presto-cli checkstyle changes

commits with expression conversions

commit for query string truncate

changes for literal type

code clean up

delete the presto-cube-cli module added previously.

client options changes

added sqlformatter for create cube query modification

clean up code

Added fallback mechanism and unit tests

Changes include running CLI with parameters

code clean up changes

Code clean up

updated output format

Reverting the server config changes

Code review changes

Code review changes

added hetu-docs description

updated the documentation in star-tree-cube

Code review changes

updated hetu docs

Changes done to the support literals

divided the methods

Added comments

Seprated the classes Console and CubeConsole

Code clean up changes

Added checkstyle changes

changes for single insert query if range is within processing limit
2021-06-01 04:18:45 -04:00
Raghunandan 34b34313b3 [maven-release-plugin] prepare for next development iteration 2021-03-31 11:15:11 +05:30
Sundar Annamalai a22f77bdcc Print user friendly message for CreateCube syntax errors. 2021-03-24 12:11:27 -04:00
chenpingzeng 3e9d1724cd Add support for SHOW FUNCTIONS LIKE pattern
Signed-off-by: chenpingzeng <chenpingzeng@huawei.com>
2021-03-23 10:28:45 +08:00
Sundar Annamalai 8ec9bdffdf Fix for star tree cube incorrect results
1. Block INSERT INTO CUBE if source table has been updated.
2. Block duplicate data insert into the cube
3. Insert entire data from source table into cube
4. Updated hetu docs
2021-03-19 12:03:37 -04:00
bryanwongsz 9e049f386a Refactor function metadata manager;
Support registry external function in connector and implement a example in the mysql jdbc connector;
store external function stored in memory;
Support push external function push down to jdbc connector and add mysql connector example.

Co-Author: bryawongsz <bryanwangsz@163.com>
Co-Author: Yize Li <liyizeyouxiang@live.cn>
Co-Author: chenpingzeng <chenpingzeng@huawei.com>
Co-Author: wyy566 <531938832@qq.com>
2021-03-13 11:01:59 +08:00
pradeep 34020b5cb0 [I3AS86] unify vacuum throwing staging Exception after manual full Vacuum 2021-03-11 15:06:29 +05:30
Sundar Annamalai f7c423cdc5 Add support for star tree cubing 2021-03-09 01:25:29 -05:00
SURYA SUMANTH N 40ad2e90ff Pushdown Non-EQUALs filters as dynamic filters to table scan 2021-03-05 10:10:19 +05:30
Vinayakumar B e42eca000d [I27RR5] Skip stats update in Metastore on Vacuum Merge
Partition column based partitioning for writes & parallel metastore operations using threadpool

Reduce redundant HMS calls

Fixed multiple writers with non-partitioned table

Adding VACUUM FULL MERGE Command

Using bulk APIs to update the partition column statistics

Fixing various issues

Using partition column for partitioning update/delete

Using the local sorting instead of Global orderby

Using threadpool for adding partitions, connecting in round-robin to multiple HMSs.

UT and Fixes for DM Optimzations for Insert Update Delete Vacuum

MERGE name conflict resolved

Skip Stats collection for delete and parallelize commit preparation operations

review comment fixes
2021-03-01 19:07:46 +05:30
luodan000 e9794f493e add new push down framework and modify existing connector using new push down framework, including dc, Oracle, hana, mysql connector.
co-author: guojunfei <970763131@qq.com>
co-author: zoujiaotong <zoujiaotong@163.com>
co-author: wuyuye <531938832@qq.com>
2021-02-25 19:49:40 +08:00
Daniel Zhang 06d5f1f698 Heuristic Index Automated Test 2021-02-09 07:35:05 -05:00
Raghunandan 592b5cbc9d [maven-release-plugin] prepare for next development iteration 2020-12-30 19:16:54 +05:30
tushengxia 67e58bc731 add copyright for index 2020-12-21 16:15:22 +08:00
SiddharthJaiswal 7c10653d26 !462 [I29O3L] Adding Copyright information to self developed java files
* Added copyright information to self developed java files.
2020-12-17 13:00:30 +08:00
i-robot 820d715113 !453 Fix hindex access control issues
Merge pull request !453 from Han_Weng/fix-index-access-control
2020-12-14 22:31:35 +08:00
Han Weng 56cca3c088 Fix heuristic index access control issues 2020-12-11 16:56:47 -05:00
rajeevrastogi da4041e0e5 Reuse exchange Feature (Optimizer rule, Execution etc) 2020-12-11 10:50:55 +05:30
Han Weng dfedbb0526 Allow dropping hindex by partition 2020-11-30 17:00:51 -05:00
karmvs 93661ce35e Adding btree index to Hindex 2020-11-29 21:54:33 -05:00
tushengxia 1adfd96a45 Support hindex creation and management through operators
- remove presto-cli's direct dependency on hindex
- add new CreateIndexOperator
    - when a CREATE INDEX statement is received, rewrite the query as a TableScan and use the data from TableScan to create index
    - hindex no longer has a direct dependency on hive packages, it now uses the hive connector
- support index creation at different levels, e.g. file level or partition level
- remove BitmapIndex support, the previous version had issues; a new version will be added later
- add metadata to Pages, currently only enabled for hindex usecase
2020-11-12 16:03:23 -05:00
Siddharth D Jaiswal 2c45ff5983 [I1OQXH] Added support for Table Pushdown when query has a subquery. Prioritize table stats over user hint for pre condition evaluation. Also added documentation. 2020-10-05 19:08:22 +05:30
Raghunandan a9ca254fb6 Change OpenLooKeng version number to have snapshot
Change OpenLooKeng version numbers to have correct convention and dependency
2020-09-23 09:15:10 +05:30
tushengxia e4f2331c17 update docs and third party copyright 2020-09-22 20:25:44 +08:00
Ayush Gupta e9d4b75cf7 support index commands 2020-09-22 15:20:47 +08:00
Yize Li 7b6a65d647 fix illegal handle for external input 2020-09-04 18:46:00 +08:00
shuaiwang999 0f95e11da8 Add support for using complex predicates in "cache table" sql 2020-08-25 07:28:03 -07:00
i-robot fef8b3117a !79 [I1OL12 ] Add unsupported hive sql statements for sql migration tool
Merge pull request !79 from wangshuai/feature-add_unsupported_hive_statements
2020-08-13 16:36:04 +08:00
i-robot 91c1d83295 !102 [I1MNHT]there are some problems when run openlk-cli on arm platform
Merge pull request !102 from cmwenxin/fixed_cli_arm
2020-08-13 05:02:05 +08:00
wangshuai ee2a81a54b Add unsupported hive statement and Add implicit conversion for between 2020-08-12 15:12:39 +08:00
cmwenxin ee4d65e5ac fixed cli can't run on arm 2020-07-25 18:01:41 +08:00
giteezhangjingfang da28e42453 fix fossbot scan issues 2020-07-16 10:27:51 +08:00
fbird2020 4769cbf5c6 openLooKeng first commit 2020-06-29 21:49:10 +08:00