Commit Graph

33 Commits

Author SHA1 Message Date
Debasatwa Dutta 6086ea367c This commit fixes issues of simultaneous drop cube or table and create cube and right literal exclusion for not equal operator
fix the issue if any query fails in between

fix for not equal operator

code clean up

code clean up

code clean up
2021-08-18 17:29:56 -04:00
Debasatwa Dutta 9a32c353eb fix for directly execute the query with --execute parameter and varchar datatype with comparison operator
removed un-intended change

Fix for multiple queries in --execute parameter and cli direct execute through --execute

code clean up

Checkstyle fixes

Fix for varchar datatype with comparison operator
2021-08-12 05:07:33 -04:00
Debasatwa Dutta e7164fc0a2 These commits fixes two issues related to star tree cube.
Fixes the issue with int type

Resolved the data mismatch issue, due to improperly inserted rows

Fix cube insert overwrite issue

simplified the code
2021-07-30 21:41:13 -04:00
Debasatwa Dutta f155ddb930 varchar data type issue fixed, code clean up
code clean up and fixed varchar issue

Increased the single batch process size to default 50M
2021-07-14 17:08:40 -04:00
Debasatwa Dutta a393cc0a0f Extended data types support changes
Rebased the master branch

Extended data type support changes missed in rebase

roll back of create cube if there are any failures

Code Review Changes

Code Review changes

Code Review changes

Code Clean up

The changes for row buffer flush

Code clean up changes

Code clean up

Fix the issues related to create cube

fix if the full qualified name is not mentioned in the create cube query

corrected the max buffered rows size
2021-07-05 18:31:09 -04:00
i-robot c0e5cab002 !984 Fix for roll back of create cube if there are any failures
Merge pull request !984 from Debasatwa/fix-drop-cube-for-fails
2021-06-24 20:22:06 +00:00
Debasatwa Dutta 7a19a5dd44 Fix for roll back of create cube if there are any failures
Code clean up

Code clean up

Code clean up
2021-06-24 12:24:03 -04:00
i-robot e1c6b8b5cb !973 Fix the create cube fail issue
Merge pull request !973 from Debasatwa/fix-create-cube-fail-issue
2021-06-24 00:14:38 +00:00
Debasatwa Dutta 0ba221723f Fix the create cube fail issue, fix stop running insert queries after create cube failure 2021-06-23 17:52:12 -04:00
i-robot e5436499ed !972 StarTree - Fix the equal operator issue in the comparison expression
Merge pull request !972 from Debasatwa/equal-comparision-expression-fix
2021-06-23 21:41:23 +00:00
Debasatwa Dutta 2c44036e82 issue fix for equal comparison expression
Code clean up changes
2021-06-23 16:55:15 -04:00
Sundar Annamalai d8a35a09f4 Add support for filtering source data when creating cube. 2021-06-08 00:20:09 -04:00
Debasatwa Dutta 3c8aaec9c3 The startree changes for CLI
Hetu cube cli initial commit

Initial commit cube cli changes with memory efficiency changes

comparison expressions changes commit

presto-cli checkstyle changes

commits with expression conversions

commit for query string truncate

changes for literal type

code clean up

delete the presto-cube-cli module added previously.

client options changes

added sqlformatter for create cube query modification

clean up code

Added fallback mechanism and unit tests

Changes include running CLI with parameters

code clean up changes

Code clean up

updated output format

Reverting the server config changes

Code review changes

Code review changes

added hetu-docs description

updated the documentation in star-tree-cube

Code review changes

updated hetu docs

Changes done to the support literals

divided the methods

Added comments

Seprated the classes Console and CubeConsole

Code clean up changes

Added checkstyle changes

changes for single insert query if range is within processing limit
2021-06-01 04:18:45 -04:00
Peikun Chen 5c29c787b8 Add user-mapping 2021-02-27 14:18:49 +08:00
tushengxia 1adfd96a45 Support hindex creation and management through operators
- remove presto-cli's direct dependency on hindex
- add new CreateIndexOperator
    - when a CREATE INDEX statement is received, rewrite the query as a TableScan and use the data from TableScan to create index
    - hindex no longer has a direct dependency on hive packages, it now uses the hive connector
- support index creation at different levels, e.g. file level or partition level
- remove BitmapIndex support, the previous version had issues; a new version will be added later
- add metadata to Pages, currently only enabled for hindex usecase
2020-11-12 16:03:23 -05:00
Han Weng ec8ea30f70 Improve index record to cache entries and pre-screen indices to load 2020-10-22 20:54:20 -04:00
hweng 59e4991476 Update parallel index creation logic, improve index exception handling, tmp dump cleaning and cross-platform security path support 2020-10-19 22:00:15 -04:00
Han Weng de95345f3a Introduce new Index API - Refactoring and new implementations 2020-10-14 15:09:26 -04:00
Han Weng a983dd5f19 Fix CLI index partition issue 2020-09-25 16:08:19 -04:00
Han Weng 139d9e1c44 Merge branch 'index-fix-han' of https://gitee.com/farhan3/hetu-core into index-fix-han 2020-09-24 18:20:53 -04:00
Han Weng acbdda48a7 Update cli jar docs 2020-09-24 18:19:24 -04:00
farhan3 f3fa974b35 Revert "remove executable from hetu-cli jar name"
This reverts commit 041c57306c.
2020-09-24 18:08:36 -04:00
farhan3 041c57306c remove executable from hetu-cli jar name 2020-09-24 17:09:46 -04:00
farhan3 3466532fa1 improve failure msg 2020-09-24 16:49:34 -04:00
farhan3 5969268638 fix create index when no WHERE predicate provided, add support for -f file.sql, fix index types in hive's IndexCache 2020-09-24 16:42:43 -04:00
Han Weng 057bad8416 Add cli access control 2020-09-24 15:43:59 -04:00
farhan3 654c056e37 hindex cli bug fixes and improvements:
- cli crashing on hindex exception
- progress bar invalid range
- use case insensitive names in hindex
- validate hindex create index WHERE expression
- use catalog and schema from session to form fqtn
- docs and cli help improvements
2020-09-24 13:58:23 +08:00
Ayush Gupta e9d4b75cf7 support index commands 2020-09-22 15:20:47 +08:00
Yize Li 67cf390e0e remove redundent code 2020-09-21 15:11:53 +08:00
Raghunandan 9e5b4a5286 [I1QHQE]Upgrade 3rd party dependencies to handle CVEs 2020-08-24 12:00:16 +05:30
cmwenxin 4f81ad3fe5 hetu-sql-migration modules is upgraded jline to 3.12 2020-07-28 14:14:12 +08:00
cmwenxin ee4d65e5ac fixed cli can't run on arm 2020-07-25 18:01:41 +08:00
fbird2020 4769cbf5c6 openLooKeng first commit 2020-06-29 21:49:10 +08:00