jffwang
/
hetu-core
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
2,146 Commits 27 Branches 57 Tags 68 MiB
Commit Graph

62 Commits

Author SHA1 Message Date
Sundar Annamalai 158b6fc355 Fail INSERT OVERWRITE on partitioned cubes. 2021-12-22 13:38:09 -05:00
Sundar Annamalai 41502fc40d Parse CREATE CUBE where clause properly and extract quoted value. 2021-12-21 16:02:55 -05:00
Sundar Annamalai 9f13593c0e Use correct catalog to retrieve datatype of the predicate column while creating cube. 2021-12-10 16:53:50 -05:00
i-robot b27aa53e27 !1259 StarTree Cube: Cube Creation Processing Type Identifier Case Sensitive Adjustment 
Merge pull request !1259 from Daniel Zhang/cube-type-adjust
 2021-12-01 20:40:06 +00:00
i-robot 0edd69ecc1 !1257 Spill Prefetch Read and Prioritizing Larger splits in Memory Revoke 
Merge pull request !1257 from i-robot/pull158
 2021-12-01 10:42:06 +00:00
Daniel Zhang db01dcbf88 StarTree Cube: Cube Creation Processing Type Identifier Case Sensitive Adjustment 2021-11-30 16:05:34 -05:00
SURYA SUMANTH N b26b7b1d9f Spill Prefetch and Prioritize Larger Splits 2021-11-30 19:50:59 +05:30
i-robot c96aa28292 !1239 [124] [I3BXGG] Output is not same as hive when data contains '\0' 
Merge pull request !1239 from i-robot/pull123
 2021-11-30 05:14:05 +00:00
Nitin Kashyap f16d1e49e2
[157] Spiller serialization optimizations 2021-11-27 16:44:43 +05:30
Aman Omer b3db79791f [I3BXGG] Output is not same as hive when data contains '\0' 2021-11-26 16:00:51 +05:30
Aman Omer 2f9e2b54f6 I3YM5D The execution time printed from CLI is not correct 2021-11-15 16:22:02 +05:30
Raghunandan 3793aa170a [maven-release-plugin] prepare for next development iteration 2021-10-01 13:13:30 +05:30
chenpingzeng 5aff66ef61 [fix] fix sql injection risk for cube console in presto-cli 
Signed-off-by: chenpingzeng <chenpingzeng@huawei.com>
 2021-09-30 17:26:59 +08:00
i-robot 28ab297ac5 !1141 two SQL injection risk for cube console in cli module 
Merge pull request !1141 from chenpingzeng/cli_cube_sql_inject
 2021-09-29 13:11:49 +00:00
chenpingzeng f7297deab9 [fix] sql injection risk for cube console in CLI 
Signed-off-by: chenpingzeng <chenpingzeng@huawei.com>
 2021-09-29 16:54:48 +08:00
Debasatwa Dutta 74b4a40557 license header fix 2021-09-28 15:25:51 -04:00
i-robot de874d8e76 !1127 Update copyright 
Merge pull request !1127 from lilianyuan_c78e/master
 2021-09-28 07:37:50 +00:00
Lilian Yuan 61ee03600b Update copyright 2021-09-27 14:16:18 -07:00
i-robot 7207e9708f !1117 Startree Cube Predicate Boundary Fix After Creation 
Merge pull request !1117 from Daniel Zhang/cube_predicate_boundary
 2021-09-27 15:07:49 +00:00
Daniel Zhang 2cc91fa4e0 Startree Cube Predicate Boundary Fix After Creation 2021-09-24 15:00:23 -04:00
farhan3 1f1532e971 Fix path manipulation and resource leak issues 2021-09-23 17:41:08 -04:00
Debasatwa Dutta aacf126204 avoid copying large object to optimize memory requirements 
fixes and memory optimizations

fixes and code clean up

code clean up

code clean up

updated hetu-docs

edited startree hetu-docs

code clean up
 2021-08-25 10:54:39 -04:00
Debasatwa Dutta 6086ea367c This commit fixes issues of simultaneous drop cube or table and create cube and right literal exclusion for not equal operator 
fix the issue if any query fails in between

fix for not equal operator

code clean up

code clean up

code clean up
 2021-08-18 17:29:56 -04:00
Debasatwa Dutta 9a32c353eb fix for directly execute the query with --execute parameter and varchar datatype with comparison operator 
removed un-intended change

Fix for multiple queries in --execute parameter and cli direct execute through --execute

code clean up

Checkstyle fixes

Fix for varchar datatype with comparison operator
 2021-08-12 05:07:33 -04:00
Debasatwa Dutta e7164fc0a2 These commits fixes two issues related to star tree cube. 
Fixes the issue with int type

Resolved the data mismatch issue, due to improperly inserted rows

Fix cube insert overwrite issue

simplified the code
 2021-07-30 21:41:13 -04:00
Debasatwa Dutta f155ddb930 varchar data type issue fixed, code clean up 
code clean up and fixed varchar issue

Increased the single batch process size to default 50M
 2021-07-14 17:08:40 -04:00
i-robot 132bc50c30 !988 Extended support for multiple data types 
Merge pull request !988 from Debasatwa/hetu-cube-cli-v3-extended-support-2
 2021-07-06 14:07:01 +00:00
Debasatwa Dutta a393cc0a0f Extended data types support changes 
Rebased the master branch

Extended data type support changes missed in rebase

roll back of create cube if there are any failures

Code Review Changes

Code Review changes

Code Review changes

Code Clean up

The changes for row buffer flush

Code clean up changes

Code clean up

Fix the issues related to create cube

fix if the full qualified name is not mentioned in the create cube query

corrected the max buffered rows size
 2021-07-05 18:31:09 -04:00
Raghunandan ed881ae4f2 [maven-release-plugin] prepare for next development iteration 2021-06-30 11:28:55 +05:30
i-robot c0e5cab002 !984 Fix for roll back of create cube if there are any failures 
Merge pull request !984 from Debasatwa/fix-drop-cube-for-fails
 2021-06-24 20:22:06 +00:00
Debasatwa Dutta 7a19a5dd44 Fix for roll back of create cube if there are any failures 
Code clean up

Code clean up

Code clean up
 2021-06-24 12:24:03 -04:00
i-robot e1c6b8b5cb !973 Fix the create cube fail issue 
Merge pull request !973 from Debasatwa/fix-create-cube-fail-issue
 2021-06-24 00:14:38 +00:00
Debasatwa Dutta 0ba221723f Fix the create cube fail issue, fix stop running insert queries after create cube failure 2021-06-23 17:52:12 -04:00
i-robot e5436499ed !972 StarTree - Fix the equal operator issue in the comparison expression 
Merge pull request !972 from Debasatwa/equal-comparision-expression-fix
 2021-06-23 21:41:23 +00:00
Debasatwa Dutta 2c44036e82 issue fix for equal comparison expression 
Code clean up changes
 2021-06-23 16:55:15 -04:00
Sundar Annamalai d8a35a09f4 Add support for filtering source data when creating cube. 2021-06-08 00:20:09 -04:00
Debasatwa Dutta 3c8aaec9c3 The startree changes for CLI 
Hetu cube cli initial commit

Initial commit cube cli changes with memory efficiency changes

comparison expressions changes commit

presto-cli checkstyle changes

commits with expression conversions

commit for query string truncate

changes for literal type

code clean up

delete the presto-cube-cli module added previously.

client options changes

added sqlformatter for create cube query modification

clean up code

Added fallback mechanism and unit tests

Changes include running CLI with parameters

code clean up changes

Code clean up

updated output format

Reverting the server config changes

Code review changes

Code review changes

added hetu-docs description

updated the documentation in star-tree-cube

Code review changes

updated hetu docs

Changes done to the support literals

divided the methods

Added comments

Seprated the classes Console and CubeConsole

Code clean up changes

Added checkstyle changes

changes for single insert query if range is within processing limit
 2021-06-01 04:18:45 -04:00
Raghunandan 34b34313b3 [maven-release-plugin] prepare for next development iteration 2021-03-31 11:15:11 +05:30
Peikun Chen d988c4e0b5 Update httpclient to 4.5.13, junit to 4.13.1 2021-03-10 11:13:40 +08:00
Peikun Chen 5c29c787b8 Add user-mapping 2021-02-27 14:18:49 +08:00
Raghunandan 592b5cbc9d [maven-release-plugin] prepare for next development iteration 2020-12-30 19:16:54 +05:30
Raghunandan 523167989d [maven-release-plugin] prepare branch branch-1.1 2020-12-30 19:16:53 +05:30
tushengxia 1adfd96a45 Support hindex creation and management through operators 
- remove presto-cli's direct dependency on hindex
- add new CreateIndexOperator
    - when a CREATE INDEX statement is received, rewrite the query as a TableScan and use the data from TableScan to create index
    - hindex no longer has a direct dependency on hive packages, it now uses the hive connector
- support index creation at different levels, e.g. file level or partition level
- remove BitmapIndex support, the previous version had issues; a new version will be added later
- add metadata to Pages, currently only enabled for hindex usecase
 2020-11-12 16:03:23 -05:00
Han Weng ec8ea30f70 Improve index record to cache entries and pre-screen indices to load 2020-10-22 20:54:20 -04:00
hweng 59e4991476 Update parallel index creation logic, improve index exception handling, tmp dump cleaning and cross-platform security path support 2020-10-19 22:00:15 -04:00
Han Weng de95345f3a Introduce new Index API - Refactoring and new implementations 2020-10-14 15:09:26 -04:00
Han Weng a983dd5f19 Fix CLI index partition issue 2020-09-25 16:08:19 -04:00
Han Weng 139d9e1c44 Merge branch 'index-fix-han' of https://gitee.com/farhan3/hetu-core into index-fix-han 2020-09-24 18:20:53 -04:00
Han Weng acbdda48a7 Update cli jar docs 2020-09-24 18:19:24 -04:00
farhan3 f3fa974b35 Revert "remove executable from hetu-cli jar name" 
This reverts commit 041c57306c.
 2020-09-24 18:08:36 -04:00