jffwang
/
hetu-core
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,340 Commits 27 Branches 57 Tags 68 MiB
Commit Graph

1340 Commits

Author SHA1 Message Date
Han Weng 83ea53c8ed Address comments 2021-06-11 11:17:17 -04:00
Han Weng 073bb9e19a Fix UT issues 2021-06-11 01:30:15 -04:00
Han Weng 8a86cb0b2f Fix TestMemoryTableManager UT 2021-06-10 17:50:28 -04:00
arjunkrishna 47db890c74 replace default num of splits and enfore minimum 2021-06-10 15:24:22 -04:00
arjunkrishna 66524c76ea remove extra pom dep 2021-06-10 14:59:56 -04:00
arjunkrishna c2380c0ab3 fix UT failure due to memory connector changes 2021-06-10 14:30:26 -04:00
Han Weng d833dc36e7 Memory Connector: Doc update and minor fixes 2021-06-10 14:00:43 -04:00
Han Weng 15584a795e Check sort_by/index columns 2021-06-09 16:29:48 -04:00
Han Weng 33ded9856e Memory Connector: Fix PR issues 2021-06-09 13:38:24 -04:00
farhan3 308bef7791 Memory Connector: Performance improvements, config updates, refactoring 2021-06-08 18:02:34 -04:00
Han Weng 7663867175 Memory Connector: Implement automatic memory management 2021-06-08 17:59:19 -04:00
farhan3 d01d316622 Memory Connector: Support additional predicate pushdown, add UTs, new configs 2021-06-08 17:59:19 -04:00
Han Weng 1035ca68cc Memory Connector: Add spill-to-disk support 2021-06-08 17:59:19 -04:00
Han Weng db059fb704 Memory Connector: Integrate with HetuMetastore 2021-06-08 17:59:19 -04:00
farhan3 7ed9e7bb63 Memory connector: Introduce new storage format 2021-06-08 17:59:19 -04:00
i-robot 44f3bdd2a5 !892 Fix slow UI rendering 
Merge pull request !892 from Maxiaoqi/ui-improvement
 2021-06-02 15:18:31 +08:00
i-robot b1ca9c0117 !890 CLI changes for Star Tree 
Merge pull request !890 from Debasatwa/hetu-cube-cli-v2
 2021-06-01 21:22:58 +08:00
i-robot aa9a577615 !886 Fix issue with query getting stuck when Bitmap index is used 
Merge pull request !886 from farhan3/fix-bitmap-rowgroup-bug
 2021-06-01 20:20:50 +08:00
Debasatwa Dutta 3c8aaec9c3 The startree changes for CLI 
Hetu cube cli initial commit

Initial commit cube cli changes with memory efficiency changes

comparison expressions changes commit

presto-cli checkstyle changes

commits with expression conversions

commit for query string truncate

changes for literal type

code clean up

delete the presto-cube-cli module added previously.

client options changes

added sqlformatter for create cube query modification

clean up code

Added fallback mechanism and unit tests

Changes include running CLI with parameters

code clean up changes

Code clean up

updated output format

Reverting the server config changes

Code review changes

Code review changes

added hetu-docs description

updated the documentation in star-tree-cube

Code review changes

updated hetu docs

Changes done to the support literals

divided the methods

Added comments

Seprated the classes Console and CubeConsole

Code clean up changes

Added checkstyle changes

changes for single insert query if range is within processing limit
 2021-06-01 04:18:45 -04:00
maxiaoqi2020 47f4e478ba load google fonts locally; add third-party software notice 2021-06-01 14:36:11 +08:00
farhan3 83fa7e341d Move BitmapIndex cursor forward when row group has been filtered out 2021-05-31 11:08:54 -04:00
i-robot ec3f390671 !887 fix cleanExpireState 
Merge pull request !887 from i-robot/pull32
 2021-05-31 23:01:15 +08:00
i-robot 81cfe31188 !862 update zh docs for PR https://gitee.com/openlookeng/hetu-core/pulls/816/files 
Merge pull request !862 from qiaominna/master
 2021-05-31 14:15:26 +08:00
i-robot 5aa088549a !888 [I3SI4C] added config for batch size in config 
Merge pull request !888 from Nitin-Kashyap/parallelUpdate
 2021-05-31 12:35:26 +08:00
nitin.kashyap 0de42742d7 [I3SI4C] added config for batch size in config 2021-05-28 19:15:20 +05:30
i-robot 8d8bd63e36 !882 [#I3SFMD] Concurrent Query Optimization 
Merge pull request !882 from RajeevRastogi/physical.plan.schedule.opt
 2021-05-26 23:52:29 +08:00
i-robot ebbc6b18d3 !875 [I3PII7] Remove taskCount from MarkerPage and MarkerSplit 
Merge pull request !875 from Richard Hua/I3PII7-remove-taskCount-from-MarkerPage-MarkerSplit
 2021-05-26 23:06:39 +08:00
rajeevrastogi a8b2e85340 [#I3SFMD] Concurrent query optimization 2021-05-26 20:25:45 +05:30
i-robot b9b092a65a !874 [I3FHGK] Improve snapshot stability 
Merge pull request !874 from sandygao/improve-snapshot-stability
 2021-05-26 21:32:29 +08:00
i-robot c6a3412e76 !881 Support Hudi MOR table Snapshot/Read-Optimized queries 
Merge pull request !881 from Maxiaoqi/hudi_mor_support
 2021-05-26 09:35:58 +08:00
i-robot 47920287d3 !876 Predicate pushdown support for CTE 
Merge pull request !876 from NeerajUnnikrishnan/feature/cte_pd_pr
 2021-05-25 16:47:07 +08:00
NeerajUnnikrishnan 01b224af0c Predicate pushdown for CTE 2021-05-25 03:24:40 -04:00
maxiaoqi2020 e3eb3a6ac6 Support Hudi COW/MOR table Snapshot/Read-Optimized queries 
Update Presto-hive UT tests
 2021-05-24 20:20:41 +08:00
i-robot 0dcb194614 !877 Query Concurrency Code Optimizations 
Merge pull request !877 from Surya Sumanth/concurrency_optimizations
 2021-05-24 02:23:16 +08:00
SURYA SUMANTH N d379529ac3 Query Concurrency Code Optimizations 2021-05-23 23:28:45 +05:30
i-robot c5af94b1d1 !879 Delete empty staging directory and subdirectories through a single api call 
Merge pull request !879 from Pradeep Agrawal/deleteEmptyStagingDir
 2021-05-23 13:45:48 +08:00
pradeep 23645d9b85 [I3SI4C] Delete empty staging directory and subdirectories through a single api call with recursive option 2021-05-22 20:32:51 +05:30
Sandy Gao 0e4683dc60 Improve snapshot stability 
- Remove hive files from old tasks
- Recover from unexpected results from tasks
- Handle "create table if not exists" statements
- Improve mechanism to verify query rerun completeness
- Handle case where table-scan task finishes after resume is done
 2021-05-20 16:05:19 -04:00
richardhua_fa1a e77ce972e1 Removes taskCount 2021-05-19 15:17:19 -05:00
yinsuna 4d98b654b1 fix cleanExpireState 
refactor

refactor
 2021-05-18 20:45:18 +08:00
i-robot f86dd04869 !867 Support merging star tree cube range predicates 
Merge pull request !867 from sundarannamalai/range-issue-fix
 2021-05-13 02:42:00 +08:00
i-robot 30701d0cd4 !868 【轻量级 PR】：Update condition to verify child stage completeness 
Merge pull request !868 from sandygao/N/A
 2021-05-12 12:29:37 +08:00
sandygao 3700d92db0 Update condition to verify child stage completeness 2021-05-12 07:44:22 +08:00
Sundar Annamalai 34b7306699 Star Tree Cubing - Support for merging range predicates. 2021-05-11 16:35:37 -04:00
i-robot fc981cce05 !863 [I3FHGK] Improve snapshot stability 
Merge pull request !863 from sandygao/improve-snapshot-stability
 2021-05-11 09:28:19 +08:00
i-robot 3021d82710 !860 fixed openLooKeng reports a java.lang.NullPointerException after querying from MySQL 
Merge pull request !860 from Wangmaomao/master
 2021-05-06 12:39:09 +08:00
i-robot 44dc647853 !864 UI display fix 
Merge pull request !864 from Maxiaoqi/ui-improvement
 2021-05-06 11:53:07 +08:00
Sandy Gao 3aea36f7cc Improve snapshot stability: 
- Avoid sharing memory context between old and new tasks
- Union sources produce same number of markers
- Exchange operator will be blocked waiting for noMoreSplits to be set
- Made noMoreSplits call happen early by scheduling all tasks with marker 0
- QuerySnapshotManager record snapshot initiated for accurate cleanup of snapshot subfiles
- Fix typo in driver logs
- Update HashBuilder comment
- Consider restored pages in ExchangeOperator isBlocked()
- Remove special handling in MergeOperator isBlocked()
- Fix issue where shared marker is updated with different origins
- Avoid too frequent resumes
 2021-05-04 19:33:15 -04:00
maxiaoqi2020 fe22da2975 remove state; fix ip/port display issue 
fix tooltip incomplete issue
 2021-04-29 11:11:29 +08:00
q00380213 0bde5c11e7 update 2021-04-27 21:11:35 +08:00