Commit Graph

951 Commits

Author SHA1 Message Date
Daniel Zhang 7411809d44 Index Documentation adjustments 2021-03-03 14:13:02 -05:00
i-robot 629c500f8e !646 Determine index creation level dynamically and resolve UT issues
Merge pull request !646 from Han_Weng/btree-auto-level
2021-03-03 00:33:31 +08:00
Han Weng ec79a88adc Determine index creation level dynamically and resolve UT issues 2021-03-02 11:09:46 -05:00
i-robot 03e7df0429 !645 [I27RR5] Documentations update associated with DM optimization
Merge pull request !645 from Nitin-Kashyap/dmperf.DocUpdate
2021-03-02 09:38:00 +08:00
nitin.kashyap 7af0092334 [I27RR5] Documentations update associated with DM optimizations 2021-03-01 21:53:34 +05:30
i-robot 2c959f733c !614 DM optimizations for INSERT UPDATE DELETE VACUUM
Merge pull request !614 from Surya Sumanth/skip_stats_bulk_api_vacuum_merge
2021-03-01 23:05:59 +08:00
Vinayakumar B e42eca000d [I27RR5] Skip stats update in Metastore on Vacuum Merge
Partition column based partitioning for writes & parallel metastore operations using threadpool

Reduce redundant HMS calls

Fixed multiple writers with non-partitioned table

Adding VACUUM FULL MERGE Command

Using bulk APIs to update the partition column statistics

Fixing various issues

Using partition column for partitioning update/delete

Using the local sorting instead of Global orderby

Using threadpool for adding partitions, connecting in round-robin to multiple HMSs.

UT and Fixes for DM Optimzations for Insert Update Delete Vacuum

MERGE name conflict resolved

Skip Stats collection for delete and parallelize commit preparation operations

review comment fixes
2021-03-01 19:07:46 +05:30
i-robot c576db7e7a !623 [#I38Q5L] CTE Optimization
Merge pull request !623 from RajeevRastogi/cte_reuse_opt_all
2021-03-01 21:11:38 +08:00
Neerajunnikrishnan b0e990b19f UTs and plan changes for CTE
fix for dynamic filter + documentation changes
2021-03-01 17:24:11 +05:30
sandeep ee812945b0 !642 [Doc] Needs to correct limitation of Carbondata connector
* 642 [I39AI7] Doc Update Limitation Of Carbondata Partition
2021-03-01 18:48:16 +08:00
rajeevrastogi 617c64461e plan changes + executor changes 2021-03-01 14:25:00 +05:30
nitin.kashyap 296b9fdc09 initial executor part 2021-03-01 14:24:01 +05:30
Surya Sumanth cfd6fe41a0 !625 Direct Delete and DM optimizations for Delete
* Failed UT fixes
* I26UAJ-Provide-option-to-delete-transactional-table-or-partition-directly
2021-03-01 16:37:28 +08:00
i-robot 0b1267f088 !622 [I38OMD] disable caching metastore for workers
Merge pull request !622 from Nitin-Kashyap/cacheDropTableFix
2021-03-01 16:35:38 +08:00
nitin.kashyap f6b20a4ef3 [I38OMD] skip cache usage on workers 2021-03-01 11:45:36 +05:30
i-robot 45d4be1587 !641 Query history support pagination
Merge pull request !641 from 张冰清/dev
2021-03-01 09:59:36 +08:00
IreneByron 3d5ec838de add pagination for query history;add user filter; 2021-02-28 10:22:29 +08:00
i-robot 591c9958b1 !621 Query result table support pagination
Merge pull request !621 from Maxiaoqi/pagigation
2021-02-27 19:15:25 +08:00
i-robot 8985e2b580 !586 Add user mapping and impersonation
Merge pull request !586 from Peikun Chen/feature/userMappingAndImpersonate
2021-02-27 17:03:26 +08:00
Peikun Chen 611effe684 Add impersonation 2021-02-27 14:18:50 +08:00
Peikun Chen 5c29c787b8 Add user-mapping 2021-02-27 14:18:49 +08:00
maxiaoqi2020 c994438d4b Add pagination for query result list 2021-02-27 12:01:54 +08:00
i-robot 93c6de4f28 !635 fix dynamic filtering register task error
Merge pull request !635 from Zhan Lu/fix-dynamic-filtering-index-error
2021-02-27 09:49:24 +08:00
i-robot 151df92d9f !638 Fix index preloading property issue
Merge pull request !638 from Han_Weng/fix-preloading-property
2021-02-27 08:51:35 +08:00
i-robot 14eadcdebe !611 Heuristic Index Bitmap Index Operator Functionality Features
Merge pull request !611 from Daniel Zhang/hindex-splits-test
2021-02-27 04:10:57 +08:00
Han Weng f49ea8511f Fix index preloading property issue 2021-02-26 14:41:01 -05:00
Daniel Zhang 0e3c601565 Bitmap operator functionality features 2021-02-26 13:46:09 -05:00
i-robot 1a4c77fca4 !636 Fix bitmap issue when the operator in predicate is not supported
Merge pull request !636 from Han_Weng/fix-bitmap
2021-02-26 11:07:09 +08:00
i-robot db7eccfcfb !634 fix dynamic filters documentation
Merge pull request !634 from Zhan Lu/fix-dynamic-filter-doc
2021-02-26 09:41:09 +08:00
i-robot ff5cd0930e !627 Preload index when server starts
Merge pull request !627 from Han_Weng/hindex-load-on-start
2021-02-26 04:37:09 +08:00
Han Weng 23c14ca518 Fix bitmap issue when the operator in predicate is not supported 2021-02-25 15:16:29 -05:00
Han Weng e039f87796 Implement user-specified index pre-loading when server starts 2021-02-25 15:13:59 -05:00
ZhanLu00 e7251c1010 avoid index out of boundary error on dynamic filtering register tasks 2021-02-25 13:57:27 -05:00
ZhanLu00 e498623102 fix state store reference in dynamic filters' documentation 2021-02-25 13:01:54 -05:00
i-robot 3c6db1fa44 !604 Clean up index record if index creation fails
Merge pull request !604 from Han_Weng/hindex-cleanup-record-on-failure
2021-02-26 01:53:09 +08:00
Han Weng 1b3678bd3e Clean up in progress record if index creation fails 2021-02-25 12:04:18 -05:00
i-robot e18cb773ef !633 Add new pushdown framework
Merge pull request !633 from luodan000/pushdown-final
2021-02-25 23:39:10 +08:00
luodan000 e9794f493e add new push down framework and modify existing connector using new push down framework, including dc, Oracle, hana, mysql connector.
co-author: guojunfei <970763131@qq.com>
co-author: zoujiaotong <zoujiaotong@163.com>
co-author: wuyuye <531938832@qq.com>
2021-02-25 19:49:40 +08:00
i-robot 840015e403 !537 Use hetu metastore for index metadata management
Merge pull request !537 from Han_Weng/index-record-hetu-metastore
2021-02-19 07:47:31 +08:00
Han Weng 675fc9a79e Use hetu-metastore for index metadata management 2021-02-18 18:22:33 -05:00
i-robot 1ee928710c !595 [I37U5U] Add parallel processing for hetu metastore
Merge pull request !595 from wangshuai/feature-fix_issue_metastore_cache
2021-02-18 23:39:26 +08:00
shuaiwang999 469ac921b6 add parallel processing for metastore 2021-02-18 14:51:10 +08:00
i-robot 0835c446d3 !600 Split Heuristic Index Splits Automated Test Files
Merge pull request !600 from Daniel Zhang/hindex-splits-test
2021-02-18 04:51:05 +08:00
Daniel Zhang 420300d65a Heuristic Index Automated Test 2021-02-17 14:50:12 -05:00
i-robot 9903b9c04a !601 Refactor BTree split filtering logic
Merge pull request !601 from Han_Weng/refactor-split-filtering
2021-02-13 03:35:08 +08:00
Han Weng d41859ebc9 Refactor BTree index, indexFilter and split filtering 2021-02-12 12:55:28 -05:00
i-robot 081b97064a !556 [I2RMCL] Fix doc issues
Merge pull request !556 from wangshuai/fix_doc_issue
2021-02-10 17:25:01 +08:00
i-robot 2293646ddd !577 Heuristic Index Splits Automated Tests
Merge pull request !577 from Daniel Zhang/hindex-splits-test
2021-02-10 01:47:00 +08:00
Daniel Zhang 06d5f1f698 Heuristic Index Automated Test 2021-02-09 07:35:05 -05:00
i-robot 85bcd4c5a6 !592 Disable a hindex concurrency UT
Merge pull request !592 from Han_Weng/hindex-disable-ut
2021-02-09 06:58:21 +08:00