Commit Graph

677 Commits

Author SHA1 Message Date
Han Weng 78dfd71c94 Check index record and evict entries from cache when updated 2020-11-30 17:09:02 -05:00
Han Weng dfedbb0526 Allow dropping hindex by partition 2020-11-30 17:00:51 -05:00
i-robot 8fbcbb29f1 !403 Fix for stats updation in non-partition table
Merge pull request !403 from amanomer/stats_issue
2020-12-01 02:16:52 +08:00
i-robot 123fe24574 !397 [I2663H]Set default value for performance test
Merge pull request !397 from wangshuai/feature-update_default_value
2020-12-01 00:50:52 +08:00
i-robot 7f77cc9583 !392 BTree index creation and Split filtering using BTree
Merge pull request !392 from karmveer/btree_index
2020-11-30 23:10:55 +08:00
Jingfang 2c3afc10b7 !300 The supplement to document of DC connector
* fix dc connector documment
2020-11-30 19:47:19 +08:00
Yize_Li 34cea32a82 !395 Fix some format issues in the hana doc
* fix hana connector docs' format issues
2020-11-30 19:43:21 +08:00
i-robot b86d786af2 !387 Merging small file size splits
Merge pull request !387 from sandeep/feature-MergeSmallFileSizeSplits
2020-11-30 18:15:47 +08:00
sandeep e187ec034b !387 [I1T7XG] merge small splits before data shuffling. 2020-11-30 10:56:50 +05:30
karmvs 93661ce35e Adding btree index to Hindex 2020-11-29 21:54:33 -05:00
i-robot 28ff0b384d !355 [I1Z142] Support concurrent update on different partitions of same hive table
Merge pull request !355 from VinayakumarB/features/concurrent_update_I1Z142
2020-11-29 23:38:39 +08:00
i-robot 675d233fa6 !388 Auto cleanup UT Not stable
Merge pull request !388 from sandeep/bugfix-CarbondataAutocleanupUtNotStable
2020-11-29 21:56:42 +08:00
i-robot f7392bfe01 !430 merge security issues into master and update hbase docs
Merge pull request !430 from tushengxia/merge-security-and-update-hbasedocs
2020-11-28 17:45:08 +08:00
tushengxia b3b0559f4b merge security issues into master and update hbase docs 2020-11-28 15:37:29 +08:00
i-robot eb44f6a85f !407 Add bitmap index to hindex
Merge pull request !407 from farhan3/bitmap-idx
2020-11-28 01:55:05 +08:00
i-robot a12b48c52f !404 [I23NHM] Avoid adding background queries by UI to history fix the issue of client access failure
Merge pull request !404 from VinayakumarB/bugfix/UI_history_fix_I23NHM
2020-11-27 21:47:06 +08:00
shuaiwang999 7cbd204c91 update default config for performance test 2020-11-27 16:06:05 +08:00
i-robot 7107ee9fac !358 [I1Z929]Add UT for sql migration tool
Merge pull request !358 from wangshuai/add_ut_for_migration_tool
2020-11-27 14:14:30 +08:00
farhan3 d9e8b7c09f add bitmap index to hindex 2020-11-26 21:18:18 -05:00
i-robot e08bb41bf8 !385 I24V1A-improve-dynamic-filter-blocking-mechanism
Merge pull request !385 from Zhan Lu/I24V1A-Improve-dynamic-filter-blocking-mechanism
2020-11-27 09:32:33 +08:00
i-robot e83c49fb68 !423 fix dynamic catalog NPE config bug
Merge pull request !423 from farhan3/fix-dynamic-catalog-config-bug
2020-11-27 06:00:31 +08:00
ZhanLu00 c7a6bb6dbb improve dynamic filtering blocking mechanism 2020-11-26 13:15:11 -05:00
i-robot cb1719f52e !378 Make the profile name of filesystem for password security feature configurable
Merge pull request !378 from Jingfang/fix-profile-name-configurable
2020-11-27 01:54:29 +08:00
farhan3 0a98311de1 fix dynamic catalog NPE config bug 2020-11-26 12:04:33 -05:00
i-robot 6ca1ff0121 !415 update approvers list
Merge pull request !415 from farhan3/update-approvers
2020-11-27 00:20:31 +08:00
i-robot 41596e6068 !376 Refactor dynamic catalog, create a client when the process starts and reuse it in subsequent operations.
Merge pull request !376 from Jingfang/fix-refactor-dynamic-catalog
2020-11-26 08:15:49 +08:00
i-robot 35fd842933 !418 Improve heuristic index design for better extensibility
Merge pull request !418 from farhan3/idx-interface-updates
2020-11-26 06:13:49 +08:00
farhan3 9ed84036dc Improve heuristic index design for better extensibility 2020-11-25 16:30:25 -05:00
i-robot 90ebdd081d !374 Don't need to set the user name when remote dc don't have authentication
Merge pull request !374 from Jingfang/fix-dc-connector-default-username
2020-11-25 12:13:39 +08:00
farhan3 d2d3836772 update approvers list 2020-11-24 20:12:54 -05:00
Vinayakumar B 8966bea84f
[I23NHM] Avoid adding background queries by UI to history
fix the issue of client access failure.
2020-11-24 00:36:40 +05:30
i-robot 9fd979e3f7 !393 Store index properties in metadata and check connector type when creating index
Merge pull request !393 from Han_Weng/store-index-properties
2020-11-24 00:50:12 +08:00
Aman Omer 8df6a6d083 Fix for stats updation in non-partition table 2020-11-23 19:33:18 +05:30
tushengxia 88dc9ae46c Check connector type/table format/predicate when creating hindex 2020-11-20 15:11:05 -05:00
i-robot 4b9d2848e5 !390 Optimize stripe persisting logic to save index writing memory
Merge pull request !390 from Han_Weng/index-mem-fix
2020-11-21 04:01:09 +08:00
i-robot 300da2d1ce !353 Optimize the generation of dynamic filters
Merge pull request !353 from lizheng920625/remove_dynamicfilters
2020-11-21 00:15:12 +08:00
Han Weng 7bf046f806 Optimize stripe persisting logic to save index writing memory
- Update ORC Reader flagging to accurately reflect stripe finishing
- Make addData in index writer thread-safe
- Persist stripe index when finished in index writer to save memory used by index creation
2020-11-20 10:14:46 -05:00
lizheng920625 e035d99daa Remove unnecessary DynamicFilters and fix UT for removing dynamic filters
fix predicates for join

Add session config for optimize the generation for dynamic filters

Remove unused session variable
2020-11-20 14:15:35 +08:00
i-robot 518fd75785 !394 [I26412] Clusterstats thows "No Value Present"
Merge pull request !394 from VinayakumarB/bugfix/I26412_ClusterStat
2020-11-19 14:33:16 +08:00
Vinayakumar B b264860f41
[I26412] Clusterstats thows "No Value Present" 2020-11-19 11:11:32 +05:30
i-robot 52ff8ac96a !386 update hbase docs for kerberos configuration
Merge pull request !386 from tushengxia/hbase-update-kerberos
2020-11-19 09:15:17 +08:00
Han Weng f1124873c1 Store index properties in metadata when creating index 2020-11-18 17:47:42 -05:00
i-robot b8b73d1593 !366 Optimize the dynamic filter listener from task level to worker level
Merge pull request !366 from zengdeyong/df_listener_to_worker_level
2020-11-18 14:09:27 +08:00
sandeep 684e72e62d 388 [I25VGI] Auto Cleanup UT not stable 2020-11-18 11:02:15 +05:30
i-robot b413626e80 !330 [I1X8NQ] Performance optimization for the case where IN clause has multiple values (For datatype double, float and decimal).
Merge pull request !330 from RajeevRastogi/pushdown.otherdtype.in.perf
2020-11-18 13:07:23 +08:00
i-robot ad5412abf4 !155 Auto Vacuum for Carbondata
Merge pull request !155 from sandeep/feature-AutoVacuumForCarbondata
2020-11-18 11:59:23 +08:00
i-robot 1de51cd634 !331 Add FVTs tests for ORC cache
Merge pull request !331 from Jiahao/FVTs-test
2020-11-18 00:14:15 +08:00
Haochen Ding 8f6f19f209 Refactored DynamicFilterListenerService and split it into DynamicFilterCacheManager and DynamicFilterListener 2020-11-16 17:06:34 -05:00
i-robot 382ee947e2 !384 Add a mutex to resolve parallel running issues in IndexCache UT
Merge pull request !384 from Han_Weng/fix-index-cache-UT
2020-11-17 00:36:14 +08:00
tushengxia 30294ad367 update hbase docs for kerberos configuration 2020-11-16 15:39:18 +08:00