hetu-core

...

Author	SHA1	Message	Date
lifengzi	e50b4ce963	回退 'Pull Request !590 : first round sync feature-pushdown code to remoteudf-poc branch[just sync feature branch code to another feature branch]'	2021-02-08 17:47:02 +08:00
bryanwong	5e742e2ba3	!590 first round sync feature-pushdown code to remoteudf-poc branch[just sync feature branch code to another feature branch] * !576 pushdown feature * !532 [I2CVRD] fix hana connector doc * !534 update releasenotes and add doc links * !529 Add index record cache back, disable local indexstore, and improv… * Add index record cache back, check filesystem time precision and impro… * !528 Remove absolute URL from query editor code * fix hana doc * !522 improve the performance of hbase connector * improve split plan and get high concurrency to improve performance * !519 update docs * !524 【轻量级 PR】：Make container build pass sanity test * Make container build pass sanity test * !516 [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog othe… * update docs. * [maven-release-plugin] prepare for next development iteration * [maven-release-plugin] prepare branch branch-1.1 * !518 add two known issue to the release notes * [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog other than hive * !514 Add release notes of release 1.1.0 version * !512 [I2BBGM] Fix: Reuse Exchange Concurrency Issue (stale query id use) * [I2BBGM]Fix: Reuse Exchange Concurrency Issue (stale query id use) * !507 Set default value of transform self join to group by to true * !511 add support column types description of all indexes in hetu-docs * add support column types description of all indexes in hetu-docs * !510 modify create new hbase logical * modify hbase logical of create new hbase table * Set default value of transform self join to group by to true * !509 [I2B55F]: Fix: Consumer gets blocked if producer gets cancelled * !508 【I2B2F5】Update Presto to Trino * [I2B55F]: Fix: Consumer gets blocked if producer gets cancelled * !506 Add limitations to the openGauss connector document * !503 add document for hetu-hive-functions module * !504 fix index issues * !505 Fixed topn rank operator data inconsistency bug * fix index issues of QA535, QA513, QA552 * fixed topn rank operator data inconsistency * !502 The first letter of OpenLooKeng in the tab page should be lowercase * change web UI title from OpenLooKeng to openLooKeng * !499 Add webui document * !487 Create docs for Oracle connector & modify docs for mongoDB connector * !491 Add document for openlookeng-ranger-plugin * !500 Fix the space in filepath for index store * Fixing the character column path issue * !497 hive.md hive.max-splits-to-group default value is 10 is changed to 1 * !489 [I2AJVX] Update to Table Pushdown to handle incorrect stats from … * !496 Fix null value handling for bitmap index * Added changes to address incorrect approx stats for getDistinctValuesC… * !495 [I2AMGW] When multiple coordinators are used, don't update memory… * !493 HA-AA network delay of coordinator * !494 throw Index creation on Decimal Column is not supported error * !492 Support openGauss connector * Type check for index creation * Add timeout to hazelcast state store * When multiple coordinators are used, don't update memory pool info for… * Add null value handling for bitmap index * Support openGauss connector * !490 Fix hindex QA issues and improve log messages * Fix hindex QA issues * !484 Update open source notice * !488 fix hbase small problems about push down when execution plan enab… * !486 sync prestosql `Trim whitespace when loading configuration #3231` issue * !472 [I29JFI]Add ip and array data type for ES connector * support ip and array data type * !473 Add huawei copyright on TestOrcCache * fix push down and batch get in hbase connector * Trim whitespace when loading configuration * !485 Fix QA issue on concurrent index creation * !483 Add open source software notice for hindex * Add lock for in-progress index record IO * add huawei copyright * !482 Fixing the between operator inclusive condition * Update open source notice * Btree between operator fix * !461 update documentation with recent change on optimization * !480 add copyright to two index files * !478 Fix role column values for worker enabled coordinator in UI * !481 Capitalize the first latter of each word on the home page * add copyright for index * !479 fixed the and modify the deleteCatalog function * Fix for roles displayed in nodes page * !477 [I29YZ4] cast exception fix * [I29YZ4] cast exception fix * Update open source notice for hindex * update documentation scratch * !474 [I29YZ4] Fix for Reuse Exchange when a dangling consumer was created * !454 Support Hive metastore impersonation * !464 Support MongoDB connector * Fix for dangling consumer issue * !475 [HOTFIX]Update bundles for UI changes * !456 [I29CR9] Documentation for Reuse Exchange * !471 fixed the QA-493:2 and fixed the issue when the bottom is blocked… * !469 Make execution time in UI query editor configurable * Merge branch 'master' of gitee.com:openlookeng/hetu-core into hive-met… * !466 Fix index QA bugs * Fix drop index failure and issues with execution plan cache * !455 Backend fixes for Web UI * !319 Fix hetu-hazelcast compile after jdk 9 * !465 bug fix: Stats issue in case of update/delete of table with Bool… * Back-end fixes and coopyright information to self developed files for Web UI * Make execution time in UI query editor configurable * !468 Update the Third Party Open Source Software Notice * update third party software notice 2020/12/17 * add mongodb connector * !462 [I29O3L] Adding Copyright information to self developed java files * !463 Update copyright in oracle connector's UT file. * Support Hive metastore impersonation * !459 Fixing issue handling decimal values in BloomIndex * Adding decimal fix for bloom index * !465 [I29PG3] bugfix-BooleanStatistics * !460 fixed the UI bug * modify the copyright in the pracle ut code * added version info to the header * !458 Fix QA issues: concurrent index creation, multi-col index creation * Improve concurrent index creation logic * !457 Remove state store properties * Removing state store properties * !453 Fix hindex access control issues * !448 fix high probability unit test failure in presto-main * fix potential issue by replacing localhost with 127.0.0.1 * Fix heuristic index access control issues * !449 Enable dynamic filtering by default and change join reorder and j… * !443 [I27OK0] Reuse Exchange * Additional Fixes for ReuseExchange * !452 Bug Fixes: Supporting the in clause for partitions, Table level B… * !444 Use BufferedReade to read seed * Enable dynamic filtering by default and change join reorder and join d… * Added final code for ReuseExchange with Consumer split scheduling and … * Reuse exchange Feature (Optimizer rule, Execution etc) * !450 defect-fix when dynamic filter with Groping of small splits is enabled * Fixing the the RC1 bugs: in clause fix, table level support * !382 [I250AR] Enhance IN predicates by avoiding Selfjoins with aggregations * !450 [I28SW2] bugfix-groupSmallFilesWithDynamicFilter * !446 Fix inaccurate memory statistics of GroupedTopNBuilder. * !445 sync user guide changes in ODBC repo to hetu core repo * !438 Sync pr from security_fixes branch to master branch * !402 push down cross-region-dynamic-filter to tableScan, and push down… * !447 Fix heuristic index QA bugs * Fix heuristic index QA issues for 1230 release * !437 Batch write in BTree index * !435 Update hindex docs * update hindex docs * !442 Fix typos in PR template * feature cross layer dynamic filter push down, push down cross dynamic… * Modify RowHeap from interface to abstract class. * fix inaccurate memory statistics of GroupedTopNBuilder UT. * !419 fix the design of security key feature * sync ODBC user guide changes from ODBC repo. * use bufferedreader to read seed * batch write support * !391 Add Dynamic Filter for Semi Joins * !421 add oracle synonyms support * Fix typos in PR doc * !441 Fix typos in SPI docs * !429 Optimizer window operator ranking function execution performance * !414 Add global file based access check on index * !440 【轻量级 PR】：Fix errors in run-hetu script * add global file based access control on index * !436 Fix cache eviction issue when dropping partial index * !434 [I27RR5] Handle hive table/partition statistics update for UPDATE… * !428 Support user-defined "zookeeper.znode.parent" for HBase Connector * !439 [I1T7XG] set default config for small split merge as 1 * Add dynamic filter for semi join * [I250AR] Enhance IN predicates by avoiding Selfjoins with aggregations * Fix errors in run-hetu script * Fix cache eviction issue when dropping partial index * fix security scan issue * !426 【轻量级 PR】：Fix typo in SPI overview document * [I27RR5] Handle hive table/partition statistics update for UPDATE/DELETE ops * add oracle synonym support * Support user-defined "zookeeper.znode.parent" for HBase Connector * !380 [I23DUQ] Reconstruct ES connector code to support ES7.6.2 * !406 Rewrite filtering SemiJoin to InnerJoin * !413 Allow dropping index by partition and add index cache eviction ba… * !377 [I24N4J] Enhancement of stats and cost for various nodes (operator) * reconstruct ES connector code to support ES7.6.2 * [I24N4J] Added support for stat and cost estimation for * !400 Fix TestOrcCache Jenkin error * Check index record and evict entries from cache when updated * Allow dropping hindex by partition * !403 Fix for stats updation in non-partition table * !397 [I2663H]Set default value for performance test * !392 BTree index creation and Split filtering using BTree * !300 The supplement to document of DC connector * !395 Fix some format issues in the hana doc * !387 Merging small file size splits * !387 [I1T7XG] merge small splits before data shuffling. * fix orc cache error * Adding btree index to Hindex * !355 [I1Z142] Support concurrent update on different partitions of sam… * !388 Auto cleanup UT Not stable * !430 merge security issues into master and update hbase docs * merge security issues into master and update hbase docs * !407 Add bitmap index to hindex * !404 [I23NHM] Avoid adding background queries by UI to history fix the… * update default config for performance test * !358 [I1Z929]Add UT for sql migration tool * Fix typo in SPI overview document * add bitmap index to hindex * !385 I24V1A-improve-dynamic-filter-blocking-mechanism * !423 fix dynamic catalog NPE config bug * improve dynamic filtering blocking mechanism * !378 Make the profile name of filesystem for password security feature… * fix dynamic catalog NPE config bug * !415 update approvers list * !376 Refactor dynamic catalog, create a client when the process starts… * !418 Improve heuristic index design for better extensibility * Improve heuristic index design for better extensibility * !374 Don't need to set the user name when remote dc don't have authentication * update approvers list * Add TransformFilteringSemiJoinToInnerJoin optimizer from prestosql community * [I23NHM] Avoid adding background queries by UI to history * !393 Store index properties in metadata and check connector type when … * Fix for stats updation in non-partition table * Check connector type/table format/predicate when creating hindex * !390 Optimize stripe persisting logic to save index writing memory * !353 Optimize the generation of dynamic filters * Optimize stripe persisting logic to save index writing memory * Remove unnecessary DynamicFilters and fix UT for removing dynamic filters * !394 [I26412] Clusterstats thows "No Value Present" * [I26412] Clusterstats thows "No Value Present" * !386 update hbase docs for kerberos configuration * Store index properties in metadata when creating index * !366 Optimize the dynamic filter listener from task level to worker level * 388 [I25VGI] Auto Cleanup UT not stable * !330 [I1X8NQ] Performance optimization for the case where IN clause ha… * !155 Auto Vacuum for Carbondata * !331 Add FVTs tests for ORC cache * Refactored DynamicFilterListenerService and split it into DynamicFilte… * !384 Add a mutex to resolve parallel running issues in IndexCache UT * update hbase docs for kerberos configuration * change dynamic filter state store listener to worker level. * Add a mutex to resolve parallel running issues in IndexCache UT * add fvts tests for ORC cache * create a client when the process starts and reuse it in subsequent operations. * Set dc connector default username * make the profile name is configurable * !155 [I1SSRN] CarbondataAutoVacuum * [I1X8NQ]: Optimization of IN clause with multiple values for Float, Do… * [I1Z142] Support concurrent update on different partitions of same hive table * add ut for sql migration tool * replace codehaus's aspectj-maven-plugin with nickwong's fork version	2021-02-08 17:43:50 +08:00

Author

SHA1

Message

Date

lifengzi

e50b4ce963

回退 'Pull Request !590 : first round sync feature-pushdown code to remoteudf-poc branch[just sync feature branch code to another feature branch]'

2021-02-08 17:47:02 +08:00

bryanwong

5e742e2ba3

!590 first round sync feature-pushdown code to remoteudf-poc branch[just sync feature branch code to another feature branch]

* !576 pushdown feature
* !532 [I2CVRD] fix hana connector doc
* !534 update releasenotes  and add doc links
* !529 Add index record cache back, disable local indexstore, and improv…
* Add index record cache back, check filesystem time precision and impro…
* !528 Remove absolute URL from query editor code
* fix hana doc
* !522 improve the performance of hbase connector
* improve split plan and get high concurrency to improve performance
* !519 update docs 
* !524 【轻量级 PR】：Make container build pass sanity test
* Make container build pass sanity test
* !516 [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog othe…
* update docs.
* [maven-release-plugin] prepare for next development iteration
* [maven-release-plugin] prepare branch branch-1.1
* !518 add two known issue to the release notes
* [I2BEWV]Fix: ReuseTableScan-Query does not work with catalog other than hive
* !514 Add release notes of release 1.1.0 version
* !512 [I2BBGM] Fix: Reuse Exchange Concurrency Issue (stale query id use)
* [I2BBGM]Fix: Reuse Exchange Concurrency Issue (stale query id use)
* !507 Set default value of transform self join to group by to true
* !511 add support column types description of all indexes in hetu-docs
* add support column types description of all indexes in hetu-docs
* !510 modify create new hbase logical
* modify hbase logical of create new hbase table
* Set default value of transform self join to group by to true
* !509 [I2B55F]: Fix: Consumer gets blocked if producer gets cancelled
* !508 【I2B2F5】Update Presto to Trino
* [I2B55F]: Fix: Consumer gets blocked if producer gets cancelled
* !506 Add limitations to the openGauss connector document
* !503 add document for hetu-hive-functions module
* !504 fix index issues 
* !505  Fixed topn rank operator data inconsistency bug
* fix index issues of QA535, QA513, QA552
* fixed topn rank operator data inconsistency
* !502  The first letter of OpenLooKeng in the tab page should be lowercase
* change web UI title from OpenLooKeng to openLooKeng
* !499 Add webui document
* !487  Create docs for Oracle connector & modify docs for mongoDB connector
* !491  Add document for openlookeng-ranger-plugin
* !500 Fix the space in filepath for index store
* Fixing the character column path issue
* !497 hive.md hive.max-splits-to-group default value is 10 is changed to 1
* !489 [I2AJVX] Update to Table Pushdown to handle incorrect stats from …
* !496 Fix null value handling for bitmap index
* Added changes to address incorrect approx stats for getDistinctValuesC…
* !495 [I2AMGW] When multiple coordinators are used, don't update memory…
* !493 HA-AA network delay of coordinator
* !494 throw Index creation on Decimal Column is not supported error
* !492 Support openGauss connector
* Type check for index creation
* Add timeout to hazelcast state store
* When multiple coordinators are used, don't update memory pool info for…
* Add null value handling for bitmap index
* Support openGauss connector
* !490 Fix hindex QA issues and improve log messages
* Fix hindex QA issues
* !484 Update open source notice
* !488 fix hbase small problems about push down when execution plan enab…
* !486 sync prestosql `Trim whitespace when loading configuration #3231` issue
* !472 [I29JFI]Add ip and array data type for ES connector
* support ip and array data type
* !473 Add huawei copyright on TestOrcCache
* fix push down and batch get in hbase connector
* Trim whitespace when loading configuration
* !485 Fix QA issue on concurrent index creation
* !483 Add open source software notice for hindex
* Add lock for in-progress index record IO
* add huawei copyright
* !482 Fixing the between operator inclusive condition
* Update open source notice
* Btree between operator fix
* !461 update documentation with recent change on optimization
* !480 add copyright to two index files
* !478 Fix role column values for  worker enabled coordinator in UI
* !481 Capitalize the first latter of each word on the home page
* add copyright for index
* !479 fixed the and modify the deleteCatalog function
* Fix for roles displayed in nodes page
* !477 [I29YZ4] cast exception fix
* [I29YZ4] cast exception fix
* Update open source notice for hindex
* update documentation scratch
* !474 [I29YZ4] Fix for Reuse Exchange when a dangling consumer was created
* !454 Support Hive metastore impersonation
* !464 Support MongoDB connector
* Fix for dangling consumer issue
* !475 [HOTFIX]Update bundles for UI changes
* !456 [I29CR9] Documentation for Reuse Exchange
* !471 fixed the QA-493:2 and fixed the issue when the bottom is blocked…
* !469 Make execution time in UI query editor configurable
* Merge branch 'master' of gitee.com:openlookeng/hetu-core into hive-met…
* !466 Fix index QA bugs
* Fix drop index failure and issues with execution plan cache
* !455 Backend fixes for Web UI 
* !319 Fix hetu-hazelcast compile after jdk 9
* !465 bug fix: Stats issue in case of update/delete of  table with Bool…
* Back-end fixes and coopyright information to self developed files for Web UI
* Make execution time in UI query editor configurable
* !468  Update the Third Party Open Source Software Notice
* update third party software notice 2020/12/17
* add mongodb connector
* !462 [I29O3L] Adding Copyright information to self developed java files
* !463 Update copyright in oracle connector's UT file. 
* Support Hive metastore impersonation
* !459 Fixing issue handling decimal values in BloomIndex
* Adding decimal fix for bloom index
* !465 [I29PG3] bugfix-BooleanStatistics
* !460 fixed the UI  bug
* modify the copyright in the pracle ut code
* added version info to the header
* !458 Fix QA issues: concurrent index creation, multi-col index creation
* Improve concurrent index creation logic
* !457 Remove state store properties 
* Removing state store properties
* !453 Fix hindex access control issues
* !448 fix high probability unit test failure in presto-main 
* fix potential issue by replacing localhost with 127.0.0.1
* Fix heuristic index access control issues
* !449 Enable dynamic filtering by default and change join reorder and j…
* !443 [I27OK0] Reuse Exchange
* Additional Fixes for ReuseExchange
* !452 Bug Fixes: Supporting the in clause for partitions, Table level B…
* !444 Use BufferedReade to read seed
* Enable dynamic filtering by default and change join reorder and join d…
* Added final code for ReuseExchange with Consumer split scheduling and …
* Reuse exchange Feature (Optimizer rule, Execution etc)
* !450 defect-fix  when dynamic filter with Groping of small splits is enabled
* Fixing the the RC1 bugs: in clause fix, table level support
* !382 [I250AR] Enhance IN predicates by avoiding Selfjoins with aggregations
* !450 [I28SW2] bugfix-groupSmallFilesWithDynamicFilter
* !446 Fix inaccurate memory statistics of GroupedTopNBuilder.
* !445 sync user guide changes in ODBC repo to hetu core repo
* !438 Sync pr from security_fixes branch to master branch
* !402 push down cross-region-dynamic-filter to tableScan, and push down…
* !447 Fix heuristic index QA bugs
* Fix heuristic index QA issues for 1230 release
* !437 Batch write in BTree index
* !435 Update hindex docs
* update hindex docs
* !442 Fix typos in PR template
*  feature cross layer dynamic filter push down, push down cross dynamic…
* Modify RowHeap from interface to abstract class.
* fix inaccurate memory statistics of GroupedTopNBuilder UT.
* !419 fix the design of security key feature
* sync ODBC user guide changes from ODBC repo.
* use bufferedreader to read seed
* batch write support
* !391 Add Dynamic Filter for Semi Joins
* !421 add oracle synonyms support
* Fix typos in PR doc
* !441 Fix typos in SPI docs
* !429 Optimizer window operator ranking function execution performance 
* !414 Add global file based access check on index
* !440 【轻量级 PR】：Fix errors in run-hetu script
* add global file based access control on index
* !436 Fix cache eviction issue when dropping partial index
* !434 [I27RR5] Handle hive table/partition statistics update for UPDATE…
* !428 Support user-defined "zookeeper.znode.parent" for HBase Connector
* !439 [I1T7XG] set default config for small split merge as 1
* Add dynamic filter for semi join
* [I250AR] Enhance IN predicates by avoiding Selfjoins with aggregations
* Fix errors in run-hetu script
* Fix cache eviction issue when dropping partial index
* fix security scan issue
* !426 【轻量级 PR】：Fix typo in  SPI overview document
* [I27RR5] Handle hive table/partition statistics update for UPDATE/DELETE ops
* add oracle synonym support
* Support user-defined "zookeeper.znode.parent" for HBase Connector
* !380 [I23DUQ] Reconstruct ES connector code to support ES7.6.2
* !406 Rewrite filtering SemiJoin to InnerJoin
* !413 Allow dropping index by partition and add index cache eviction ba…
* !377 [I24N4J] Enhancement of stats and cost for various nodes (operator) 
* reconstruct ES connector code to support ES7.6.2
* [I24N4J] Added support for stat and cost estimation for
* !400 Fix TestOrcCache Jenkin error
* Check index record and evict entries from cache when updated
* Allow dropping hindex by partition
* !403 Fix for stats updation in non-partition table
* !397 [I2663H]Set default value for performance test
* !392 BTree index creation and Split filtering using BTree
* !300 The supplement to document of DC connector
* !395 Fix some format issues in the hana doc 
* !387 Merging small file size splits
* !387 [I1T7XG] merge small splits before data shuffling.
* fix orc cache error
* Adding btree index to Hindex
* !355 [I1Z142] Support concurrent update on different partitions of sam…
* !388 Auto cleanup UT Not stable
* !430 merge security issues into master and update hbase docs
* merge security issues into master and update hbase docs
* !407 Add bitmap index to hindex
* !404 [I23NHM] Avoid adding background queries by UI to history fix the…
* update default config for performance test
* !358 [I1Z929]Add UT for sql migration tool
* Fix typo in  SPI overview document
* add bitmap index to hindex
* !385 I24V1A-improve-dynamic-filter-blocking-mechanism
* !423 fix dynamic catalog NPE config bug
* improve dynamic filtering blocking mechanism
* !378 Make the profile name of filesystem for password security feature…
* fix dynamic catalog NPE config bug
* !415 update approvers list
* !376 Refactor dynamic catalog, create a client when the process starts…
* !418 Improve heuristic index design for better extensibility
* Improve heuristic index design for better extensibility
* !374 Don't need to set the user name when remote dc don't have authentication
* update approvers list
* Add TransformFilteringSemiJoinToInnerJoin optimizer from prestosql community
* [I23NHM] Avoid adding background queries by UI to history
* !393 Store index properties in metadata and check connector type when …
* Fix for stats updation in non-partition table
* Check connector type/table format/predicate when creating hindex
* !390 Optimize stripe persisting logic to save index writing memory
* !353 Optimize the generation of dynamic filters
* Optimize stripe persisting logic to save index writing memory
* Remove unnecessary DynamicFilters and fix UT for removing dynamic filters
* !394 [I26412] Clusterstats thows "No Value Present"
* [I26412] Clusterstats thows "No Value Present"
* !386 update hbase docs for kerberos configuration
* Store index properties in metadata when creating index
* !366 Optimize the dynamic filter listener from task level to worker level
* 388 [I25VGI] Auto Cleanup UT not stable
* !330 [I1X8NQ] Performance optimization for the case where IN clause ha…
* !155 Auto Vacuum for Carbondata
* !331 Add FVTs tests for ORC cache
* Refactored DynamicFilterListenerService and split it into DynamicFilte…
* !384 Add a mutex to resolve parallel running issues in IndexCache UT
* update hbase docs for kerberos configuration
* change dynamic filter state store listener to worker level.
* Add a mutex to resolve parallel running issues in IndexCache UT
* add fvts tests for ORC cache
* create a client when the process starts and reuse it in subsequent operations.
* Set dc connector default username
* make the profile name is configurable
* !155 [I1SSRN] CarbondataAutoVacuum
* [I1X8NQ]: Optimization of IN clause with multiple values for Float, Do…
* [I1Z142] Support concurrent update on different partitions of same hive table
* add ut for sql migration tool
* replace codehaus's aspectj-maven-plugin with nickwong's fork version

2021-02-08 17:43:50 +08:00

Compare commits

2 Commits

master ... revert-mer

Diff Content Not Available

Compare commits

2 Commits master ... revert-mer

Diff Content Not Available

2 Commits

master ... revert-mer