update default config for performance test
This commit is contained in:
parent
41596e6068
commit
7cbd204c91
|
|
@ -21,7 +21,7 @@ dynamic-filtering-bloom-filter-fpp=0.1
|
|||
The above attributes are described below:
|
||||
|
||||
- `enable-dynamic-filtering`: Enable dynamic filtering feature.
|
||||
- `dynamic-filtering-wait-time`: Maximum waiting time for the dynamic filter to be ready, default to 0ms. (This feature requires the time of nodes in cluster to be highly sync-up)
|
||||
- `dynamic-filtering-wait-time`: Maximum waiting time for the dynamic filter to be ready, default to 1s. (This feature requires the time of nodes in cluster to be highly sync-up)
|
||||
- `dynamic-filtering-data-type`: Set dynamic filtering data type, default to BLOOM_FILTER.
|
||||
- `dynamic-filtering-max-size`: Max dynamic filter size, cost based optimizer won't create dynamic filter that has estimate size exceeding this value based on statistics, default to 1000000.
|
||||
- `dynamic-filtering-max-per-driver-size`: Max data size collected for dynamic filter per driver, default to 1MB.
|
||||
|
|
|
|||
|
|
@ -491,14 +491,14 @@ Heuristic index is external index module that which can be used to filter to out
|
|||
### `hetu.heuristicindex.filter.cache.max-memory`
|
||||
|
||||
> - **Type:** `data size`
|
||||
> - **Default value:** `1GB`
|
||||
> - **Default value:** `10GB`
|
||||
>
|
||||
> Caching the index files provides better performance, index files are read only and modified very rarely. Caching saves time spent on reading the files from indexstore. This property controls the maximum memory used by the index cache. When limit exceeded, existing entries will be removed from cache based on LRU and new entry will be added to cache.
|
||||
|
||||
### `hetu.heuristicindex.filter.cache.soft-reference`
|
||||
|
||||
> - **Type:** `boolean`
|
||||
> - **Default value:** `false`
|
||||
> - **Default value:** `true`
|
||||
>
|
||||
> Caching the index files provides better performance, however it utilizes memory. Enabling this property allows the Garbage Collector to remove entries from the cache if memory is running low.
|
||||
>
|
||||
|
|
@ -507,14 +507,14 @@ Heuristic index is external index module that which can be used to filter to out
|
|||
### `hetu.heuristicindex.filter.cache.ttl`
|
||||
|
||||
> - **Type:** `Duration`
|
||||
> - **Default value:** `1h`
|
||||
> - **Default value:** `24h`
|
||||
>
|
||||
> The time period after which index cache expires.
|
||||
|
||||
### `hetu.heuristicindex.filter.cache.loading-threads`
|
||||
|
||||
> - **Type:** `integer`
|
||||
> - **Default value:** `2`
|
||||
> - **Default value:** `10`
|
||||
>
|
||||
> The number of threads used to load indices in parallel.
|
||||
|
||||
|
|
@ -553,14 +553,14 @@ of constructing another execution plan, thus reducing the amount of query pre-pr
|
|||
### `hetu.executionplan.cache.limit`
|
||||
>
|
||||
> - **Type:** `integer`
|
||||
> - **Default value:** `1000`
|
||||
> - **Default value:** `10000`
|
||||
>
|
||||
> Maximum number of execution plans to keep in the cache
|
||||
|
||||
### `hetu.executionplan.cache.timeout`
|
||||
>
|
||||
> - **Type:** `integer`
|
||||
> - **Default value:** `60000 ms`
|
||||
> - **Default value:** `86400000 ms`
|
||||
>
|
||||
> Time in milliseconds to expire cached execution plans after the last access
|
||||
|
||||
|
|
|
|||
|
|
@ -286,20 +286,20 @@ files that are matching the predicates provided via `cache table` sql statement.
|
|||
| Property Name | Description | Default |
|
||||
| :----------------------------------------- | :--------------------------------------------------- | :-------- |
|
||||
| `hive.orc.file-tail.cache.enabled` | Enable ORC file tail cache | `false` |
|
||||
| `hive.orc.file-tail.cache.ttl` | TTL for ORC file tail cache | `30 mins` |
|
||||
| `hive.orc.file-tail.cache.limit` | Maximum number of entries in ORC file tail cache | `10,000` |
|
||||
| `hive.orc.file-tail.cache.ttl` | TTL for ORC file tail cache | `4 hours` |
|
||||
| `hive.orc.file-tail.cache.limit` | Maximum number of entries in ORC file tail cache | `50,000` |
|
||||
| `hive.orc.stripe-footer.cache.enabled` | Enable ORC stripe footer cache | `false` |
|
||||
| `hive.orc.stripe-footer.cache.ttl` | TTL for ORC stripe footer cache | `30 mins` |
|
||||
| `hive.orc.stripe-footer.cache.limit` | Maximum number of entries in ORC Stripe footer cache | `25,000` |
|
||||
| `hive.orc.stripe-footer.cache.ttl` | TTL for ORC stripe footer cache | `4 hours` |
|
||||
| `hive.orc.stripe-footer.cache.limit` | Maximum number of entries in ORC Stripe footer cache | `250,000` |
|
||||
| `hive.orc.row-index.cache.enabled` | Enable ORC row index cache | `false` |
|
||||
| `hive.orc.row-index.cache.ttl` | TTL for ORC row index cache | `30 mins` |
|
||||
| `hive.orc.row-index.cache.limit` | Maximum number of entries in ORC row index cache | `50,000` |
|
||||
| `hive.orc.row-index.cache.ttl` | TTL for ORC row index cache | `4 hours` |
|
||||
| `hive.orc.row-index.cache.limit` | Maximum number of entries in ORC row index cache | `250,000` |
|
||||
| `hive.orc.bloom-filters.cache.enabled` | Enable ORC bloom filter cache | `false` |
|
||||
| `hive.orc.bloom-filters.cache.ttl` | TTL for ORC bloom filter cache | `30 mins` |
|
||||
| `hive.orc.bloom-filters.cache.limit` | Maximum number of entries in ORC bloom filter cache | `50,000` |
|
||||
| `hive.orc.bloom-filters.cache.ttl` | TTL for ORC bloom filter cache | `4 hours` |
|
||||
| `hive.orc.bloom-filters.cache.limit` | Maximum number of entries in ORC bloom filter cache | `250,000` |
|
||||
| `hive.orc.row-data.block.cache.enabled` | Enable ORC row group block cache | `false` |
|
||||
| `hive.orc.row-data.block.cache.ttl` | TTL for ORC row group cache | `30 mins` |
|
||||
| `hive.orc.row-data.block.cache.max.weight` | Maximum weight of ORC row group cache | `500 MB` |
|
||||
| `hive.orc.row-data.block.cache.ttl` | TTL for ORC row group cache | `4 hours` |
|
||||
| `hive.orc.row-data.block.cache.max.weight` | Maximum weight of ORC row group cache | `20 GB` |
|
||||
|
||||
TTL is time taken since cache entry was last accessed by read or write. Timed expiration is performed with periodic maintenance during writes
|
||||
and occasionally during reads, as discussed below.
|
||||
|
|
|
|||
|
|
@ -22,7 +22,7 @@ dynamic-filtering-bloom-filter-fpp=0.1
|
|||
上述属性说明如下:
|
||||
|
||||
- `enable-dynamic-filtering`:是否开启动态过滤特性。
|
||||
- `dynamic-filtering-wait-time`:等待动态过滤条件生成的最长等待时间,默认值是0ms。(该配置要求集群不同节点之间的时间高度同步)
|
||||
- `dynamic-filtering-wait-time`:等待动态过滤条件生成的最长等待时间,默认值是1s。(该配置要求集群不同节点之间的时间高度同步)
|
||||
- `dynamic-filtering-data-type`:设置动态过滤类型,可选包含`BLOOM_FILTER`以及`HASHSET`,默认类型为`BLOOM_FILTER`。
|
||||
- `dynamic-filtering-max-size`: 每个dynamic filter的大小上限,如果预估大小超过设定值,代价优化器不会生成对应的dynamic filter,默认值是1000000。
|
||||
- `dynamic-filtering-max-per-driver-size`:每个driver可以收集的数据大小上限,默认值是1MB。
|
||||
|
|
|
|||
|
|
@ -456,14 +456,14 @@
|
|||
### `hetu.heuristicindex.filter.cache.max-memory`
|
||||
|
||||
> - **类型:** `data size`
|
||||
> - **默认值:** `1GB`
|
||||
> - **默认值:** `10GB`
|
||||
>
|
||||
> 由于索引文件很少被改动,将索引缓存可以提升性能,减少从文件系统读取索引所需时间。这一属性控制索引缓存允许使用的内存大小,当缓存已满,最旧的缓存将被移除,由新的缓存替代(LRU缓存)。
|
||||
|
||||
### `hetu.heuristicindex.filter.cache.soft-reference`
|
||||
|
||||
> - **类型:** `boolean`
|
||||
> - **默认值:** `false`
|
||||
> - **默认值:** `true`
|
||||
>
|
||||
> 缓存索引可以提供更好的性能,但是需要使用一部分内存空间。启用这一属性将允许垃圾回收器(GC)在内存不足时从缓存中清除内容来释放内存。
|
||||
>
|
||||
|
|
@ -472,14 +472,14 @@
|
|||
### `hetu.heuristicindex.filter.cache.ttl`
|
||||
|
||||
> - 类型:`Duration`
|
||||
> - **默认值:** `1h`
|
||||
> - **默认值:** `24h`
|
||||
>
|
||||
> 索引缓存的有效时间。
|
||||
|
||||
### `hetu.heuristicindex.filter.cache.loading-threads`
|
||||
|
||||
> - 类型:`integer`
|
||||
> - **默认值:** `2`
|
||||
> - **默认值:** `10`
|
||||
>
|
||||
> 从索引存储文件系统并行加载索引时使用的线程数量。
|
||||
|
||||
|
|
@ -517,14 +517,14 @@
|
|||
### `hetu.executionplan.cache.limit`
|
||||
|
||||
> - **类型:** `integer`
|
||||
> - **默认值:** `1000`
|
||||
> - **默认值:** `10000`
|
||||
>
|
||||
> 保留在缓存中的最大执行计划数
|
||||
|
||||
### `hetu.executionplan.cache.timeout`
|
||||
|
||||
> - **类型:** `integer`
|
||||
> - **默认值:** `60000 ms`
|
||||
> - **默认值:** `86400000 ms`
|
||||
>
|
||||
> 上次访问后使缓存的执行计划失效的时间(以毫秒为单位)
|
||||
|
||||
|
|
|
|||
|
|
@ -254,20 +254,20 @@ Hive连接器缓存ORC文件数据,以提供更好的性能并减少查询时
|
|||
| 属性名称| 说明| 默认值|
|
||||
|:----------|:----------|:----------|
|
||||
| `hive.orc.file-tail.cache.enabled`| 启用ORC文件尾缓存| `false`|
|
||||
| `hive.orc.file-tail.cache.ttl`| ORC文件尾缓存TTL| `30 mins`|
|
||||
| `hive.orc.file-tail.cache.limit`| ORC文件尾缓存最大条目数| `10,000`|
|
||||
| `hive.orc.file-tail.cache.ttl`| ORC文件尾缓存TTL| `4 hours`|
|
||||
| `hive.orc.file-tail.cache.limit`| ORC文件尾缓存最大条目数| `50,000`|
|
||||
| `hive.orc.stripe-footer.cache.enabled`| 启用ORC分条页脚缓存| `false`|
|
||||
| `hive.orc.stripe-footer.cache.ttl`| ORC分条页脚缓存的TTL| `30 mins`|
|
||||
| `hive.orc.stripe-footer.cache.limit`| ORC分条页脚缓存最大条目数| `25,000`|
|
||||
| `hive.orc.stripe-footer.cache.ttl`| ORC分条页脚缓存的TTL| `4 hours`|
|
||||
| `hive.orc.stripe-footer.cache.limit`| ORC分条页脚缓存最大条目数| `250,000`|
|
||||
| `hive.orc.row-index.cache.enabled`| 启用ORC行索引缓存| `false`|
|
||||
| `hive.orc.row-index.cache.ttl`| ORC行索引缓存TTL| `30 mins`|
|
||||
| `hive.orc.row-index.cache.limit`| ORC行索引缓存最大条目数| `50,000`|
|
||||
| `hive.orc.row-index.cache.ttl`| ORC行索引缓存TTL| `4 hours`|
|
||||
| `hive.orc.row-index.cache.limit`| ORC行索引缓存最大条目数| `250,000`|
|
||||
| `hive.orc.bloom-filters.cache.enabled`| 启用ORC布隆过滤器缓存| `false`|
|
||||
| `hive.orc.bloom-filters.cache.ttl`| ORC布隆过滤器缓存TTL| `30 mins`|
|
||||
| `hive.orc.bloom-filters.cache.limit`| ORC布隆过滤器缓存最大条目数| `50,000`|
|
||||
| `hive.orc.bloom-filters.cache.ttl`| ORC布隆过滤器缓存TTL| `4 hours`|
|
||||
| `hive.orc.bloom-filters.cache.limit`| ORC布隆过滤器缓存最大条目数| `250,000`|
|
||||
| `hive.orc.row-data.block.cache.enabled`| 启用ORC行组块缓存| `false`|
|
||||
| `hive.orc.row-data.block.cache.ttl`| ORC行组缓存TTL| `30 mins`|
|
||||
| `hive.orc.row-data.block.cache.max.weight`| ORC行组缓存最大权重。| `500 MB`|
|
||||
| `hive.orc.row-data.block.cache.ttl`| ORC行组缓存TTL| `4 hours`|
|
||||
| `hive.orc.row-data.block.cache.max.weight`| ORC行组缓存最大权重。| `20 GB`|
|
||||
|
||||
TTL: 是指自最后一次读写cache到现在的时间间隔。如后文所讲, 在写cache阶段会周期性执行时间过期验证,在读cache的时也会触发过期验证。
|
||||
|
||||
|
|
|
|||
|
|
@ -40,7 +40,10 @@ import java.util.Optional;
|
|||
import java.util.TimeZone;
|
||||
import java.util.concurrent.TimeUnit;
|
||||
|
||||
import static io.airlift.units.DataSize.Unit.BYTE;
|
||||
import static io.airlift.units.DataSize.Unit.GIGABYTE;
|
||||
import static io.airlift.units.DataSize.Unit.MEGABYTE;
|
||||
import static java.util.concurrent.TimeUnit.HOURS;
|
||||
import static java.util.concurrent.TimeUnit.MINUTES;
|
||||
|
||||
@DefunctConfig({
|
||||
|
|
@ -121,7 +124,7 @@ public class HiveConfig
|
|||
private double orcDefaultBloomFilterFpp = 0.05;
|
||||
private DataSize orcMaxMergeDistance = new DataSize(1, MEGABYTE);
|
||||
private DataSize orcMaxBufferSize = new DataSize(8, MEGABYTE);
|
||||
private DataSize orcTinyStripeThreshold = new DataSize(8, MEGABYTE);
|
||||
private DataSize orcTinyStripeThreshold = new DataSize(1, BYTE);
|
||||
private DataSize orcStreamBufferSize = new DataSize(8, MEGABYTE);
|
||||
private DataSize orcMaxReadBlockSize = new DataSize(16, MEGABYTE);
|
||||
private boolean orcLazyReadSmallRanges = true;
|
||||
|
|
@ -130,20 +133,20 @@ public class HiveConfig
|
|||
private OrcWriteValidationMode orcWriterValidationMode = OrcWriteValidationMode.BOTH;
|
||||
|
||||
private boolean orcFileTailCacheEnabled;
|
||||
private Duration orcFileTailCacheTtl = new Duration(30, MINUTES);
|
||||
private long orcFileTailCacheLimit = 10_000;
|
||||
private Duration orcFileTailCacheTtl = new Duration(4, HOURS);
|
||||
private long orcFileTailCacheLimit = 50_000;
|
||||
private boolean orcStripeFooterCacheEnabled;
|
||||
private Duration orcStripeFooterCacheTtl = new Duration(30, MINUTES);
|
||||
private long orcStripeFooterCacheLimit = 25_000;
|
||||
private Duration orcStripeFooterCacheTtl = new Duration(4, HOURS);
|
||||
private long orcStripeFooterCacheLimit = 250_000;
|
||||
private boolean orcRowIndexCacheEnabled;
|
||||
private Duration orcRowIndexCacheTtl = new Duration(30, MINUTES);
|
||||
private long orcRowIndexCacheLimit = 50_000;
|
||||
private Duration orcRowIndexCacheTtl = new Duration(4, HOURS);
|
||||
private long orcRowIndexCacheLimit = 250_000;
|
||||
private boolean orcBloomFiltersCacheEnabled;
|
||||
private Duration orcBloomFiltersCacheTtl = new Duration(30, MINUTES);
|
||||
private long orcBloomFiltersCacheLimit = 50_000;
|
||||
private Duration orcBloomFiltersCacheTtl = new Duration(4, HOURS);
|
||||
private long orcBloomFiltersCacheLimit = 250_000;
|
||||
private boolean orcRowDataCacheEnabled;
|
||||
private Duration orcRowDataCacheTtl = new Duration(30, MINUTES);
|
||||
private DataSize orcRowDataCacheMaximumWeight = new DataSize(500, MEGABYTE);
|
||||
private Duration orcRowDataCacheTtl = new Duration(4, HOURS);
|
||||
private DataSize orcRowDataCacheMaximumWeight = new DataSize(20, GIGABYTE);
|
||||
|
||||
private boolean rcfileWriterValidate;
|
||||
|
||||
|
|
@ -178,7 +181,7 @@ public class HiveConfig
|
|||
private boolean temporaryStagingDirectoryEnabled = true;
|
||||
private String temporaryStagingDirectoryPath = "/tmp/presto-${USER}";
|
||||
|
||||
private Duration fileStatusCacheExpireAfterWrite = new Duration(1, TimeUnit.MINUTES);
|
||||
private Duration fileStatusCacheExpireAfterWrite = new Duration(24, TimeUnit.HOURS);
|
||||
private long fileStatusCacheMaxSize = 1000 * 1000;
|
||||
private List<String> fileStatusCacheTables = ImmutableList.of();
|
||||
|
||||
|
|
|
|||
|
|
@ -78,7 +78,7 @@ public final class HiveTestUtils
|
|||
}
|
||||
|
||||
public static final ConnectorSession SESSION = new TestingConnectorSession(
|
||||
new HiveSessionProperties(new HiveConfig(), new OrcFileWriterConfig(), new ParquetFileWriterConfig()).getSessionProperties());
|
||||
new HiveSessionProperties(new HiveConfig().setOrcLazyReadSmallRanges(false), new OrcFileWriterConfig(), new ParquetFileWriterConfig()).getSessionProperties());
|
||||
|
||||
private static final Metadata METADATA = createTestMetadataManager();
|
||||
public static final TypeManager TYPE_MANAGER = new InternalTypeManager(METADATA);
|
||||
|
|
|
|||
|
|
@ -28,6 +28,7 @@ import java.util.Map;
|
|||
import java.util.TimeZone;
|
||||
import java.util.concurrent.TimeUnit;
|
||||
|
||||
import static io.airlift.units.DataSize.Unit.GIGABYTE;
|
||||
import static io.airlift.units.DataSize.Unit.MEGABYTE;
|
||||
import static io.prestosql.plugin.hive.TestHiveUtil.nonDefaultTimeZone;
|
||||
|
||||
|
|
@ -91,13 +92,13 @@ public class TestHiveConfig
|
|||
.setOrcMaxMergeDistance(new DataSize(1, Unit.MEGABYTE))
|
||||
.setOrcMaxBufferSize(new DataSize(8, Unit.MEGABYTE))
|
||||
.setOrcStreamBufferSize(new DataSize(8, Unit.MEGABYTE))
|
||||
.setOrcTinyStripeThreshold(new DataSize(8, Unit.MEGABYTE))
|
||||
.setOrcTinyStripeThreshold(new DataSize(1, Unit.BYTE))
|
||||
.setOrcMaxReadBlockSize(new DataSize(16, Unit.MEGABYTE))
|
||||
.setOrcFileTailCacheEnabled(false).setOrcFileTailCacheTtl(new Duration(30, TimeUnit.MINUTES)).setOrcFileTailCacheLimit(10_000)
|
||||
.setOrcStripeFooterCacheEnabled(false).setOrcStripeFooterCacheTtl(new Duration(30, TimeUnit.MINUTES)).setOrcStripeFooterCacheLimit(25_000)
|
||||
.setOrcRowIndexCacheEnabled(false).setOrcRowIndexCacheTtl(new Duration(30, TimeUnit.MINUTES)).setOrcRowIndexCacheLimit(50_000)
|
||||
.setOrcBloomFiltersCacheEnabled(false).setOrcBloomFiltersCacheTtl(new Duration(30, TimeUnit.MINUTES)).setOrcBloomFiltersCacheLimit(50_000)
|
||||
.setOrcRowDataCacheEnabled(false).setOrcRowDataCacheTtl(new Duration(30, TimeUnit.MINUTES)).setOrcRowDataCacheMaximumWeight(new DataSize(500, MEGABYTE))
|
||||
.setOrcFileTailCacheEnabled(false).setOrcFileTailCacheTtl(new Duration(4, TimeUnit.HOURS)).setOrcFileTailCacheLimit(50_000)
|
||||
.setOrcStripeFooterCacheEnabled(false).setOrcStripeFooterCacheTtl(new Duration(4, TimeUnit.HOURS)).setOrcStripeFooterCacheLimit(250_000)
|
||||
.setOrcRowIndexCacheEnabled(false).setOrcRowIndexCacheTtl(new Duration(4, TimeUnit.HOURS)).setOrcRowIndexCacheLimit(250_000)
|
||||
.setOrcBloomFiltersCacheEnabled(false).setOrcBloomFiltersCacheTtl(new Duration(4, TimeUnit.HOURS)).setOrcBloomFiltersCacheLimit(250_000)
|
||||
.setOrcRowDataCacheEnabled(false).setOrcRowDataCacheTtl(new Duration(4, TimeUnit.HOURS)).setOrcRowDataCacheMaximumWeight(new DataSize(20, GIGABYTE))
|
||||
.setOrcLazyReadSmallRanges(true)
|
||||
.setRcfileWriterValidate(false)
|
||||
.setOrcWriteLegacyVersion(false)
|
||||
|
|
@ -125,7 +126,7 @@ public class TestHiveConfig
|
|||
.setS3SelectPushdownMaxConnections(500)
|
||||
.setTemporaryStagingDirectoryEnabled(true)
|
||||
.setTemporaryStagingDirectoryPath("/tmp/presto-${USER}")
|
||||
.setFileStatusCacheExpireAfterWrite(new Duration(1, TimeUnit.MINUTES))
|
||||
.setFileStatusCacheExpireAfterWrite(new Duration(24, TimeUnit.HOURS))
|
||||
.setFileStatusCacheMaxSize(1000 * 1000)
|
||||
.setFileStatusCacheTables("")
|
||||
.setHiveTransactionHeartbeatInterval(null)
|
||||
|
|
|
|||
|
|
@ -139,7 +139,7 @@ public class FeaturesConfig
|
|||
|
||||
private Duration iterativeOptimizerTimeout = new Duration(3, MINUTES); // by default let optimizer wait a long time in case it retrieves some data from ConnectorMetadata
|
||||
private boolean enableDynamicFiltering;
|
||||
private Duration dynamicFilteringWaitTime = new Duration(0, MILLISECONDS);
|
||||
private Duration dynamicFilteringWaitTime = new Duration(1000, MILLISECONDS);
|
||||
private int dynamicFilteringMaxSize = 1000000;
|
||||
private int dynamicFilteringMaxPerDriverRowCount = 10000;
|
||||
private DynamicFilterDataType dynamicFilteringDataType = BLOOM_FILTER;
|
||||
|
|
|
|||
|
|
@ -35,11 +35,11 @@ import static io.airlift.units.DataSize.Unit.GIGABYTE;
|
|||
public class HetuConfig
|
||||
{
|
||||
private Boolean enableFilter = Boolean.FALSE;
|
||||
private DataSize indexCacheMaxMemory = new DataSize(1, GIGABYTE);
|
||||
private long indexCacheLoadingThreads = 2L;
|
||||
private DataSize indexCacheMaxMemory = new DataSize(10, GIGABYTE);
|
||||
private long indexCacheLoadingThreads = 10L;
|
||||
private Duration indexCacheLoadingDelay = new Duration(10, TimeUnit.SECONDS);
|
||||
private Duration indexCacheTTL = new Duration(1, TimeUnit.HOURS);
|
||||
private Boolean indexCacheSoftReference = Boolean.FALSE;
|
||||
private Duration indexCacheTTL = new Duration(24, TimeUnit.HOURS);
|
||||
private Boolean indexCacheSoftReference = Boolean.TRUE;
|
||||
private String indexStoreUri = "/opt/hetu/indices/";
|
||||
private String indexStoreFileSystemProfile = "local-config-default";
|
||||
private Boolean enableEmbeddedStateStore = Boolean.FALSE;
|
||||
|
|
@ -51,8 +51,8 @@ public class HetuConfig
|
|||
private int dataCenterSplits = 5;
|
||||
private Duration dataCenterConsumerTimeout = new Duration(10, TimeUnit.MINUTES);
|
||||
private boolean executionPlanCacheEnabled;
|
||||
private long executionPlanCacheMaxItems = 1000L;
|
||||
private long executionPlanCacheTimeout = 60000L;
|
||||
private long executionPlanCacheMaxItems = 10000L;
|
||||
private long executionPlanCacheTimeout = 86400000L;
|
||||
private boolean splitCacheMapEnabled = Boolean.FALSE;
|
||||
private Duration splitCacheStateUpdateInterval = new Duration(2, TimeUnit.SECONDS);
|
||||
private boolean isTraceStackVisible;
|
||||
|
|
|
|||
|
|
@ -117,7 +117,7 @@ public class TestFeaturesConfig
|
|||
.setEnableDynamicFiltering(false)
|
||||
.setDynamicFilteringMaxPerDriverRowCount(10000)
|
||||
.setDynamicFilteringDataType(BLOOM_FILTER)
|
||||
.setDynamicFilteringWaitTime(new Duration(0, MILLISECONDS))
|
||||
.setDynamicFilteringWaitTime(new Duration(1000, MILLISECONDS))
|
||||
.setDynamicFilteringMaxSize(1000000)
|
||||
.setDynamicFilteringMaxPerDriverSize(new DataSize(1, MEGABYTE))
|
||||
.setDynamicFilteringBloomFilterFpp(0.1)
|
||||
|
|
|
|||
|
|
@ -34,14 +34,14 @@ public class TestHetuConfig
|
|||
.setFilterEnabled(false)
|
||||
.setIndexStoreUri("/opt/hetu/indices/")
|
||||
.setIndexStoreFileSystemProfile("local-config-default")
|
||||
.setIndexCacheMaxMemory(new DataSize(1, GIGABYTE))
|
||||
.setIndexCacheTTL(new Duration(1, TimeUnit.HOURS))
|
||||
.setIndexCacheLoadingThreads(2L)
|
||||
.setIndexCacheMaxMemory(new DataSize(10, GIGABYTE))
|
||||
.setIndexCacheTTL(new Duration(24, TimeUnit.HOURS))
|
||||
.setIndexCacheLoadingThreads(10L)
|
||||
.setIndexCacheLoadingDelay(new Duration(10, TimeUnit.SECONDS))
|
||||
.setIndexCacheSoftReferenceEnabled(false)
|
||||
.setIndexCacheSoftReferenceEnabled(true)
|
||||
.setExecutionPlanCacheEnabled(false)
|
||||
.setExecutionPlanCacheTimeout(60000L)
|
||||
.setExecutionPlanCacheMaxItems(1000L)
|
||||
.setExecutionPlanCacheTimeout(86400000L)
|
||||
.setExecutionPlanCacheMaxItems(10000L)
|
||||
.setEmbeddedStateStoreEnabled(false)
|
||||
.setMultipleCoordinatorEnabled(false)
|
||||
.setStateFetchInterval(new Duration(100, TimeUnit.MILLISECONDS))
|
||||
|
|
@ -66,10 +66,10 @@ public class TestHetuConfig
|
|||
.put("hetu.heuristicindex.filter.cache.loading-threads", "5")
|
||||
.put("hetu.heuristicindex.filter.cache.loading-delay", "1000ms")
|
||||
.put("hetu.heuristicindex.filter.cache.ttl", "20m")
|
||||
.put("hetu.heuristicindex.filter.cache.soft-reference", "true")
|
||||
.put("hetu.heuristicindex.filter.cache.soft-reference", "false")
|
||||
.put("hetu.executionplan.cache.enabled", "true")
|
||||
.put("hetu.executionplan.cache.timeout", "6000")
|
||||
.put("hetu.executionplan.cache.limit", "10000")
|
||||
.put("hetu.executionplan.cache.limit", "20000")
|
||||
.put("hetu.embedded-state-store.enabled", "true")
|
||||
.put("hetu.multiple-coordinator.enabled", "true")
|
||||
.put("hetu.multiple-coordinator.query-submit-timeout", "20s")
|
||||
|
|
@ -91,10 +91,10 @@ public class TestHetuConfig
|
|||
.setIndexCacheTTL(new Duration(20, TimeUnit.MINUTES))
|
||||
.setIndexCacheLoadingThreads(5L)
|
||||
.setIndexCacheLoadingDelay(new Duration(1000, TimeUnit.MILLISECONDS))
|
||||
.setIndexCacheSoftReferenceEnabled(true)
|
||||
.setIndexCacheSoftReferenceEnabled(false)
|
||||
.setExecutionPlanCacheEnabled(true)
|
||||
.setExecutionPlanCacheTimeout(6000L)
|
||||
.setExecutionPlanCacheMaxItems(10000L)
|
||||
.setExecutionPlanCacheMaxItems(20000L)
|
||||
.setEmbeddedStateStoreEnabled(true)
|
||||
.setMultipleCoordinatorEnabled(true)
|
||||
.setQuerySubmitTimeout(new Duration(20, TimeUnit.SECONDS))
|
||||
|
|
|
|||
Loading…
Reference in New Issue