# Tenzir Node v2.3.0 ## 馃殌 Features ### Cloud matchers Aug 25, 2022 路 [@rdettai](https://github.com/rdettai) 路 [#2473](https://github.com/tenzir/tenzir/pull/2473) We can now use matchers in AWS using the vast-cloud CLI matcher plugin. ### Make the connection timeout configurable Aug 16, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2499](https://github.com/tenzir/tenzir/pull/2499) The new `vast.connection-timeout` option allows for configuring the timeout VAST clients use when connecting to a VAST server. The value defaults to 10s; setting it to a zero duration causes produces an infinite timeout. ### Make the `rebuild` command more reliable Aug 16, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2493](https://github.com/tenzir/tenzir/pull/2493) VAST now continuously rebuilds outdated and merges undersized partitions in the background. The new option `vast.automatic-rebuild` controls how many resources to spend on this. To disable this behavior, set the option to 0; the default is 1. Rebuilding now emits metrics under the keys `rebuilder.partitions.{remaining,rebuilding,completed}`. The `vast status rebuild` command additionally shows information about the ongoing rebuild. ### Implement optional dense indexes Aug 8, 2022 路 [@patszt](https://github.com/patszt) 路 [#2430](https://github.com/tenzir/tenzir/pull/2430) VAST鈥檚 partition indexes are now optional, allowing operators to control the trade-off between disk-usage and query performance for every field. ## 馃敡 Changes ### Make the `rebuild` command more reliable Aug 16, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2493](https://github.com/tenzir/tenzir/pull/2493) The default value for `vast.active-partition-timeout` is now 5 minutes (down from 1 hour), causing VAST to persist underful partitions earlier. We split the `vast rebuild` command into two: `vast rebuild start` and `vast rebuild stop`. Rebuild orchestration now runs server-side, and only a single rebuild may run at a given time. We also made it more intuitive to use: `--undersized` now implies `--all`, and a new `--detached` option allows for running rebuilds in the background. ### Lower the impact of low-priority queries Aug 8, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2484](https://github.com/tenzir/tenzir/pull/2484) We improved the operability of VAST servers under high load from automated low-priority queries. VAST now considers queries issued with `--low-priority`, such as automated retro-match queries, with even less priority compared to regular queries (down from 33.3% to 4%) and internal high-priority queries used for rebuilding and compaction (down from 12.5% to 1%). ## 馃悶 Bug Fixes ### Don鈥檛 abort startup if individual partitions fail to load Sep 23, 2022 路 [@tobim](https://github.com/tobim) 路 [#2515](https://github.com/tenzir/tenzir/pull/2515) The `rebuild` command, automatic rebuilds, and compaction are now much faster, and match the performance of the `import` command for building indexes. ### Wait until all stores have exited before finishing a partition transform Aug 31, 2022 路 [@lava](https://github.com/lava) 路 [#2543](https://github.com/tenzir/tenzir/pull/2543) Fixed a race condition where the output of a partition transform could be reused before it was fully written to disk, for example when running `vast rebuild`. ### Activate cloud plugins explicitely Aug 29, 2022 路 [@rdettai](https://github.com/rdettai) 路 [#2510](https://github.com/tenzir/tenzir/pull/2510) We changed the way `vast-cloud` is loading its cloud plugins to make it more explicit. This avoids inconsitent defaults assigned to variables when using core commands on specific plugins. ### Implement a flatbuffer container class to hold excess table slices in segments Aug 23, 2022 路 [@lava](https://github.com/lava) 路 [#2449](https://github.com/tenzir/tenzir/pull/2449) VAST can now store data in segments bigger than 2GiB in size each. VAST can now store column indexes that are bigger than 2GiB. ### Respect `--connection-timeout` in more places Aug 22, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2503](https://github.com/tenzir/tenzir/pull/2503) Configuration options representing durations with an associated command-line option like `vast.connection-timeout` and `--connection-timeout` were not picked up from configuration files or environment variables. This now works as expected. ### Display store load failures to the user Aug 19, 2022 路 [@dominiklohmann](https://github.com/dominiklohmann) 路 [#2507](https://github.com/tenzir/tenzir/pull/2507) Partitions now fail early when their stores fail to load from disk, detailing what went wrong in an error message. ### Add active partition actor to unpersisted partitions on decomission Aug 16, 2022 路 [@patszt](https://github.com/patszt) 路 [#2500](https://github.com/tenzir/tenzir/pull/2500) VAST no longer occasionally prints warnings about no longer available partitions when queries run concurrently to imports. ### Implement optional dense indexes Aug 8, 2022 路 [@patszt](https://github.com/patszt) 路 [#2430](https://github.com/tenzir/tenzir/pull/2430) VAST properly processes queries for fields with `skip` attribute. [ Download on GitHub ](https://github.com/tenzir/tenzir/releases/tag/v2.3.0) [Get the release artifacts and source code.](https://github.com/tenzir/tenzir/releases/tag/v2.3.0)