v0.30.0-rc.0

[bwplotka]

v0.30 brings many important fixes & optimizations to compaction, store gateway, receive replication and querying. Make sure to try the new PromQL engine which is more & more efficient every week.

NOTE: Querier's query.promql-engine flag enabling the new PromQL engine is now unhidden. We encourage users to use new experimental PromQL engine for efficiency reasons.

Furthermore, we recommend you use Redis as a caching client (if you use store GW or query frontend caching) and Ketama algorithm as receiver hashing algorithm ( --receive.hashrings-algorithm=ketama - introducing consistent hashing to receiver).

Enjoy & Happy Christmas Holidays! 🎉

Changes

Fixed

• #5716 DNS: Fix miekgdns resolver LookupSRV to work with CNAME records.
• #5844 Query Frontend: Fixes @ modifier time range when splitting queries by interval.
• #5854 Query Frontend: lookback_delta param is now handled in query frontend.
• #5860 Query: Fixed bug of not showing query warnings in Thanos UI.
• #5856 Store: Fixed handling of debug logging flag.
• #5230 Rule: Stateless ruler support restoring for state from query API servers. The query API servers should be able to access the remote write storage.
• #5880 Query Frontend: Fixes some edge cases of query sharding analysis.
• #5893 Cache: Fixed redis client not respecting SetMultiBatchSize config value.
• #5966 Query: Stop relying on non-existent hints for mint and maxt when selecting series for the api/v1/series HTTP endpoint.
• #5948 Store: chunks_fetched_duration wrong calculation.
• #5910: Receive: Fixed ketama quorum bug that was could cause success response for failed replication. This also optimize heavily receiver CPU use.

Added

• #5814 Store: Added metric thanos_bucket_store_postings_size_bytes that shows the distribution of how many postings (in bytes) were needed for each Series() call in Thanos Store. Useful for determining limits.
• #5703 StoreAPI: Added hash field to series' chunks. Store gateway and receive implements that field and proxy leverage that for quicker deduplication.
• #5801 Store: Added a new flag --store.grpc.downloaded-bytes-limit that limits the number of bytes downloaded in each Series/LabelNames/LabelValues call. Use thanos_bucket_store_postings_size_bytes for determining the limits.
• #5836 Receive: Added hidden flag tsdb.memory-snapshot-on-shutdown to enable experimental TSDB feature to snapshot on shutdown. This is intended to speed up receiver restart.
• #5839 Receive: Added parameter --tsdb.out-of-order.time-window to set time window for experimental out-of-order samples ingestion. Disabled by default (set to 0s). Please note if you enable this option and you use compactor, make sure you set the --enable-vertical-compaction flag, otherwise you might risk compactor halt.
• #5889 Query Frontend: Added support for vertical sharding label_replace and label_join functions.
• #5865 Compact: Retry on sync metas error.
• #5819 Store: Added a few objectives for Store's data summaries (touched/fetched amount and sizes). They are: 50, 95, and 99 quantiles.
• #5837 Store: Added streaming retrival of series from object storage.
• #5940 Objstore: Support for authenticating to Swift using application credentials.
• #5945 Tools: Added new no-downsample marker to skip blocks when downsampling via thanos tools bucket mark --marker=no-downsample-mark.json. This will skip downsampling for blocks with the new marker.
• #5977 Tools: Added remove flag on bucket mark command to remove deletion, no-downsample or no-compact markers on the block

Changed

• #5785 Query: thanos_store_nodes_grpc_connections now trimms external_labels label name longer than 1000 character. It also allows customizations in what labels to preserve using query.conn-metric.label flag.
• #5542 Mixin: Added query concurrency panel to Querier dashboard.
• #5846 Query Frontend: vertical query sharding supports subqueries.
• #5909 Receive: Compact tenant head after no appends have happened for 1.5 tsdb.max-block-size.
• #5593 Cache: Switched Redis client to Rueidis. Rueidis is faster and provides client-side caching. It is highly recommended to use it so that repeated requests for the same key would not be needed.
• #5896 *: Upgraded Prometheus to v0.40.7 without implementing native histogram support. Querying native histograms will fail with Error executing query: invalid chunk encoding "<unknown>" and native histograms in write requests are ignored.
• #5838 Mixin: Added data touched type to Store dashboard.
• #5922 Compact: Retry on clean, partial marked errors when possible.

Removed

• #5824 Mixin: Remove noisy ThanosReceiveTrafficBelowThreshold alert.

New Contributors

• @rajivharlalka made their first contribution in [IMPROVEMENT]Fix Typo's in recieve.md #5631
• @Atharva-Shinde made their first contribution in Feature: Fix miekgdns resolver LookupSRV function to work with CNAME records too #5716
• @clwluvw made their first contribution in store: add missing debugLogging set #5856
• @VicThomas made their first contribution in Update 2022-09-08-thanos-at-medallia.md #5884
• @karster made their first contribution in change Hyperia logo #5886
• @sumanpaikdev made their first contribution in Update README.md #5868
• @abbyssoul made their first contribution in Cache: Fixed redis cache to use multi batch size config value #5893
• @juanrh made their first contribution in query:Avoid creating aux slice in removeExactDuplicates #5795
• @hyder made their first contribution in docs: Updated documentation for OCI Object Storage, added link to blog post #5928
• @aarnq made their first contribution in objstore: Update to latest #5940
• @4orty made their first contribution in add kakaopay as adoptors #5953
• @jatinagwal made their first contribution in fixed blog list view in website #5967
• @RohitKochhar made their first contribution in Added tools bucket marker for no-downsample.json #5945
• @rabenhorst made their first contribution in Update Prometheus to v0.40.1 #5896
• @kama910 made their first contribution in Changing store to match debug level #5981
• @Vishvsalvi made their first contribution in Github link to v0.25.2 #5979
• @maheshbaliga made their first contribution in tools: Added remove flag on bucket mark command to remove deletion, no-downsample or no-compact markers on the block #5977

Commits

• CHANGELOG: mark 0.29.0 as in progress by @GiedriusS in CHANGELOG: mark 0.29.0 as in progress #5808
• store: add histogram for postings size by @GiedriusS in store: add histogram for postings size #5814
• Store/Receivers: Calculating chunk hashes on stores/receivers by @pedro-stanaka in Store/Receivers: Calculating chunk hashes on stores/receivers #5703
• Use pre-calculated hashes by @fpetkovski in Use pre-calculated hashes #5817
• Short-circuit chunk dedup in proxy by @fpetkovski in Short-circuit chunk dedup in proxy #5816
• deps: Updated promql-engine to latest. by @bwplotka in deps: Updated promql-engine to latest. #5821
• Query: Trim very long external labels and add cmd flag to optionally specify metric labels to collect by @utukJ in Query: Trim very long external labels and add cmd flag to optionally specify metric labels to collect #5785
• CircleCI: Replace checkout step with custom command by @matej-g in CircleCI: Replace checkout step with custom command #5829
• store: add downloaded bytes limit by @GiedriusS in store: add downloaded bytes limit #5801
• Mixin: Remove low ingestion rate warning for receiver by @matej-g in Mixin: Remove low ingestion rate warning for receiver #5824
• Mixin: Remove low ingestion rate warning for receiver (fix tests) by @matej-g in Mixin: Remove low ingestion rate warning for receiver (fix tests) #5831
• Fix Typo's in recieve.md by @rajivharlalka in [IMPROVEMENT]Fix Typo's in recieve.md #5631
• add panel Query Concurrency to dashboard mixin. by @raptorsun in add panel Query Concurrency to dashboard mixin. #5542
• docs: Added guide for Community Office Hours shepherding. by @bwplotka in docs: Added guide for Community Office Hours shepherding. #5568
• *: Clean up stale bot config file by @matej-g in *: Clean up stale bot config file #5834
• Receive: Add experimental snapshot on shutdown by @matej-g in Receive: Add experimental snapshot on shutdown #5836
• Feature: Fix miekgdns resolver LookupSRV function to work with CNAME records too by @Atharva-Shinde in Feature: Fix miekgdns resolver LookupSRV function to work with CNAME records too #5716
• Update promql engine by @fpetkovski in Update promql engine #5845
• Receive: Add parameter to set out-of-order time window by @matej-g in Receive: Add parameter to set out-of-order time window #5839
• Apply @ modifier start and end in QF split interval middleware by @yeya24 in Apply @ modifier start and end in QF split interval middleware #5844
• Shard subqueries by @yeya24 in Shard subqueries #5846
• Support lookback_delta on query frontend by @yeya24 in Support lookback_delta on query frontend  #5854
• Receive: Make out-of-order max cap parameter hidden by @matej-g in Receive: Make out-of-order max cap parameter hidden #5851
• Merge release 0.29 to main by @GiedriusS in Merge release 0.29 to main #5858
• ui: Added back support for warnings printed in info level. by @bwplotka in ui: Added back support for warnings printed in info level. #5860
• store: add missing debugLogging set by @clwluvw in store: add missing debugLogging set #5856
• Added blog space on Thanos website. by @bwplotka in Added blog space on Thanos website. #5873
• Adds medallia blog post by @vanugrah in Adds medallia blog post #5878
• Update 2022-09-08-thanos-at-medallia.md by @VicThomas in Update 2022-09-08-thanos-at-medallia.md #5884
• change Hyperia logo by @karster in change Hyperia logo #5886
• *:Fix stateless ruler config in quickstart by @matej-g in *:Fix stateless ruler config in quickstart #5885
• Stateless ruler restores alert state by @yeya24 in Stateless ruler restores alert state #5230
• Update README.md by @sumanpaikdev in Update README.md #5868
• Fix querysharding labels analysis by @yeya24 in Fix querysharding labels analysis #5880
• *: Fix lint by @matej-g in *: Fix lint #5888
• Cache: Fixed redis cache to use multi batch size config value by @abbyssoul in Cache: Fixed redis cache to use multi batch size config value #5893
• compact: retry on sync metas error by @clwluvw in compact: retry on sync metas error #5865
• Support matrix type response merge for instant query sharding by @yeya24 in Support matrix type response merge for instant query sharding #5853
• Support vertical sharding for label_join and label_replace functions by @yeya24 in Support vertical sharding for label_join and label_replace functions #5889
• *: Updates Prometheus BusyBox image SHAs by @github-actions in *: Updates Prometheus BusyBox image SHAs #5898
• Update objstore to latest commit by @phillebaba in Update objstore to latest commit #5897
• query:Avoid creating aux slice in removeExactDuplicates by @juanrh in query:Avoid creating aux slice in removeExactDuplicates #5795
• Bump loader-utils from 1.4.0 to 1.4.2 in /pkg/ui/react-app by @dependabot in Bump loader-utils from 1.4.0 to 1.4.2 in /pkg/ui/react-app #5900
• querier: Unhide query.promql-engine flag; added info in docs. by @bwplotka in querier: Unhide query.promql-engine flag; added info in docs. #5913
• Compact tenant TSDBs after 3h inactivity by @fpetkovski in Compact tenant TSDBs after 3h inactivity #5909
• Store: Add a few objectives for Store's data touched/fetched amount and sizes by @douglascamata in Store: Add a few objectives for Store's data touched/fetched amount and sizes #5819
• *: Quick CHANGELOG fix after Store: Add a few objectives for Store's data touched/fetched amount and sizes #5819 by @douglascamata in *: Quick CHANGELOG fix after #5819 #5919
• Store: add data touched by type to the dashboard by @douglascamata in Store: add data touched by type to the dashboard #5838
• Implement lazy retrieval of series from object store. by @fpetkovski in Implement lazy retrieval of series from object store. #5837
• compact: retry on cleanPartialMarked errors if possible by @clwluvw in compact: retry on cleanPartialMarked errors if possible #5922
• Docs: Add mentee selection process by @saswatamcode in Docs: Add mentee selection process #5920
• docs: Updated documentation for OCI Object Storage, added link to blog post by @hyder in docs: Updated documentation for OCI Object Storage, added link to blog post #5928
• Bump github.com/prometheus/exporter-toolkit from 0.7.1 to 0.7.3 by @dependabot in Bump github.com/prometheus/exporter-toolkit from 0.7.1 to 0.7.3 #5938
• objstore: Update to latest by @aarnq in objstore: Update to latest #5940
• Added Filip and Saswata to maintainers list after internal vote. by @bwplotka in Added Filip and Saswata to maintainers list after internal vote. #5950
• add kakaopay as adoptors by @4orty in add kakaopay as adoptors #5953
• Fix values for the chunks_fetched_duration metric by @fpetkovski in Fix values for the chunks_fetched_duration metric #5948
• Added bwplotka as community meetings and release shepherd for December. by @bwplotka in Added bwplotka as community meetings and release shepherd for December. #5955
• docs: fix some typos by @daixiang0 in docs: fix some typos #5958
• *: Document development in WSL2 by @douglascamata in *: Document development in WSL2 #5927
• Fix mint and maxt for api/v1/series call by @fpetkovski in Fix mint and maxt for api/v1/series call #5966
• fixed blog list view in website by @jatinagwal in fixed blog list view in website #5967
• Fix ketama quorum by @fpetkovski in Fix ketama quorum #5910
• cortex/transport: print grafana data if exists by @GiedriusS in cortex/transport: print grafana data if exists #5973
• query/endpointset: fix some races by @GiedriusS in query/endpointset: fix some races #5972
• Added tools bucket marker for no-downsample.json by @RohitKochhar in Added tools bucket marker for no-downsample.json #5945
• *: Updates Prometheus BusyBox image SHAs by @github-actions in *: Updates Prometheus BusyBox image SHAs #5975
• Update Prometheus to v0.40.1 by @rabenhorst in Update Prometheus to v0.40.1 #5896
• Bump decode-uri-component from 0.2.0 to 0.2.2 in /pkg/ui/react-app by @dependabot in Bump decode-uri-component from 0.2.0 to 0.2.2 in /pkg/ui/react-app #5939
• Use efficientgo/core/testutil for tests by @saswatamcode in Use efficientgo/core/testutil for tests #5933
• Changing store to match debug level by @kama910 in Changing store to match debug level #5981
• Github link to v0.25.2 by @Vishvsalvi in Github link to v0.25.2 #5979
• mixin(Receive): Fix series/samples written rate by @douglascamata in mixin(Receive): Fix series/samples written rate #5989
• cache: switch to Rueidis client for Redis by @GiedriusS in cache: switch to Rueidis client for Redis #5593
• tools: Added remove flag on bucket mark command to remove deletion, no-downsample or no-compact markers on the block by @maheshbaliga in tools: Added remove flag on bucket mark command to remove deletion, no-downsample or no-compact markers on the block #5977
• compact: remove cancel on SyncMetas errors by @clwluvw in compact: remove cancel on SyncMetas errors #5923
• Cut v0.30.0-rc.0 by @bwplotka in Cut v0.30.0-rc.0 #5992

Full Changelog: v0.29.0...v0.30.0-rc.0🎉

---

This discussion was created from the release v0.30.0-rc.0.