chore(deps): bump tantivy from 0.19.2 to 0.20.2

[dependabot]

Bumps tantivy from 0.19.2 to 0.20.2.

Release notes

Sourced from tantivy's releases.

0.20.1

What's Changed

• Fix building on windows with mmap by @​ChillFish8 in quickwit-oss/tantivy#2070

Tantivy v0.20

What's Changed

Bugfixes

• Fix phrase queries with slop (slop supports now transpositions, algorithm that carries slop so far for num terms > 2) #2031#2020(@​PSeitz)
• Handle error for exists on MMapDirectory #1988 (@​PSeitz)
• Aggregation
  • Fix min doc_count empty merge bug #2057 (@​PSeitz)
  • Fix: Sort order for term aggregations (sort order on key was inverted) #1858 (@​PSeitz)

Features/Improvements

• Add PhrasePrefixQuery #1842 (@​trinity-1686a)
• Add coerce option for text and numbers types (convert the value instead of returning an error during indexing) #1904 (@​PSeitz)
• Add regex tokenizer #1759(@​mkleen)
• Move tokenizer API to seperate crate. Having a seperate crate with a stable API will allow us to use tokenizers with different tantivy versions. #1767 (@​PSeitz)
• Columnar crate: New fast field handling (@​fulmicoton @​PSeitz) #1806#1809
  • Support for fast fields with optional values. Previously tantivy supported only single-valued and multi-value fast fields. The encoding of optional fast fields is now very compact.
  • Fast field Support for JSON (schemaless fast fields). Support multiple types on the same column. #1876 (@​fulmicoton)
  • Unified access for fast fields over different cardinalities.
  • Unified storage for typed and untyped fields.
  • Move fastfield codecs into columnar. #1782 (@​fulmicoton)
  • Sparse dense index for optional values #1716 (@​PSeitz)
  • Switch to nanosecond precision in DateTime fastfield #2016 (@​PSeitz)
• Aggregation
  • Add date_histogram aggregation (only fixed_interval for now) #1900 (@​PSeitz)
  • Add percentiles aggregations #1984 (@​PSeitz)
  • [breaking] Drop JSON support on intermediate agg result (we use postcard as format in quickwit to send intermediate results) #1992 (@​PSeitz)
  • Set memory limit in bytes for aggregations after which they abort (Previously there was only the bucket limit) #1942#1957(@​PSeitz)
  • Add support for u64,i64,f64 fields in term aggregation #1883 (@​PSeitz)
  • Add count, min, max, and sum aggregations #1794 (@​guilload)
  • Switch to Aggregation without serde_untagged => better deserialization errors. #2003 (@​PSeitz)
  • Switch to ms in histogram for date type (ES compatibility) #2045 (@​PSeitz)
  • Reduce term aggregation memory consumption #2013 (@​PSeitz)
  • Reduce agg memory consumption: Replace generic aggregation collector (which has a high memory requirement per instance) in aggregation tree with optimized versions behind a trait.
  • Split term collection count and sub_agg (Faster term agg with less memory consumption for cases without sub-aggs) #1921 (@​PSeitz)
  • Schemaless aggregations: In combination with stacker tantivy supports now schemaless aggregations via the JSON type.
    • Add aggregation support for JSON type #1888 (@​PSeitz)
    • Mixed types support on JSON fields in aggs #1971 (@​PSeitz)
  • Perf: Fetch blocks of vals in aggregation for all cardinality #1950 (@​PSeitz)
• Searcher with disabled scoring via EnableScoring::Disabled #1780 (@​shikhar)
• Enable tokenizer on json fields #2053 (@​PSeitz)
• Enforcing "NOT" and "-" queries consistency in UserInputAst #1609 (@​Denis Bazhenov)
• Faster indexing
  • Refactor tokenization pipeline to use GATs #1924 (@​trinity-1686a)
  • Faster term hash map #1940 (@​PSeitz)
  • Refactor vint #2010 (@​PSeitz)
• Faster search

... (truncated)

Changelog

Sourced from tantivy's changelog.

Tantivy 0.20 [Unreleased]

Bugfixes

• Fix phrase queries with slop (slop supports now transpositions, algorithm that carries slop so far for num terms > 2) #2031#2020(@​PSeitz)
• Handle error for exists on MMapDirectory #1988 (@​PSeitz)
• Aggregation
  • Fix min doc_count empty merge bug #2057 (@​PSeitz)
  • Fix: Sort order for term aggregations (sort order on key was inverted) #1858 (@​PSeitz)

Features/Improvements

• Add PhrasePrefixQuery #1842 (@​trinity-1686a)
• Add coerce option for text and numbers types (convert the value instead of returning an error during indexing) #1904 (@​PSeitz)
• Add regex tokenizer #1759(@​mkleen)
• Move tokenizer API to seperate crate. Having a seperate crate with a stable API will allow us to use tokenizers with different tantivy versions. #1767 (@​PSeitz)
• Columnar crate: New fast field handling (@​fulmicoton @​PSeitz) #1806#1809
  • Support for fast fields with optional values. Previously tantivy supported only single-valued and multi-value fast fields. The encoding of optional fast fields is now very compact.
  • Fast field Support for JSON (schemaless fast fields). Support multiple types on the same column. #1876 (@​fulmicoton)
  • Unified access for fast fields over different cardinalities.
  • Unified storage for typed and untyped fields.
  • Move fastfield codecs into columnar. #1782 (@​fulmicoton)
  • Sparse dense index for optional values #1716 (@​PSeitz)
  • Switch to nanosecond precision in DateTime fastfield #2016 (@​PSeitz)
• Aggregation
  • Add date_histogram aggregation (only fixed_interval for now) #1900 (@​PSeitz)
  • Add percentiles aggregations #1984 (@​PSeitz)
  • [breaking] Drop JSON support on intermediate agg result (we use postcard as format in quickwit to send intermediate results) #1992 (@​PSeitz)
  • Set memory limit in bytes for aggregations after which they abort (Previously there was only the bucket limit) #1942#1957(@​PSeitz)
  • Add support for u64,i64,f64 fields in term aggregation #1883 (@​PSeitz)
  • Allow histogram bounds to be passed as Rfc3339 #2076 (@​PSeitz)
  • Add count, min, max, and sum aggregations #1794 (@​guilload)
  • Switch to Aggregation without serde_untagged => better deserialization errors. #2003 (@​PSeitz)
  • Switch to ms in histogram for date type (ES compatibility) #2045 (@​PSeitz)
  • Reduce term aggregation memory consumption #2013 (@​PSeitz)
  • Reduce agg memory consumption: Replace generic aggregation collector (which has a high memory requirement per instance) in aggregation tree with optimized versions behind a trait.
  • Split term collection count and sub_agg (Faster term agg with less memory consumption for cases without sub-aggs) #1921 (@​PSeitz)
  • Schemaless aggregations: In combination with stacker tantivy supports now schemaless aggregations via the JSON type.
    • Add aggregation support for JSON type #1888 (@​PSeitz)
    • Mixed types support on JSON fields in aggs #1971 (@​PSeitz)
  • Perf: Fetch blocks of vals in aggregation for all cardinality #1950 (@​PSeitz)
• Searcher with disabled scoring via EnableScoring::Disabled #1780 (@​shikhar)
• Enable tokenizer on json fields #2053 (@​PSeitz)
• Enforcing "NOT" and "-" queries consistency in UserInputAst #1609 (@​bazhenov)
• Faster indexing
  • Refactor tokenization pipeline to use GATs #1924 (@​trinity-1686a)
  • Faster term hash map #2058#1940 (@​PSeitz)
  • Refactor vint #2010 (@​PSeitz)
• Faster search
  • Work in batches of docs on the SegmentCollector (Only for cases without score for now) #1937 (@​PSeitz)
  • Faster fast field range queries using SIMD #1954 (@​fulmicoton)

... (truncated)

Commits

• See full diff in compare view

You can trigger a rebase of this PR by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

> **Note** > Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

[dependabot]

Superseded by #1654.