Skip to content

Releases: lanterndata/lantern_extras

Lantern Extras 0.3.0

03 Oct 10:17
Compare
Choose a tag to compare

What's Changed

  • Optimize relu max pooling and fix sql query for non-integer primary keys by @var77 in #134
  • Optimize relu_max_pooling and mean_pooling functions by @var77 in #135
  • Limit update batching for embedding jobs to specified defaults by @var77 in #136
  • do not take any other jobs if daemon has specified label by @var77 in #137
  • fix bug for initial label caching, update tests by @var77 in #138
  • remove cache for labels and handle label updates in update processor by @var77 in #139
  • make daemon label check more strict by @var77 in #140
  • fix progress issue in external indexing for small tables by @var77 in #141
  • Add external indexing tcp server by @var77 in #142
  • correctly handle error when target db url is not valid by @var77 in #143
  • add ssl config to external indexing server by @var77 in #144
  • cleanup tmp index files after indexing finishes or errors by @var77 in #145
  • External Indexing Server Status by @var77 in #146
  • fix memory leak in external indexing by not shadowing the variable by @var77 in #147
  • push containers with cpu-native build for common intel CPUs by @var77 in #148
  • update cli to 0.3.24 by @var77 in #149
  • pass usearch defines to enable simsimd and native f16 for optimized builds by @var77 in #150
  • external indexing quantization by @var77 in #151
  • remove saphirerapids build from CI by @var77 in #152
  • Daemon as background worker by @var77 in #153

Full Changelog: 0.2.3...0.3.0

Lantern Extras 0.2.3

05 Jul 13:44
Compare
Choose a tag to compare

What's Changed

  • Make embeddings async by @var77 in #126
  • Daemon jobs from single queue by @var77 in #127
  • fix error for running blocking tasks inside tokio runtime by @var77 in #128
  • non-blocking streaming jobs by @var77 in #129
  • external index progress by @var77 in #130
  • Add dynamic batching for splade-v3 model by @var77 in #131
  • Properly handle daemon job failures by @var77 in #132
  • Update usearch to support lantern 0.3+ by @var77 in #133

Full Changelog: 0.2.2...0.2.3

Lantern Extras 0.2.2

13 Jun 08:33
d947a44
Compare
Choose a tag to compare

What's Changed

  • Add daemon functions in lantern_extras extension by @var77 in #120

Full Changelog: 0.2.1...0.2.2

Lantern Extras 0.2.1

12 Jun 20:07
ffdea61
Compare
Choose a tag to compare

What's Changed

  • Update filter to ignore source embeddings from daemon by @var77 in #116
  • Update rustc to 1.78 in dockerfiles by @var77 in #117
  • Add filters in client listeners by @var77 in #118
  • Move daemon jobs table to target database by @var77 in #115
  • Add labels to embedding jobs, fix init_finished_at for empty tables by @var77 in #121
  • Remove unnecessary migration by @var77 in #122
  • Add code coverage info by @var77 in #119
  • Splade v3 model by @var77 in #123

Full Changelog: 0.2.0...0.2.1

Lantern Extras 0.2.0

13 May 21:36
Compare
Choose a tag to compare

What's Changed

  • Fix onnxlib for arm64 by @var77 in #111
  • Remove unnecessary if statement from dockerfile by @var77 in #112
  • Update usearch to new verison, bump versions to 0.2.0 by @var77 in #113
  • rollback cargo config file format by @var77 in #114

Full Changelog: 0.1.5...0.2.0

Lantern Extras 0.1.5

26 Apr 14:17
Compare
Choose a tag to compare

What's Changed

  • Set max batch size to embeddings when exporting results by @var77 in #94
  • Ignore embedding rows which has empty string by @var77 in #95
  • Fix daemon connection issues by @var77 in #98
  • Separate db connections for each daemon task by @var77 in #99
  • Add caching to cargo builds by @var77 in #97
  • Add basic auth to http server by @var77 in #101
  • Make channels unbounded, change Atomic to Channel by @var77 in #100
  • Stream init jobs to not block updates by @var77 in #102
  • Add bge m3 model by @var77 in #103
  • Embedding job filter by @var77 in #107
  • Track failed embedding requests by @var77 in #105
  • Add arm64 platform to CLI docker publish by @var77 in #108

Full Changelog: 0.1.4...0.1.5

Lantern Extras 0.1.4

07 Mar 12:35
Compare
Choose a tag to compare

What's Changed

  • [PQ] Random starting id for dataset limit by @var77 in #90
  • Use attention mask to zero padded tokens when mean pooling by @var77 in #91
  • Fix gcp job by @var77 in #92
  • HTTP API by @var77 in #93

Full Changelog: 0.0.13...0.1.4

Lantern Extras 0.0.13

29 Feb 21:44
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.1.3...0.0.13

Lantern Extras 0.1.3

23 Feb 07:21
Compare
Choose a tag to compare

What's Changed

  • Change codebook table name prefix to pq_ by @var77 in #85

Full Changelog: 0.1.2...0.1.3

Lantern Extras 0.1.2

21 Feb 16:53
Compare
Choose a tag to compare

What's Changed

  • Count input tokens for embedding usage by @var77 in #77
  • Update rust version in docker by @var77 in #78
  • Fix embedding usage function name by @var77 in #80
  • Add tests for embedding usage tracking by @var77 in #81
  • Expand backoff mechanism for body validation as well by @var77 in #82
  • Product Quantization by @var77 in #79
  • Add base_url param for OpenAi runtime by @var77 in #83

Full Changelog: 0.1.1...0.1.2