v2.18.1

Major Features and Improvements

• Add Python 3.12 and aarch64 support

Bug Fixes and Other Changes

• Add docker build scripts and enable aarch64 pip wheels.
• Replace std::string_view with absl::string_view
• Protect the fast wordpiece tokenizer from infinite looping.
• Update lock files
• Update version for 2.18.1
• Set HERMETIC_PYTHON_VERSION correctly

v2.18.0

Release 2.18.0

Bug Fixes and Other Changes

• Fix out-of-bounds read in whitespace tokenizer
• Add unit test for fixed bounds check in IsWhitespace
• Add Hermetic CUDA rules.
• Remove tf/lite/kernels/shim:tf_headers from tf/core:framework
• Update version
• Update configure.sh

v2.18.0-rc0

Release 2.18.0-rc0

Bug Fixes and Other Changes

• Fix out-of-bounds read in whitespace tokenizer
• Add unit test for fixed bounds check in IsWhitespace
• Add Hermetic CUDA rules.
• Remove tf/lite/kernels/shim:tf_headers from tf/core:framework
• Update version
• Update configure.sh

v2.17.0

Release 2.17.0

Bug Fixes and Other Changes

• negative sampling excludes positive class
• revert html encoding
• much faster set-intersection based version
• Fix notebook failure with Keras 3.
• Remove tensorflow-macos from setup.py
• Update tensorflow-macos to 2.16.1
• Update version

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Alex Shroyer, C. Antonio Sánchez, Maggie Zhang

v2.17.0-rc0

Release 2.17.0-rc0

Bug Fixes and Other Changes

• negative sampling excludes positive class
• revert html encoding
• much faster set-intersection based version
• Fix notebook failure with Keras 3.
• Remove tensorflow-macos from setup.py
• Update tensorflow-macos to 2.16.1
• Update version

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Alex Shroyer, C. Antonio Sánchez, Maggie Zhang

v2.16.1

Release 2.16.1

Major Features and Improvements

Breaking Changes

Bug Fixes and Other Changes

• Update tf-text setup scripts.
• Support resource manager scoped Sentencepiece resources.
• Remove use_unique_shared_resource_name.
• Remove tensorflow_text dependency on tf_hub library.
• Fix TF patch, bump TF commit
• Update version

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Raviteja Gorijala

v2.16.0-rc0

Release 2.16.0-rc0

Major Features and Improvements

Breaking Changes

Bug Fixes and Other Changes

• Update tf-text setup scripts.
• Support resource manager scoped Sentencepiece resources.
• Remove use_unique_shared_resource_name.
• Remove tensorflow_text dependency on tf_hub library.
• Fix TF patch, bump TF commit
• Update version

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Raviteja Gorijala

v2.15.0

Release 2.15.0

Bug Fixes and Other Changes

• Update TF versions and scripts to allow consistently building against tf-nightly.
• No public description
• Update phrase tokenizer to handle end-punctuation.
• Remove private Keras imports.
• Update tensorflow_hub dependency.
• Sprawling .pyi updates related to pybind11 PRs #4831, #4833.
• Report unsupported tensor type in RaggedTensorToTensor in Prepare.
• Check in generated pyi files for some py_extension targets.
• Update version
• Update WORKSPACE

v2.15.0-rc0

Release 2.15.0-rc0

Bug Fixes and Other Changes

• Update TF versions and scripts to allow consistently building against tf-nightly.
• No public description
• Update phrase tokenizer to handle end-punctuation.
• Remove private Keras imports.
• Update tensorflow_hub dependency.
• Sprawling .pyi updates related to pybind11 PRs #4831, #4833.
• Report unsupported tensor type in RaggedTensorToTensor in Prepare.
• Check in generated pyi files for some py_extension targets.
• Update version
• Update WORKSPACE

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

nallave

v2.14.0

Release 2.14.0

Bug Fixes and Other Changes

• Fix nullptr dereference issue in UnicodeScriptTokenizeWithOffsetOp.
• Bump tensorflow_hub to 0.13.0
• Add @tensorflow/docs-team to CODEOWNERS
• Internal change
• Update TF Text API page to emphasize KerasNLP as the API of first choice.
• Add a note about the implementation differences.
• Fix out-of-bounds absl::string_view handling in RegexSplitImpl
• Disable coerce_to_valid_utf8_op_test test on mac
• Update /text/tutorials and /text/guide to highlight KerasNLP.
• Move remaining text tutorials to text/
• Update /text/tutorials and /text/guide index pages to reflect updated navigation.
• Update broken image links
• Creates a patch to use non_hermetic python for tf text.
• Check in generated pyi files for some py_extension targets.
• Update ops.Tensor references to //third_party/tensorflow/python/framework/tensor.py.
• Remove invalid stub file
• Update tensorflow-text from 2.11 to 2.13
• Check in generated pyi files for some py_extension targets.
• Remove py38 classifiers in setup.py
• Update version

Thanks to our Contributors

This release contains contributions from many people at Google, as well as: