Version 4.7.1

1. Added T5 Tatabahasa, https://malaya.readthedocs.io/en/latest/load-tatabahasa.html
2. Added 5MB T5 for True Case, https://malaya.readthedocs.io/en/latest/load-tatabahasa.html
3. Added 5MB T5 for Segmentation, https://malaya.readthedocs.io/en/latest/load-segmentation.html
4. Added FastFormer BASE and TINY for Emotion Analysis, https://malaya.readthedocs.io/en/latest/load-emotion.html
5. Added FastFormer BASE and TINY for Relevancy Analysis, https://malaya.readthedocs.io/en/latest/load-relevancy.html, can infer up to 2048 tokens.
6. Added FastFormer BASE and TINY for Sentiment Analysis, https://malaya.readthedocs.io/en/latest/load-sentiment.html
7. Added FastFormer BASE and TINY for Subjectivity Analysis, https://malaya.readthedocs.io/en/latest/load-subjectivity.html
8. Added FastFormer BASE and TINY for Toxicity Analysis, https://malaya.readthedocs.io/en/latest/load-toxic.html
9. Added FastFormer BASE and TINY for Entity Tagging, https://malaya.readthedocs.io/en/latest/load-entities.html
10. Added Pretrained FastFormer, https://github.com/huseinzol05/malaya/tree/master/pretrained-model/fastformer

Version 4.7

1. Added NeuSpell Spelling Correction using T5-Bahasa, https://malaya.readthedocs.io/en/latest/load-spell-correction.html#List-available-Transformer-models
2. Added JamSpell Spelling Correction interface, https://malaya.readthedocs.io/en/latest/load-spell-correction.html#Load-JamSpell-speller
3. Added LibreOffice pEJAm Spelling Correction interface, https://malaya.readthedocs.io/en/latest/load-spell-correction.html#Load-Spylls-speller
4. Added T5 models for segmentation, https://malaya.readthedocs.io/en/latest/load-segmentation.html#Load-Transformer-model
5. Added T5 models for True Case, https://malaya.readthedocs.io/en/latest/load-true-case.html#List-available-Transformer-model
6. Added quantized models for GPT2, https://malaya.readthedocs.io/en/latest/load-prefix-generator.html#Load-GPT2

Version 4.6.1

1. Added NeuSpell based using T5-Bahasa, https://malaya.readthedocs.io/en/latest/load-spell-correction.html#List-available-Transformer-models
2. Added T5 models for segmentation, https://malaya.readthedocs.io/en/latest/load-segmentation.html#Load-Transformer-model

Version 4.6

1. Improved Abstractive Summarization dataset and module, https://malaya.readthedocs.io/en/latest/load-abstractive.html
2. Improved Paraphrase dataset and module, https://malaya.readthedocs.io/en/latest/load-abstractive.html
3. Improved Knowledge Graph triplet dataset and module, https://malaya.readthedocs.io/en/latest/load-knowledge-graph-triplet.html
4. added T5 for Knowledge Graph triplet, now able to predict for news, https://malaya.readthedocs.io/en/latest/load-knowledge-graph-triplet.html
5. Remove all t2t models, and replaced with T5-BASE, T5-SMALL and T5-TINY.
6. Now able to parallelise T5 models while maintaining model definition from Tensorflow-Mesh.

Version 4.5

1. Added Coreference Resolution module, https://malaya.readthedocs.io/en/latest/load-coreference-resolution.html
2. Improved dependency parsing module, https://malaya.readthedocs.io/en/latest/load-dependency.html

Version 4.4

1. Supported XLA for malaya models, https://malaya.readthedocs.io/en/latest/devices.html
2. Supported precision modes, can choose to run FP16, FP32 or FP64, https://malaya.readthedocs.io/en/latest/precision-mode.html
3. Improved GPU interface, https://malaya.readthedocs.io/en/latest/gpu-environment.html
4. Added Knowledge Graph Triplet transformer models, https://malaya.readthedocs.io/en/latest/load-knowledge-graph-triplet.html
5. Added Knowledge Graph parser from Dependency Parsing models, https://malaya.readthedocs.io/en/latest/load-knowledge-graph-from-dependency.html

Version 4.3

1. Deep stemmer now support Tensorflow 2.X
2. Added distilled transformer for Abstractive Summarization, https://malaya.readthedocs.io/en/latest/load-abstractive.html#List-available-Transformer-models
3. Added Similarity module documentation.
4. Added KeyPhrase similarity Transformer model, https://malaya.readthedocs.io/en/latest/load-keyphrase-similarity.html
5. Added QA SQUAD style Transformer model, https://malaya.readthedocs.io/en/latest/load-keyphrase-similarity.html
6. Update WordVector interface, https://malaya.readthedocs.io/en/latest/load-wordvector.html#

Version 4.2.1

1. Support Tensorflow 2.0! Deep stemmer model not able to use TF 2.0.

Version 4.2

1. Added OntoNotes5 Entity recognition, https://malaya.readthedocs.io/en/latest/load-entities.html#Load-Transformer-Ontonotes-5-model
2. Added BigBird Translation, able to infer up to 1024 words, https://malaya.readthedocs.io/en/latest/load-long-text-translation.html
3. Added BigBird + Pegasus Abstractive Summarization, able to infer up to 2048 words, https://malaya.readthedocs.io/en/latest/long-text-abstractive-summarization.html
4. T5 function merged with transformer function.
5. Removed Bert-Tensorflow and ALBert-Tensorflow dependencies, preparing for TF2.
6. Removed contrib layers dependencies, preparing for TF2.

Version 4.1

1. Released Kesalahan Tatabahasa module, https://malaya.readthedocs.io/en/latest/load-tatabahasa.html
2. Standardized methods for seq2seq model,

• greedy_decoder for greedy decoder.
• beam_decoder for beam decoder.
• nucleus_decoder for nucleus decoder.