Feature (LLMLingua): support customized compression spec#96

Merged

iofu728 merged 19 commits intomainfrom develop

Feb 28, 2024

+1,326-180

Commits on Feb 8, 2024

update the definition of compression ratio

SiyunZhao
authored and
iofu728
committed
update structured prompt compress

SiyunZhao
authored and
iofu728
committed
update structured prompt compress for llama

SiyunZhao
authored and
iofu728
committed
update structured prompt compress for llama and gpt2

SiyunZhao
authored and
iofu728
committed
add variable type declaration

SiyunZhao
authored and
iofu728
committed
merge part of structured_compress_prompt into compress_prompt

SiyunZhao
authored and
iofu728
committed
add no-compression retention to sentence and context level filter

SiyunZhao
authored and
iofu728
committed
update global ratio and global target token

SiyunZhao
authored and
iofu728
committed
fix segments_info error

SiyunZhao
authored and
iofu728
committed

Commits on Feb 21, 2024

Feature(LLMLingua): update the release script
iofu728
committed

Commits on Feb 26, 2024

Feature(LLMLingua): add HF_TOKEN
iofu728
committed

Commits on Feb 28, 2024

Added unittest for structured_compress_prompt and fixed bugs (#95 )

authored