Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature (LLMLingua): support customized compression spec #96

Merged
merged 19 commits into from
Feb 28, 2024
Merged

Feature (LLMLingua): support customized compression spec #96

merged 19 commits into from
Feb 28, 2024

Conversation

iofu728
Copy link
Contributor

@iofu728 iofu728 commented Feb 28, 2024

  • Support customized compression spec;
  • Add unittest, template;
  • Add documents;
  • Fix the bug of different SLM;

SiyunZhao and others added 19 commits February 8, 2024 15:41
@SiyunZhao @iofu728
update the definition of compression ratio
75d192e
@SiyunZhao @iofu728
update structured prompt compress
fb2290c
@SiyunZhao @iofu728
update structured prompt compress for llama
8e31e10
@SiyunZhao @iofu728
update structured prompt compress for llama and gpt2
992df86
@SiyunZhao @iofu728
add variable type declaration
81acc9c
@SiyunZhao @iofu728
merge part of structured_compress_prompt into compress_prompt
46343ca
@SiyunZhao @iofu728
add no-compression retention to sentence and context level filter
85f2fda
@SiyunZhao @iofu728
update global ratio and global target token
2917e5a
@SiyunZhao @iofu728
fix segments_info error
f60d052
@SiyunZhao @iofu728
change input paramete from ratio to rate
29be238
@SiyunZhao @iofu728
change parameter name
3905814
@iofu728
Feature(LLMLingua): add tempature & test scripts
2cd5c7e
@iofu728
Feature(LLMLingua): add pre commit check & unittest
7a57052
@iofu728
Fix(LLMLingua): fix the unittest
b68c3a3
@iofu728
Fix(LLMLingua): fix the unitest
6a2dcdd
@iofu728
Fix(LLMLingua): fix the unitest
61e7e51
@iofu728
Feature(LLMLingua): update the release script
b3b7476
@iofu728
Feature(LLMLingua): add HF_TOKEN
049a113
@SiyunZhao @QianhuiWu
@XufangLuo @mydmdm
Added unittest for structured_compress_prompt and fixed bugs (#95)
9f97ba7 
- fix bugs and add unittests
- make style
- add nltk init
- fix nltk file exist error
- add unittest for different models

Co-authored-by: Siyun Zhao <[email protected]>
Co-authored-by: Qianhui Wu <[email protected]>
Co-authored-by: Xufang Luo <[email protected]>
Co-authored-by: Yuqing Yang <[email protected]>
@iofu728 iofu728 added bug Something isn't working documentation Improvements or additions to documentation feature feature style some problem of code style labels Feb 28, 2024
@iofu728 iofu728 merged commit 042bd0e into main Feb 28, 2024
10 checks passed
@iofu728 iofu728 deleted the develop branch February 28, 2024 06:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@iofu728 iofu728

@SiyunZhao SiyunZhao

Labels
bug Something isn't working documentation Improvements or additions to documentation feature feature style some problem of code style
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iofu728 @SiyunZhao