Skip to content

Issues: hao-ai-lab/LookaheadDecoding

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

33 Open 25 Closed
33 Open 25 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

AttributeError: type object 'GenerationMixin' has no attribute 'greedy_search'
#67 opened Nov 5, 2024 by grandxin
Question about batching strategy
#66 opened Oct 10, 2024 by lxnlxnlxnlxnlxn
Error with USE_LADE option
#65 opened Oct 10, 2024 by lxnlxnlxnlxnlxn
1
Yi Models support
#64 opened Jun 17, 2024 by fayuge
1
How to optimize the scene with relatively short output?
#63 opened Jun 4, 2024 by yangbohust
Bug in Greedy Search
#62 opened May 21, 2024 by david-wei-01001
Cannot use save_log and log_history
#61 opened May 17, 2024 by david-wei-01001
1
about verification branch
#60 opened May 13, 2024 by dhcode-cpp
1
TypeError: LlamaSdpaAttention.forward() got an unexpected keyword argument 'lookahead'
#59 opened Apr 25, 2024 by zev123456
5
How to use LADE in single-node multi-process way?
#57 opened Apr 15, 2024 by sjrrr13
2
[BUG Report] jacobi_greedy_search_multilevel function bug
#56 opened Apr 8, 2024 by yangbohust
Do lookahead and repetition_penalty conflict?
#55 opened Apr 7, 2024 by zhanweiw
BUG Report
#54 opened Mar 26, 2024 by yangbohust
Why jacobi_sample_multilevel() fill window with argmax instead of also using sampling?
#53 opened Mar 22, 2024 by yangbohust
question on verification beginning pos
#52 opened Mar 18, 2024 by felixdae
1
Adaptive LEVEL/GUESS size?
#51 opened Feb 28, 2024 by sahel-sh
specific model
#48 opened Jan 22, 2024 by qspang
13
Multiple GPUS
#47 opened Jan 20, 2024 by qspang
9
Related work: Prompt lookup decoding
#45 opened Jan 18, 2024 by shermansiu
7
Questions on combined attention mask structure for Jacobi iteration
#44 opened Jan 11, 2024 by learning-chip
23
Can I get a MT-bench evaluation code for reproduction of acceleration?
#36 opened Dec 19, 2023 by je1lee
11
Questions on the attention mask, and whether to accept the last element of guess_results when all guess_tokens are accepted
#32 opened Dec 7, 2023 by YingHH1
6
The inference results are inconsistent with Huggingface.
#30 opened Dec 6, 2023 by cyfwry
6
Does Lade support topp/topk/temperature sampleing?
#29 opened Dec 6, 2023 by AlvL1225
2
Benchmarks comparing with Medusa
#26 opened Nov 30, 2023 by Rock-Anderson
ProTip! Mix and match filters to narrow down what you’re looking for.