Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf(es/lexer): Use logos lexer as a sub-lexer #9807

Draft
wants to merge 182 commits into
base: main
Choose a base branch
from

Conversation

kdy1
Copy link
Member

@kdy1 kdy1 commented Dec 19, 2024

Description:

Currently it does not support regex so some results are distorted, but expected gain is 27% ~ 32%.

image

Related issue (if exists):

@kdy1 kdy1 self-assigned this Dec 19, 2024
Copy link

changeset-bot bot commented Dec 19, 2024

⚠️ No Changeset found

Latest commit: 036bc21

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@kdy1 kdy1 changed the title perf(es/lexer): Use logos for Text => RawToken => Token phase perf(es/lexer): Use logos for sub-lexer Jan 2, 2025
@kdy1 kdy1 changed the title perf(es/lexer): Use logos for sub-lexer perf(es/lexer): Use logos lexer as a sub-lexer Jan 2, 2025
@kdy1 kdy1 added this to the Planned milestone Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

1 participant