Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any solution on how Named Entities can be skipped in the utility? #106

Open
katreparitosh opened this issue Jun 9, 2021 · 1 comment
Open

Comments

@katreparitosh
Copy link

katreparitosh commented Jun 9, 2021

Hi,

First of all, thanks for creating such a useful utility.

I came across cases where it gave incorrect suggestions (false positives) for named entities. I understand that the current functionality doesn't consider Named Entities as separate processing. See examples below:


Example 1: Here, "DC" is corrected to "do"

image


Example 2: Here, "abdalati" is replaced with the same word "abdalati"

image

Does the dictionary contain this word as a meaningful word?


Would love to know your thoughts/suggestions/advice on this?

Regards,
Paritosh

@katreparitosh katreparitosh changed the title How Any solution to which Named Entities can be skipped in the utility? Jun 9, 2021
@katreparitosh katreparitosh changed the title Any solution to which Named Entities can be skipped in the utility? Any solution on how Named Entities can be skipped in the utility? Jun 9, 2021
@barrust
Copy link
Owner

barrust commented Jun 22, 2021

You are correct, this library does not take part of speech into account.

It is possible to add those entities into the dictionary that you are leveraging so that it doesn't call it as a false positive. As for your second example, it would only return the same word if it was either provided in the dictionary or there were no suggestions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants