Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Poor NER performance? #1425

Open
stajdini opened this issue Sep 24, 2024 · 1 comment
Open

Poor NER performance? #1425

stajdini opened this issue Sep 24, 2024 · 1 comment
Labels

Comments

@stajdini
Copy link

I am using Stanza to identify NER is short pieces of text like (business names/brand names). Here is one example:


 # BUILDING THE MODELS
#-----stanza
sen = stanza.Pipeline ("en")
smlp = stanza.MultilingualPipeline()

# TESTING THE MODELS
name = 'The Port of Peri Peri'

print('stanza sen')
doc = sen(name)
for sent in doc.sentences:
   for token in sent.tokens:
       for word in token.words:
print('-----------------')

print('stanza smlp')
doc = smlp(name)
for sent in doc.sentences:
   for token in sent.tokens:
       for word in token.words:
           print(word.text, word.xpos, word.upos, word.deprel, token.ner)#, word.feats)
print('-----------------')


stanza sen
The DT DET det B-PERSON
Port NNP PROPN root I-PERSON
of IN ADP case I-PERSON
Peri NNP PROPN nmod I-PERSON
Peri NNP PROPN nmod E-PERSON
-----------------
stanza smlp
The DT DET det B-PERSON
Port NNP PROPN root I-PERSON
of IN ADP case I-PERSON
Peri NNP PROPN nmod I-PERSON
Peri NNP PROPN nmod E-PERSON
-----------------

Obviously, 'The Port of Peri Peri' does not even look like a person's name. Is there any way I can improve Stanza's performance?

@AngledLuffa
Copy link
Collaborator

If you gather up a few such examples, we can retrain the model with those examples and get them right in the future. Please bear in mind that statistical models will have some sort of errors in them

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants