Code

New NlpEngine - docs#1177

Code

Merged

omri374 merged 78 commits intomainmicrosoft/presidio:mainfrom omri/new_transformers_engine_docsmicrosoft/presidio:omri/new_transformers_engine_docsCopy head branch name to clipboardOct 25, 2023

+392-280

Commits

Commits on Aug 28, 2023

• integrating spacy-huggingface-pipeliens and refactoring NlpEngine logic

  omri374

  committed
  a59d67b

• Update languages-config.yml

  omri374

  authored
  cf44222

• Update customizing_nlp_models.md

  omri374

  authored
  7db2320

• Merge remote-tracking branch 'origin/main' into omri/new_transformers_engine

  Show description for b8b7be7
  omri374

  committed
  b8b7be7

• Update customizing_nlp_models.md

  omri374

  authored
  ede9f9a

• Update default.yaml

  omri374

  authored
  d3edce8

• Update languages-config.yml

  omri374

  authored
  8508c00

• Update default.yaml

  omri374

  authored
  800843d

• Update spacy_multilingual.yaml

  omri374

  authored
  f066c31

• Update stanza.yaml

  omri374

  authored
  03a7ed8

• Update stanza_multilingual.yaml

  omri374

  authored
  971c7ec

• default_score from config + more logging

  omri374

  committed
  1263f21

• Merge remote-tracking branch 'origin/omri/new_transformers_engine' into omri/new_transformers_engine

  omri374

  committed
  5d6de3c

• flake8 updates

  omri374

  committed
  b353c5c

• added en_core_web_sm for transformers pipelines

  omri374

  authored
  a740c2d

• removed type_checking option

  omri374

  committed
  b6170b6

Commits on Aug 29, 2023

• Merge remote-tracking branch 'origin/omri/new_transformers_engine' into omri/new_transformers_engine

  omri374

  committed
  b924242

• add transformers_recognizer test

  omri374

  committed
  f0a9924

• formatting

  omri374

  committed
  28472ab

• updated docstring

  omri374

  authored
  39103e2

• revert formatting

  omri374

  authored
  1aca153

• revert formatting

  omri374

  authored
  db7c45f

• ignore type checking errors (TC001 TC002 TC003)

  omri374

  committed
  e8a814f

• small updates to docs

  omri374

  committed
  f2cd479

• update to mkdocs to support tabs in v8

  omri374

  committed
  5dc5930

• added trasnformers extra

  omri374

  authored
  5ce545f

• fixed extras

  omri374

  authored
  fcd8ef6

• updated extras

  omri374

  authored
  b5d56f6

• Update installation.md

  omri374

  authored
  7364052

• Update getting_started.md

  omri374

  authored
  7aa5df0

• added comment on lazy downloading

  omri374

  authored
  1610685

• Update getting_started.md

  omri374

  authored
  f2d5843

Commits on Aug 31, 2023

• revert conf to reduce PR size

  omri374

  committed
  cf85101

• Simplified logic between spacy and trasnformers nlp engines

  omri374

  committed
  5a4bb29

• flake8

  omri374

  committed
  7e05bf0

• Update Pipfile

  omri374

  authored
  865fae0

• fixed wrong key name

  omri374

  committed
  67bf43f

• Merge remote-tracking branch 'origin/omri/new_transformers_engine' into omri/new_transformers_engine

  omri374

  committed
  01d227c

• line width

  omri374

  committed
  3724847

Commits on Sep 12, 2023

• Merge branch 'main' into omri/new_transformers_engine

  omri374

  authored
  f063d05

Commits on Sep 18, 2023

• Updates to tests and docs

  omri374

  committed
  53e0196

• updates to tests and docs

  omri374

  committed
  b194c92

• revert tests to separate PRs

  omri374

  committed
  0604028

• revert code to separate PRs

  omri374

  committed
  35b99e0

• Updates to NlpEngine - tests (#1176)

  omri374

  authored
  7dbd2be

• updates to Stanza NLP engine + tests

  omri374

  committed
  5f9cab6

Commits on Sep 19, 2023

• tests fix

  omri374

  committed
  1c556c9

• linting

  omri374

  committed
  b58a799

• Merge branch 'main' into omri/new_transformers_engine

  omri374

  committed
  62a9d93

• added GPE to mapping

  omri374

  committed
  3fb2494

Commits on Sep 20, 2023

• reverted installation.md

  omri374

  authored
  0200d1a

• reverted getting_started.md

  omri374

  authored
  49b0562

• Update spacy.yaml

  omri374

  authored
  023cc8f

• Update spacy_multilingual.yaml

  omri374

  authored
  f81e3c3

• Merge branch 'main' into omri/new_transformers_engine

  omri374

  authored
  5b59e87

Commits on Sep 21, 2023

• changed alignment_model to expand

  omri374

  authored
  2a81f87

• Update ner_model_configuration.py

  omri374

  authored
  72e7c2b

Commits on Sep 26, 2023

• minor changes after more testing

  omri374

  committed
  a338b99

• revert recognizer name change, no need.

  omri374

  committed
  52cce16

• removed unnecessary field

  omri374

  committed
  8238cbd

• updates to docs for new NLP engine and in general

  omri374

  committed
  d60315a

• newline

  omri374

  committed
  79434a2

• Merge branch 'omri/new_transformers_engine' into omri/new_transformers_engine_docs

  omri374

  authored
  d4839c1

Commits on Oct 19, 2023

• Merge branch 'main' into omri/new_transformers_engine_docs

  omri374

  committed
  d46af19

Commits on Oct 22, 2023

• Merge branch 'main' into omri/new_transformers_engine_docs

  Show description for 2940713
  omri374

  committed
  2940713

• Create spelling.yml

  omri374

  authored
  e6df67e

• Delete .github/spelling.yml

  omri374

  authored
  e3c31e7

• Updates to docs

  omri374

  committed
  8feadb8

• Merge branch 'omri/new_transformers_engine_docs' of github.com:microsoft/presidio into omri/new_transformers_engine_docs

  omri374

  committed
  88393d0

• removed "attachments"

  omri374

  authored
  b634221

• Update batch_processing.ipynb

  Show description for 1d80011
  omri374

  authored
  1d80011

• Update batch_processing.ipynb

  Show description for 4cc77fe
  omri374

  authored
  4cc77fe

• Added line between pip and spacy

  omri374

  authored
  5ab5c8d

• fixed markdown in notebook

  omri374

  authored
  0cb1d9e

• added line between pip and spacy

  omri374

  authored
  b8955e3

• revert notebook change

  omri374

  authored
  c371f04

• added a line between pip and spacy

  omri374

  authored
  cdf09ad

• revert docstring change

  omri374

  authored
  98e631e