Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(pipeline) : Passage à l'API médiation numérique #180

Merged
merged 1 commit into from
Dec 20, 2023

Conversation

vperron
Copy link
Contributor

@vperron vperron commented Dec 18, 2023

  • on supprime les entrées mergées ainsi que ce qui vient de Dora.
  • on profite de l'ajout des infos d'accessibilité et des codes INSEE
  • on perd deux sources : "cd28-appui-territorial" and "hub-antilles"
  • on gagne "Corse", "Epernay", "La Sarthe", "Mednum BFC".

Attention il y a des soucis de SIRET, de labels nationaux et de courriel, qui sont écartés des résultats (20 services, 70 structures à date d'écriture)
Certaines structures ont une date de MAJ en 1970 (~6000)

And get rid of the use of the multiple structures and sources.

To be noted:
- we have added a check to remove the entries form the API that are
  "merged" structures, since DI already stores a lot of duplicates.
  The merged IDs from the ANCT don't look stable and we don't want to
  depend on their algorithm for it.
  We only keep deduplicated structures and services for now.

- with the API we gained a few fields in the structures : we now have an
  INSEE code and accessibility options.

- it seems that switching from the open data to the API we "lost" a few
  sources but gained quite a few others (23875 -> 26592 records)
  We lost the sources : "cd28-appui-territorial" and "hub-antilles"
  We gained the sources : "Corse", "Epernay", "La Sarthe", "Mednum BFC".

Also, we filter-out the Dora structures and services.
@vperron vperron merged commit b356c7f into main Dec 20, 2023
5 of 6 checks passed
@vperron vperron deleted the vperron/mednum branch December 20, 2023 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant