chore(pipeline) : Convert 'PE' entities to 'FT'

Some sources still transmit 'PE' types for their structures, which leads to those being discarded. Avant: data-inclusion=# select count(*) from public_dbt_test__audit.check_structure_int__union_structures__di_surrogate_id where value = 'PE'; -[ RECORD 1 ] count | 1146 Après: data-inclusion=# select count(*) from public_dbt_test__audit.check_structure_int__union_structures__di_surrogate_id where value = 'PE'; -[ RECORD 1 ] count | 0
gip-inclusion · Sep 19, 2024 · f4b919e · f4b919e
1 parent c82d0dd
commit f4b919e
Show file tree

Hide file tree

Showing 2 changed files with 8 additions and 2 deletions.
diff --git a/...dels/intermediate/sources/emplois_de_linclusion/int_emplois_de_linclusion__structures.sql b/...dels/intermediate/sources/emplois_de_linclusion/int_emplois_de_linclusion__structures.sql
@@ -21,7 +21,10 @@ final AS (
         labels_nationaux                AS "labels_nationaux",
         labels_autres                   AS "labels_autres",
         thematiques                     AS "thematiques",
-        typologie                       AS "typologie",
+        CASE
+            WHEN typologie = 'PE' THEN 'FT'
+            ELSE typologie
+        END                             AS typologie,
         date_maj                        AS "date_maj",
         NULLIF(siret, '')               AS "siret",
         NULLIF(nom, '')                 AS "nom",

diff --git a/...t/models/intermediate/sources/mediation_numerique/int_mediation_numerique__structures.sql b/...t/models/intermediate/sources/mediation_numerique/int_mediation_numerique__structures.sql
@@ -17,7 +17,10 @@ final AS (
         accessibilite                                                                                                AS "accessibilite",
         labels_nationaux                                                                                             AS "labels_nationaux",
         thematiques                                                                                                  AS "thematiques",
-        typologie                                                                                                    AS "typologie",
+        CASE
+            WHEN typologie = 'PE' THEN 'FT'
+            ELSE typologie
+        END                                                                                                          AS typologie,
         presentation_resume                                                                                          AS "presentation_resume",
         {{ truncate_text("presentation_detail") }} AS "presentation_detail",
         CAST(date_maj AS DATE)                                                                                       AS "date_maj",