diff --git a/docs/images/dl_prob_mod_scheme.png b/docs/images/dl_prob_mod_scheme.png deleted file mode 100644 index 45624dbd..00000000 Binary files a/docs/images/dl_prob_mod_scheme.png and /dev/null differ diff --git a/docs/images/splink_diagram.png b/docs/images/splink_diagram.png new file mode 100644 index 00000000..df079b13 Binary files /dev/null and b/docs/images/splink_diagram.png differ diff --git a/docs/our_work/data-linkage-hub/linkage-projects/better-matching.md b/docs/our_work/data-linkage-hub/linkage-projects/better-matching.md index 939926d2..0f005153 100644 --- a/docs/our_work/data-linkage-hub/linkage-projects/better-matching.md +++ b/docs/our_work/data-linkage-hub/linkage-projects/better-matching.md @@ -1,12 +1,13 @@ --- title: 'Probabilistic Linkage Model' -summary: 'This project is creating a probabilistic linkage model using Splink, in order to improve linkage outcomes, and by extension, patient outcomes.' +summary: 'This project is creating a probabilistic linkage model using Splink, in order to improve linkage outcomes, and by extension, patient outcomes. The aim is for this to be used to link data in a range of NHS datasets.' category: 'Projects' origin: 'NHSD' tags: ['LINKAGE', 'PYTHON', 'PROBABILISTIC MODEL'] --- + ## Crafting a model that suits NHS England data linkage needs -This project aims at developing an alternative data linkage model to [MPS (Master Person Service)](./mps-handbook.md) by creating a [probabilistic linkage model](https://www.bristol.ac.uk/media-library/sites/cmm/migrated/documents/problinkage.pdf) using the package called [Splink](https://moj-analytical-services.github.io/splink/index.html), which was developed by Ministry of Justice (MoJ). +This project aims at developing an alternative data linkage model to [MPS (Master Person Service)](./mps-handbook.md) by creating a [probabilistic linkage model](https://www.bristol.ac.uk/media-library/sites/cmm/migrated/documents/problinkage.pdf) using the package called [Splink](https://moj-analytical-services.github.io/splink/index.html), which was developed by Ministry of Justice (MoJ) Data Science Team. The linkage pipeline consists of a few steps: @@ -19,8 +20,10 @@ The linkage pipeline consists of a few steps: Each of these steps requires research into linkage best practice, testing on samples of our data, feasibility studies of computational power required, and then thorough evaluation. We are working with an incremental improvement plan and a series of iterative MVPs to ensure that the pipeline has the highest quality we can achieve within our computational limits. +We have also added additional configuration to the pipeline to allow for a deduplication task. This is in order to try and identify possible duplicate records in the [Personal Demographics Service (PDS)](https://digital.nhs.uk/services/personal-demographics-service). + Here is an overview of how our pipeline currently looks. -![Splink linkage pipeline scheme](../../../images/dl_prob_mod_scheme.png) +![Splink linkage pipeline scheme](../../../images/splink_diagram.png) ## Building a model with transparency in mind Users of linked data have to rely on the accuracy of the process created by others as often the process of linking data is not under their control. That is why one of the main focus of the model we are building is transparency of the methods and explainability of the results.