Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP - James to look at fix for empty partitions in bootstrap replication (MF bootstrap mechanism) #68

Open
wants to merge 19 commits into
base: develop
Choose a base branch
from

Conversation

MeganFantes
Copy link
Contributor

See the R/mechanism-bootstrap.R file
At the top (line 13) there is a comment that says: # There are 2 options for handling empty partitions:
Below this comment, the two options for handling empty partitions are fully implemented, tested, and commented.

James, I would just like to hear from you which option is best.

Briefly, the two options for handling empty partitions are:

  1. Ignore empty partitions entirely (and not include them in the count of partitions)
  2. Set the value of the statistic for that partition to 0, and include that partition in the bootstrap calculation

Also fix a bug that becomes apparent after fixing the original bug:
Not all partitions in the bootstrap replication are necessarily be filled, yielding NaN values when the statistic is calculated. Add data validation to ensure only calculating statistic on partitions that contain values.
Will discuss with Ira which option is best
…an of the partition means (instead of the sum)
…n instead of sum.

This addresses the huge standard error that results from bootstrapping.
This was another bug found after fixing Issue #49.
…the HUGE standard error on the differentially private bootstrapped mean.)
@MeganFantes MeganFantes added the bug label Jul 9, 2019
@MeganFantes MeganFantes changed the title WIP - James to look at fix for empty partitions in bootstrap replication WIP - James to look at fix for empty partitions in bootstrap replication (MF bootstrap mechanism) Sep 17, 2019
Ira Globus-Harris added 4 commits October 1, 2019 13:56
Merge branch 'develop' of https://github.com/privacytoolsproject/PSI-Library into MF_Issue49_bugFix_bootStatEval

# Conflicts:
#	.gitignore
#	NAMESPACE
#	R/mechanism-bootstrap.R
#	man/Laplace-Mechanism.Rd
#	vignettes/dp-mean.Rmd
@globusharris
Copy link

As of earlier this week, I have fixed the merge conflicts in this branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants