ABCDP: Approximate Bayesian Computation with Differential Privacy

We developed a novel approximate Bayesian computation (ABC) framework, <i>ABCDP</i>, which produces differentially private (DP) and approximate posterior samples. Our framework takes advantage of the sparse vector technique (SVT), widely studied in the differential privacy literature. SV...

Full description

Bibliographic Details
Main Authors: Mijung Park, Margarita Vinaroz, Wittawat Jitkrittum
Format: Article
Language:English
Published: MDPI AG 2021-07-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/23/8/961
Description
Summary:We developed a novel approximate Bayesian computation (ABC) framework, <i>ABCDP</i>, which produces differentially private (DP) and approximate posterior samples. Our framework takes advantage of the sparse vector technique (SVT), widely studied in the differential privacy literature. SVT incurs the privacy cost only when a condition (whether a quantity of interest is above/below a threshold) is met. If the condition is sparsely met during the repeated queries, SVT can drastically reduce the cumulative privacy loss, unlike the usual case where every query incurs the privacy loss. In ABC, the quantity of interest is the distance between observed and simulated data, and only when the distance is below a threshold can we take the corresponding prior sample as a posterior sample. Hence, applying SVT to ABC is an organic way to transform an ABC algorithm to a privacy-preserving variant with minimal modification, but yields the posterior samples with a high privacy level. We theoretically analyzed the interplay between the noise added for privacy and the accuracy of the posterior samples. We apply ABCDP to several data simulators and show the efficacy of the proposed framework.
ISSN:1099-4300