From the Information Bottleneck to the Privacy Funnel
Author(s)
Salamatian, Salman; Fawaz, Nadia; Medard, Muriel; Makhdoumi Kakhaki, Ali
DownloadMedard_From the information.pdf (119.9Kb)
OPEN_ACCESS_POLICY
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
We focus on the privacy-utility trade-off encountered by users who wish to disclose some information to an analyst, that is correlated with their private data, in the hope of receiving some utility. We rely on a general privacy statistical inference framework, under which data is transformed before it is disclosed, according to a probabilistic privacy mapping. We show that when the log-loss is introduced in this framework in both the privacy metric and the distortion metric, the privacy leakage and the utility constraint can be reduced to the mutual information between private data and disclosed data, and between non-private data and disclosed data respectively. We justify the relevance and generality of the privacy metric under the log-loss by proving that the inference threat under any bounded cost function can be upperbounded by an explicit function of the mutual information between private data and disclosed data. We then show that the privacy-utility tradeoff under the log-loss can be cast as the non-convex Privacy Funnel optimization, and we leverage its connection to the Information Bottleneck, to provide a greedy algorithm that is locally optimal. We evaluate its performance on the US census dataset. Finally, we characterize the optimal privacy mapping for the Gaussian Privacy Funnel.
Date issued
2014-11Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer ScienceJournal
Proceedings of the 2014 IEEE Information Theory Workshop (ITW 2014)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Makhdoumi, Ali, Salman Salamatian, Nadia Fawaz, and Muriel Medard. “From the Information Bottleneck to the Privacy Funnel.” 2014 IEEE Information Theory Workshop (ITW 2014) (November 2014).
Version: Original manuscript
ISBN
978-1-4799-5999-0
ISSN
1662-9019