Alert button

User-Entity Differential Privacy in Learning Natural Language Models

Nov 01, 2022
Phung Lai, NhatHai Phan, Tong Sun, Rajiv Jain, Franck Dernoncourt, Jiuxiang Gu, Nikolaos Barmpalios

Figure 1 for User-Entity Differential Privacy in Learning Natural Language Models
Figure 2 for User-Entity Differential Privacy in Learning Natural Language Models
Figure 3 for User-Entity Differential Privacy in Learning Natural Language Models
Figure 4 for User-Entity Differential Privacy in Learning Natural Language Models

Share this with someone who'll enjoy it:

In this paper, we introduce a novel concept of user-entity differential privacy (UeDP) to provide formal privacy protection simultaneously to both sensitive entities in textual data and data owners in learning natural language models (NLMs). To preserve UeDP, we developed a novel algorithm, called UeDP-Alg, optimizing the trade-off between privacy loss and model utility with a tight sensitivity bound derived from seamlessly combining user and sensitive entity sampling processes. An extensive theoretical analysis and evaluation show that our UeDP-Alg outperforms baseline approaches in model utility under the same privacy budget consumption on several NLM tasks, using benchmark datasets.

* Accepted at IEEE BigData 2022  
View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: