vix.ing · top · new · best · stats · spec

I Am Not What I Write: Privacy Preserving Text Representation Learning

2019/07/06 by Ghazaleh Beigi, Beigi, Ghazaleh, Kai Shu +7 · 2 citations
Computer Science · Social Sciences · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #Social and Information Networks (cs.SI)

paper · pdf · doi:10.48550/arxiv.1907.03189

openalex publication_date 2019/07/06 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Online users generate tremendous amounts of textual information by participating in different activities, such as writing reviews and sharing tweets. This textual data provides opportunities for researchers and business partners to study and understand individuals. However, this user-generated textual data not only can reveal the identity of the user but also may contain individual's private information (e.g., age, location, gender). Hence, "you are what you write" as the saying goes. Publishing the textual data thus compromises the privacy of individuals who provided it. The need arises for data publishers to protect people's privacy by anonymizing the data before publishing it. It is challenging to design effective anonymization techniques for textual information which minimizes the chances of re-identification and does not contain users' sensitive information (high privacy) while retaining the semantic meaning of the data for given tasks (high utility). In this paper, we study this problem and propose a novel double privacy preserving text representation learning framework, DPText, which learns a textual representation that (1) is differentially private, (2) does not contain private information and (3) retains high utility for the given task. Evaluating on two natural language processing tasks, i.e., sentiment analysis and part of speech tagging, we show the effectiveness of this approach in terms of preserving both privacy and utility.

Citations

Cited by

Related