USENIX Security2018Top-tier venue
Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learning
Hamza Harkous, Kassem Fawaz, Rémi Lebret, Florian Schaub, Kang G. Shin, Karl Aberer
Abstract
Privacy policies are the primary channel through which companies inform users about their data collection and sharing practices. In their current form, policies remain long and difficult to comprehend, thus merely serving the goal of legally protecting the companies. Short notices based on information extracted from privacy policies have been shown to be useful and more usable, but face a significant scalability hurdle, given the number of policies and their evolution over time. Companies, users, researchers, and regulators still lack usable and scalable tools to cope with the breadth and depth of privacy policies. To address these hurdles, we propose Polisis, an automated framework for privacy Policies analysis. It enables scalable, dynamic, and multi-dimensional queries on privacy policies. At the core of Polisis is a privacy-centric language model, built with 130K privacy policies, and a novel hierarchy of neural network classifiers that caters to the high-level aspects and the fine-grained details of privacy practices. We demonstrate Polisis's modularity and utility with two robust applications that support structured and free-form querying. The structured querying application is the automated assignment of privacy icons from the privacy policies. With Polisis, we can achieve an accuracy of 88.4% on this task, when evaluated against earlier annotations by a group of three legal experts. The second application is PriBot, the first free-form Question Answering about Privacy policies. We show that PriBot can produce a correct answer among its top-3 results for 82% of the test questions.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
62 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- PolicyLint: Investigating Internal Privacy Policy Contradictions on Google Play cites Automated Analysis of Privacy Requirements for Mobile Apps
- Have You been Properly Notified? Automatic Compliance Analysis of Privacy Policy Text with GDPR Article 13 cites Finding a Choice in a Haystack: Automatic Extraction of Opt-Out Statements from Privacy Policy Text
- Finding a Choice in a Haystack: Automatic Extraction of Opt-Out Statements from Privacy Policy Text cites Automated Analysis of Privacy Requirements for Mobile Apps
- Privacy Policies over Time: Curation and Analysis of a Million-Document Dataset cites Finding a Choice in a Haystack: Automatic Extraction of Opt-Out Statements from Privacy Policy Text
Cited by top-tier papers62
- PolicyLint: Investigating Internal Privacy Policy Contradictions on Google PlayBenjamin Andow, Samin Yaseer Mahmud, Wenyu Wang, Justin Whitaker et al.USENIX Security 2019 · 185 citations
- Privacy Policies over Time: Curation and Analysis of a Million-Document DatasetRyan Amos, Gunes Acar, Elena Lucherini, Mihir Kshirsagar et al.WWW 2021 · 135 citations
- Finding a Choice in a Haystack: Automatic Extraction of Opt-Out Statements from Privacy Policy TextVinayshekhar Bannihatti Kumar, Roger Iyengar, Namita Nisal, Yuanyuan Feng et al.WWW 2020 · 93 citations
- Understanding Privacy-Related Questions on Stack OverflowMohammad Tahaei, Kami Vaniea, Naomi SaphraCHI 2020 · 93 citations
- Have You been Properly Notified? Automatic Compliance Analysis of Privacy Policy Text with GDPR Article 13Shuang Liu, Baiyang Zhao, Renjie Guo, Guozhu Meng et al.WWW 2021 · 68 citations
Builds on1
Related papers
- Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy PoliciesMukund Srinath, Shomir Wilson, C. Lee GilesACL 2021
- PolicyQA: A Reading Comprehension Dataset for Privacy PoliciesWasi Uddin Ahmad, Jianfeng Chi, Yuan Tian, Kai-Wei ChangEMNLP Findings 2020 · 56 citations
- PolicyPulse: Precision Semantic Role Extraction for Enhanced Privacy Policy ComprehensionAndrick Adhikari, Sanchari Das, Rinku DewriNDSS 2025
- PoliGraph: Automated Privacy Policy Analysis using Knowledge GraphsHao Cui, Rahmadi Trimananda, Athina Markopoulou, Scott JordanUSENIX Security 2023
- PoliCond: Condition-Aware Ontology-Driven LLMs for Privacy Policy Contradiction AnalysisYalin Feng, Yifei Lu, Minxue PanASE 2025
