GAP: Differentially Private Graph Neural Networks with Aggregation Perturbation - INRIA - Institut National de Recherche en Informatique et en Automatique Access content directly
Conference Papers Year :

GAP: Differentially Private Graph Neural Networks with Aggregation Perturbation


In this paper, we study the problem of learning Graph Neural Networks (GNNs) with Differential Privacy (DP). We propose a novel differentially private GNN based on Aggregation Perturbation (GAP), which adds stochastic noise to the GNN's aggregation function to statistically obfuscate the presence of a single edge (edge-level privacy) or a single node and all its adjacent edges (node-level privacy). Tailored to the specifics of private learning, GAP's new architecture is composed of three separate modules: (i) the encoder module, where we learn private node embeddings without relying on the edge information; (ii) the aggregation module, where we compute noisy aggregated node embeddings based on the graph structure; and (iii) the classification module, where we train a neural network on the private aggregations for node classification without further querying the graph edges. GAP's major advantage over previous approaches is that it can benefit from multi-hop neighborhood aggregations, and guarantees both edge-level and node-level DP not only for training, but also at inference with no additional costs beyond the training's privacy budget. We analyze GAP's formal privacy guarantees using Rényi DP and conduct empirical experiments over three real-world graph datasets. We demonstrate that GAP offers significantly better accuracy-privacy trade-offs than state-of-the-art DP-GNN approaches and naive MLP-based baselines. Our code is publicly available at
Fichier principal
Vignette du fichier
2203.00949.pdf (876.86 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03905068 , version 1 (17-12-2022)



Sina Sajadmanesh, Ali Shahin Shamsabadi, Aurélien Bellet, Daniel Gatica-Perez. GAP: Differentially Private Graph Neural Networks with Aggregation Perturbation. USENIX Security 2023 - 32nd USENIX Security Symposium, Aug 2023, Anaheim, United States. ⟨hal-03905068⟩
83 View
56 Download



Gmail Facebook Twitter LinkedIn More