One-Shot Compression of Large Edge-Exchangeable Graphs using Bits-Back Coding
Daniel Severo, James Townsend, Ashish J. Khisti, Alireza Makhzani
Abstract
We present a one-shot method for compressing large labeled graphs called Random Edge Coding. When paired with a parameter-free model based on Pólya's Urn, the worst-case computational and memory complexities scale quasi-linearly and linearly with the number of observed edges, making it efficient on sparse graphs, and requires only integer arithmetic. Key to our method is bits-back coding, which is used to sample edges and vertices without replacement from the edge-list in a way that preserves the structure of the graph. Optimality is proven under a class of random graph models that are invariant to permutations of the edges and of vertices within an edge. Experiments indicate Random Edge Coding can achieve competitive compression performance on real-world network datasets and scales to graphs with millions of nodes and edges. For the most recent version, see https://arxiv.org/ abs/2305.09705 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f0a3beb3-b7a0-45ff-8b59-a4a01a5616f4Builds on6
- GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph GenerationNikhil Goyal, Harsh Vardhan Jain, Sayan RanuWWW 2020 · 110 citations
- HiLLoC: lossless image compression with hierarchical latent variable modelsJames Townsend, Thomas Bird, Julius Kunze, David BarberICLR 2020 · 60 citations
- Order Matters: Probabilistic Modeling of Node Sequence for Graph GenerationXiaohui Chen, Xu Han, Jiajing Hu, Francisco J. R. Ruiz et al.ICML 2021 · 40 citations
- IDF++: Analyzing and Improving Integer Discrete Flows for Lossless CompressionRianne van den Berg, Alexey A. Gritsenko, Mostafa Dehghani, Casper Kaae Sønderby et al.ICLR 2021 · 38 citations
- Improving Lossless Compression Rates via Monte Carlo Bits-Back CodingYangjun Ruan, Karen Ullrich, Daniel Severo, James Townsend et al.ICML 2021 · 25 citations
Related papers
- Practical Shuffle CodingJulius Kunze, Daniel Severo, Jan-Willem van de Meent, James TownsendNeurIPS 2024 · 2 citations
- Entropy Coding of Unordered Data StructuresJulius Kunze, Daniel Severo, Giulio Zani, Jan-Willem van de Meent et al.ICLR 2024 · 7 citations
- Partition and Code: learning how to compress graphsGiorgos Bouritsas, Andreas Loukas, Nikolaos Karalias, Michael M. BronsteinNeurIPS 2021 · 23 citations
- Efficient and Degree-Guided Graph Generation via Discrete Diffusion ModelingXiaohui Chen, Jiaxing He, Xu Han, Liping LiuICML 2023 · 85 citations
- On Compressing Temporal GraphsPanagiotis Liakos, Katia Papakonstantinopoulou, Theodore Stefou, Alex DelisICDE 2022 · 8 citations
