On the Learning and Learnability of Quasimetrics
Tongzhou Wang, Phillip Isola
摘要
Our world is full of asymmetries. Gravity and wind can make reaching a place easier than coming back. Social artifacts such as genealogy charts and citation graphs are inherently directed. In reinforcement learning and control, optimal goal-reaching strategies are rarely reversible (symmetrical). Distance functions supported on these asymmetrical structures are called quasimetrics. Despite their common appearance, little research has been done on the learning of quasimetrics. Our theoretical analysis reveals that a common class of learning algorithms, including unconstrained multilayer perceptrons (MLPs), provably fails to learn a quasimetric consistent with training data. In contrast, our proposed Poisson Quasimetric Embedding (PQE) is the first quasimetric learning formulation that both is learnable with gradient-based optimization and enjoys strong performance guarantees. Experiments on random graphs, social graphs, and offline Q-learning demonstrate its effectiveness over many common baselines. Project Page: ssnl.github.io/quasimetric. Code: github.com/SsnL/poisson_quasimetric_embedding.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- Optimal Goal-Reaching Reinforcement Learning via Quasimetric LearningTongzhou Wang, Antonio Torralba, Phillip Isola, Amy ZhangICML 2023 · 被引用 88 次
- Learning Temporal Distances: Contrastive Successor Features Can Provide a Metric Structure for Decision-MakingVivek Myers, Chongyi Zheng, Anca D. Dragan, Sergey Levine 等ICML 2024 · 被引用 38 次
- Temporal Straightening for Latent PlanningYing Wang, Oumayma Bounou, Gaoyue Zhou, Randall Balestriero 等ICML 2026 · 被引用 19 次
- State Chrono Representation for Enhancing Generalization in Reinforcement LearningJianda Chen, Wen Zheng Terence Ng, Zichen Chen, Sinno Jialin Pan 等NeurIPS 2024 · 被引用 5 次
- Compositional Transduction with Latent Analogies for Offline Goal-Conditioned Reinforcement LearningJunseok Kim, Dohyeong Kim, Mineui Hong, Songhwai OhICML 2026 · 被引用 1 次
它引用的顶会 Paper6
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 被引用 2,360 次
- On the Similarity between the Laplace and Neural Tangent KernelsAmnon Geifman, Abhay Kumar Yadav, Yoni Kasten, Meirav Galun 等NeurIPS 2020 · 被引用 118 次
- Model-Based Visual Planning with Self-Supervised Functional DistancesStephen Tian, Suraj Nair, Frederik Ebert, Sudeep Dasari 等ICLR 2021 · 被引用 69 次
- An Inductive Bias for Distances: Neural Nets that Respect the Triangle InequalitySilviu Pitis, Harris Chan, Kiarash Jamali, Jimmy BaICLR 2020 · 被引用 31 次
- Nested Subspace Arrangement for Representation of Relational DataNozomi Hata, Shizuo Kaji, Akihiro Yoshida, Katsuki FujisawaICML 2020 · 被引用 3 次
相关 Paper
- Offline Goal-conditioned Reinforcement Learning with Quasimetric RepresentationsVivek Myers, Bill Zheng, Benjamin Eysenbach, Sergey LevineNeurIPS 2025 · 被引用 26 次
- Path and Intersections: Characterization of Quasi-metrics in Directed Okamura-Seymour InstancesYu Chen, Zihan TanSODA 2025
- QPRL : Learning Optimal Policies with Quasi-Potential Functions for Asymmetric TraversalJumman Hossain, Nirmalya RoyICML 2025
- Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement LearningVittorio Giammarino, Ahmed Hussain QureshiICLR 2026 · 被引用 7 次
- Unsupervised Metric Learning with Synthetic ExamplesUjjal Kr Dutta, Mehrtash Harandi, C. Chandra SekharAAAI 2020 · 被引用 14 次
