Neural Distance Embeddings for Biological Sequences
Gabriele Corso, Zhitao Ying, Michal Pándy, Petar Velickovic, Jure Leskovec, Pietro Liò
Abstract
The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research. However, popular machine learning approaches, based on continuous Euclidean spaces, have struggled with the discrete combinatorial formulation of the edit distance that models evolution and the hierarchical relationship that characterises real-world datasets. We present Neural Distance Embeddings (NeuroSEED), a general framework to embed sequences in geometric vector spaces, and illustrate the effectiveness of the hyperbolic space that captures the hierarchical structure and provides an average 22% reduction in embedding RMSE against the best competing geometry. The capacity of the framework and the significance of these improvements are then demonstrated devising supervised and unsupervised NeuroSEED approaches to multiple core tasks in bioinformatics. Benchmarked with common baselines, the proposed approaches display significant accuracy and/or runtime improvements on real-world datasets. As an example for hierarchical clustering, the proposed pretrained and from-scratch methods match the quality of competing baselines with 30x and 15x runtime reduction, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 679f4589-5ecb-4b62-aa7b-cdc5d3daf303Cited by top-tier papers6
- Fast Hyperboloid Decision Tree AlgorithmsPhilippe Chlenski, Ethan Turok, Antonio Khalil Moretti, Itsik Pe'erICLR 2024 · 7 citations
- Deep Squared Euclidean Approximation to the Levenshtein Distance for DNA StorageAlan J. X. Guo, Cong Liang, Qing-Hu HouICML 2022 · 5 citations
- Neural Embeddings for kNN Search in Biological SequenceZhihao Chang, Linzhu Yu, Yanchao Xu, Wentao HuAAAI 2024 · 4 citations
- Levenshtein Distance Embedding with Poisson Regression for DNA StorageXiang Wei, Alan J. X. Guo, Sihan Sun, Mengyi Wei et al.AAAI 2024 · 2 citations
- DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS ChannelAlan J. X. Guo, Sihan Sun, Xiang Wei, Mengyi Wei et al.NeurIPS 2025
Builds on5
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical ClusteringInes Chami, Albert Gu, Vaggos Chatziafratis, Christopher RéNeurIPS 2020 · 125 citations
- Mixed-curvature Variational AutoencodersOndrej Skopek, Octavian-Eugen Ganea, Gary BécigneulICLR 2020 · 122 citations
- Low-Dimensional Hyperbolic Knowledge Graph EmbeddingsInes Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala et al.ACL 2020 · 48 citations
- Convolutional Embedding for Edit DistanceXinyan Dai, Xiao Yan, Kaiwen Zhou, Yuxuan Wang et al.SIGIR 2020 · 27 citations
Related papers
- General Neural Embedding for Sequence Distance ApproximationZhihao Chang, Ding Wang, Xiu Tang, Kingsum Chow et al.SIGIR 2025
- Hyperbolic Genome EmbeddingsRaiyan R. Khan, Philippe Chlenski, Itsik Pe'erICLR 2025
- HyperMiner: Topic Taxonomy Mining with Hyperbolic EmbeddingYishi Xu, Dongsheng Wang, Bo Chen, Ruiying Lu et al.NeurIPS 2022 · 38 citations
- HEEGNet: Hyperbolic Embeddings for EEGShanglin Li, Shiwen Chu, Okan Koç, Yi Ding et al.ICLR 2026 · 2 citations
- Hyperbolic Representation Learning: Revisiting and AdvancingMenglin Yang, Min Zhou, Rex Ying, Yankai Chen et al.ICML 2023 · 41 citations
