Lune

EMNLP Findings2021

Geo-BERT Pre-training Model for Query Rewriting in POI Search

Xiao Liu, Juan Hu, Qi Shen, Huan Chen

摘要

Query Rewriting (QR) is proposed to solve the problem of the word mismatch between queries and documents in Web search. Existing approaches usually model QR with an end-to-end sequence-to-sequence (seq2seq) model. The state-of-the-art Transformer-based models can effectively learn textual semantics from user session logs, but they often ignore users' geographic location information that is crucial for the Point-of-Interest (POI) search of map services. In this paper, we proposed a pretraining model, called Geo-BERT, to integrate semantics and geographic information in the pre-trained representations of POIs. Firstly, we simulate POI distribution in the real world as a graph, in which nodes represent POIs and multiple geographic granularities. Then we use graph representation learning methods to get geographic representations. Finally, we train a BERT-like pre-training model with text and POIs' graph embeddings to get an integrated representation of both geographic and semantic information, and apply it in the QR of POI search. The proposed model achieves excellent accuracy on a wide range of real-world datasets of map services.

问 Lune

几分钟读透这篇 Paper,不用再花一下午。

Lune 能读完全文,也能读引用它的顶会 Paper,讲清它的结论、证据和局限,每一点都注明出自哪篇 Paper。不用硬啃,也不靠猜。

已有 1 篇顶会 Paper 引用了它。别等审稿人问起,先弄清它们发现了什么。

可以从这些问题问起

Lune 可以查阅

全文 · 引用它的顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

脉络

它引用的引用它的从左到右按年份排列,引用越多,位置越高。

引用它的顶会 Paper1

  1. MGeo: Multi-Modal Geographic Language Model Pre-TrainingRuixue Ding, Boli Chen, Pengjun Xie, Fei Huang 等SIGIR 2023 · 29 次引用

它引用的 Paper1

  1. Incorporating BERT into Neural Machine TranslationJinhua Zhu, Yingce Xia, Lijun Wu, Di He 等ICLR 2020 · 391 次引用

相关 Paper

  1. SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity RepresentationZekun Li, Jina Kim, Yao-Yi Chiang, Muhao ChenEMNLP Findings 2022 · 35 次引用
  2. ConvGQR: Generative Query Reformulation for Conversational SearchFengran Mo, Kelong Mao, Yutao Zhu, Yihong Wu 等ACL 2023 · 29 次引用
  3. Spatio-Temporal Dual Graph Attention Network for Query-POI MatchingZixuan Yuan, Hao Liu, Yanchi Liu, Denghui Zhang 等SIGIR 2020 · 59 次引用
  4. U-BERT: Pre-training User Representations for Improved RecommendationZhaopeng Qiu, Xian Wu, Jingyue Gao, Wei FanAAAI 2021 · 171 次引用
  5. GraphCodeBERT: Pre-training Code Representations with Data FlowDaya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng 等ICLR 2021 · 1,644 次引用
黄昏的海面,两侧是细线勾勒的悬崖