AutoMLP: Automated MLP for Sequential Recommendations
Muyang Li, Zijian Zhang, Xiangyu Zhao, Wanyu Wang, Minghao Zhao, Runze Wu, Ruocheng Guo
Abstract
Sequential recommender systems aim to predict users' next interested item given their historical interactions. However, a longstanding issue is how to distinguish between users' long/short-term interests, which may be heterogeneous and contribute differently to the next recommendation. Existing approaches usually set predefined short-term interest length by exhaustive search or empirical experience, which is either highly inefficient or yields subpar results. The recent advanced transformer-based models can achieve state-of-the-art performances despite the aforementioned issue, but they have a quadratic computational complexity to the length of the input sequence. To this end, this paper proposes a novel sequential recommender system, AutoMLP, aiming for better modeling users' long/short-term interests from their historical interactions. In addition, we design an automated and adaptive search algorithm for preferable short-term interest length via end-to-end optimization. Through extensive experiments, we show that AutoMLP has competitive performance against state-of-the-art methods, while maintaining linear computational complexity. CCS CONCEPTS • Information systems → Recommender systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers18
- LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential RecommendationQidong Liu, Xian Wu, Yejing Wang, Zijian Zhang et al.NeurIPS 2024 · 154 citations
- Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense RepresentationsYuhao Yang, Zhi Ji, Zhaopeng Li, Yi Li et al.NeurIPS 2025 · 90 citations
- LinRec: Linear Attention Mechanism for Long-term Sequential Recommender SystemsLangming Liu, Liu Cai, Chi Zhang, Xiangyu Zhao et al.SIGIR 2023 · 86 citations
- End-to-end Learnable Clustering for Intent Learning in RecommendationYue Liu, Shihao Zhu, Jun Xia, Yingwei Ma et al.NeurIPS 2024 · 56 citations
- SIGMA: Selective Gated Mamba for Sequential RecommendationZiwei Liu, Qidong Liu, Yejing Wang, Wanyu Wang et al.AAAI 2025 · 31 citations
Builds on5
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- Pay Attention to MLPsHanxiao Liu, Zihang Dai, David R. So, Quoc V. LeNeurIPS 2021 · 912 citations
- Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest RecommendationKe Sun, Tieyun Qian, Tong Chen, Yile Liang et al.AAAI 2020 · 412 citations
- Rethinking Positional Encoding in Language Pre-trainingGuolin Ke, Di He, Tie-Yan LiuICLR 2021 · 358 citations
- AutoDim: Field-aware Embedding Dimension Searchin Recommender SystemsXiangyu Zhao, Haochen Liu, Hui Liu, Jiliang Tang et al.WWW 2021 · 69 citations
Related papers
- BlossomRec: Block-level Fused Sparse Attention Mechanism for Sequential RecommendationsMengyang Ma, Xiaopeng Li, Wanyu Wang, Zhaocheng Du et al.WWW 2026 · 1 citation
- Incremental Learning for Multi-Interest Sequential RecommendationZhikai Wang, Yanyan ShenICDE 2023 · 16 citations
- Length-Adaptive Interest Network for Balancing Long and Short Sequence Modeling in CTR PredictionZhicheng Zhang, Zhaocheng Du, Jieming Zhu, Jiwei Tang et al.AAAI 2026 · 2 citations
- Dynamic Memory based Attention Network for Sequential RecommendationQiaoyu Tan, Jianwei Zhang, Ninghao Liu, Xiao Huang et al.AAAI 2021 · 74 citations
- Multi-Grained Preference Enhanced Transformer for Multi-Behavior Sequential RecommendationChuan He, Yongchao Liu, Qiang Li, Weiqiang Wang et al.KDD 2025 · 1 citation
