Time-TK: A Multi-Offset Temporal Interaction Framework Combining Transformer and Kolmogorov-Arnold Networks for Time Series Forecasting
Fan Zhang, Shiming Fan, Hua Wang
Abstract
Time series forecasting is crucial for the World Wide Web and represents a core technical challenge in ensuring the stable and efficient operation of modern web services, such as intelligent transportation and website throughput. However, we have found that existing methods typically employ a strategy of embedding each time step as an independent token. This paradigm introduces a fundamental information bottleneck when processing long sequences, the root cause of which is that independent token embedding destroys a crucial structure within the sequence—what we term as multi-offset temporal correlation. This refers to the fine-grained dependencies embedded within the sequence that span across different time steps, which is especially prevalent in regular Web data. To fundamentally address this issue, we propose a new perspective on time series embedding. We provide an upper bound on the approximate reconstruction performance of token embedding, which guides our design of a concise yet effective Multi-Offset Time Embedding (MOTE) method to mitigate the performance degradation caused by standard token embedding. Furthermore, our MOTE can be integrated into various existing models and serve as a universal building block. Based on this paradigm, we further design a novel forecasting architecture named Time-TK. This architecture first utilizes a Multi-Offset Interactive KAN (MI-KAN) to learn and represent specific temporal patterns among multiple offset sub-sequences. Subsequently, it employs an efficient Multi-Offset Temporal Interaction mechanism (MOTI) to effectively capture the complex dependencies between these sub-sequences, achieving global information integration. Extensive experiments on 14 real-world benchmark datasets, covering domains such as traffic flow and BTC/USDT throughput, demonstrate that Time-TK significantly outperforms all baseline models, achieving state-of-the-art forecasting accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bfe6cd21-7666-4dd4-a03b-b007c7456ecfCited by top-tier papers1
Ask how each one uses itBuilds on24
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- SCINet: Time Series Modeling and Forecasting with Sample Convolution and InteractionMinhao Liu, Ailing Zeng, Muxi Chen, Zhijian Xu et al.NeurIPS 2022 · 934 citations
- TimeMixer: Decomposable Multiscale Mixing for Time Series ForecastingShiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu et al.ICLR 2024 · 573 citations
Related papers
- TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise DecodingKuiye Ding, Fanda Fan, Chunyi Hou, Zheya Wang et al.AAAI 2026 · 4 citations
- TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series ForecastingJaebin Lee, Hankook LeeNeurIPS 2025 · 1 citation
- Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and MissingnessJinkwan Jang, Hyungjin Park, Jinmyeong Choi, Taesup KimICLR 2026 · 2 citations
- TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series ForecastingSongtao Huang, Zhen Zhao, Can Li, Lei BaiICLR 2025
- Byte Pair Encoding for Efficient Time Series ForecastingLeon Götz, Marcel Kollovieh, Stephan Günnemann, Leo SchwinnICML 2026
