CI-STHPAN: Pre-trained Attention Network for Stock Selection with Channel-Independent Spatio-Temporal Hypergraph
Hongjie Xia, Huijie Ao, Long Li, Yu Liu, Sen Liu, Guangnan Ye, Hongfeng Chai
Abstract
Quantitative stock selection is one of the most challenging FinTech tasks due to the non-stationary dynamics and complex market dependencies. Existing studies rely on channel mixing methods, exacerbating the issue of distribution shift in financial time series. Additionally, complex model structures they build make it difficult to handle very long sequences. Furthermore, most of them are based on predefined stock relationships thus making it difficult to capture the dynamic and highly volatile stock markets. To address the above issues, in this paper, we propose Channel-Independent based Spatio-Temporal Hypergraph Pre-trained Attention Networks (CI-STHPAN), a two-stage framework for stock selection, involving Transformer and HGAT based stock time series self-supervised pre-training and stock-ranking based downstream task fine-tuning. We calculate the similarity of stock time series of different channel in dynamic intervals based on Dynamic Time Warping (DTW), and further construct channel-independent stock dynamic hypergraph based on the similarity. Experiments with NASDAQ and NYSE markets data over five years show that our framework outperforms SOTA approaches in terms of investment return ratio (IRR) and Sharpe ratio (SR). Additionally, we find that even without introducing graph information, self-supervised learning based on the vanilla Transformer Encoder also surpasses SOTA results. Notable improvements are gained on the NYSE market. It is mainly attributed to the improvement of fine-tuning approach on Information Coefficient (IC) and Information Ratio based IC (ICIR), indicating that the fine-tuning method enhances the accuracy and stability of the model prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext aff9d78a-6ec1-4f37-b5b6-4f4cbbb66acfCited by top-tier papers5
- FactorGCL: A Hypergraph-Based Factor Model with Temporal Residual Contrastive Learning for Stock Returns PredictionYitong Duan, Weiran Wang, Jian LiAAAI 2025 · 13 citations
- TSPRank: Bridging Pairwise and Listwise Methods with a Bilinear Travelling Salesman ModelWeixian Waylon Li, Yftah Ziser, Yifei Xie, Shay B. Cohen et al.KDD 2025 · 2 citations
- TimeMar: Multi-Scale Autoregressive Modeling for Unconditional Time Series GenerationXiangyu Xu, Qingsong Zhong, Jilin HuWWW 2026 · 1 citation
- Integrating Inductive Biases in Transformers via Distillation for Financial Time Series ForecastingYu-Chen Den, Kuan-Yu Chen, Kendro Vincent, Tien-Hao ChangKDD 2026 · 1 citation
- Pre-training Time Series Models with Stock Data CustomizationMengyu Wang, Tiejun Ma, Shay B. CohenKDD 2025 · 1 citation
Builds on13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
Related papers
- Stock Selection via Spatiotemporal Hypergraph Attention Network: A Learning to Rank ApproachRamit Sawhney, Shivam Agarwal, Arnav Wadhwa, Tyler Derr et al.AAAI 2021 · 183 citations
- Exploring the Scale-Free Nature of Stock Markets: Hyperbolic Graph Learning for Algorithmic TradingRamit Sawhney, Shivam Agarwal, Arnav Wadhwa, Rajiv Ratn ShahWWW 2021 · 52 citations
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 536 citations
- Relational Temporal Graph Convolutional Networks for Ranking-Based Stock PredictionZetao Zheng, Jie Shao, Jia Zhu, Heng Tao ShenICDE 2023 · 14 citations
- Dynamic Hypergraph Convolutional NetworkNan Yin, Fuli Feng, Zhigang Luo, Xiang Zhang et al.ICDE 2022 · 40 citations
