Continuous Learning and Online Adaptation for Non-Stationary Stock Markets: Addressing Concept Drift in Graph-Based State Space Models

Keywords

Concept Drift
Continuous Learning

Abstract

Financial markets are inherently non-stationary systems where the statistical relationships between predictive features and stock returns evolve continuously over time. This phenomenon, known as concept drift, poses a fundamental challenge for machine learning models trained on historical data, as patterns that held during training may no longer apply during deployment. The Stock State Space Graph model introduced by Lu, Hu, and Zhang achieves impressive prediction accuracy by integrating state space modeling with graph-based relational reasoning, yet it is designed for stationary settings where model parameters remain fixed after training. This paper proposes Adaptive Stock State Space Graph (A-S3G), a framework that extends the S3G architecture through continuous learning mechanisms that detect and adapt to concept drift in real-time. Our approach integrates concept drift detection using statistical monitoring and change point detection, online learning algorithms for incremental model updates, and elastic weight consolidation to prevent catastrophic forgetting of previously learned patterns. Through extensive experiments on benchmark financial datasets spanning multiple market cycles, we demonstrate that A-S3G substantially outperforms static S3G baselines in non-stationary environments, maintaining predictive accuracy during market regime transitions while preserving performance on previously learned patterns. Our work contributes to the growing literature on continuous learning in finance, providing a principled framework for deploying adaptive prediction models in dynamic market environments.

References

1. Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014). A survey on concept drift adaptation. ACM Computing Surveys, 46(4), 1-37.

2. Lu, Y., Hu, K., & Zhang, L. (2026, May). S3G: Stock State Space Graph for Enhanced Stock Trend Prediction. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 4081-4085). IEEE.

3. Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., ... & Hadsell, R. (2017). Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, 114(13), 3521-3526.

4. Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., & Sun, M. (2020). Graph neural networks: A survey of methods and applications. AI Open, 1, 57-81.

5. Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41(1/2), 100-115.

6. Hinkley, D. V. (1970). Inference about the change-point from cumulative sum tests. Biometrika, 57(1), 1-17.

7. Ross, G. J., Tasoulis, D. K., & Adams, N. M. (2011). Nonparametric statistical diagnosis: Key trends and applications. Statistical Methods in Medical Research, 20(5), 451-467.

8. Cugliari, J., & Goude, Y. (2023). Time series forecasting in non-stationary environments: A review. International Journal of Forecasting, 39(1), 1-27.

9. Hocquard, A., L'Heveder, G., & Bruckstein, A. (2021). Online learning for deep neural networks in financial time series prediction. Journal of Computational Finance, 24(4), 1-24.

10. Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020). Federated optimization in heterogeneous networks. In Proceedings of the 1st MLSys Conference on Machine Learning and Systems (MLSys).

11. Dietterich, T. G. (2002). Machine learning for sequential data: A review. In Structural, Syntactic, and Statistical Pattern Recognition (pp. 15-30). Springer.

12. Alberg, D., & Last, M. (2022). Brief overview of concept drift. WIREs Data Mining and Knowledge Discovery, 12(3), e1442.

13. Malini, S., & Pushpa, M. (2023). Adaptive graph neural networks for streaming time series. IEEE Transactions on Neural Networks and Learning Systems, 34(8), 4123-4136.

14. Chen, Z., & Liu, B. (2016). Lifelong machine learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 10(3), 1-145.

15. Hadsell, R., Rao, D., Rusu, A. A., & Pascanu, R. (2020). Embracing change: Continual learning in deep neural networks. Trends in Cognitive Sciences, 24(12), 1028-1040.