Using Echo State Network based on Ridge Regression for Time Series Forecasting
DOI:
https://doi.org/10.62933/aej59z81Abstract
Studying climate in terms of predicting evaporation quantities through changing many factors and climate variables is of great importance to reduce the risks of climate change and its impact on many environmental phenomena affecting human and plant health. Weather patterns and conditions will be analyzed for a limited period of time. In this study, Ridge Regression (RR) was used to identify components, address the problem of multicollinearity and multicollinearity, and overcome the problem of multicollinearity of the reconstructed inputs. The problem of multicollinearity occurs when building a multiple linear regression model, i.e. the presence of a strong correlation between the predictive variables, and this correlation leads to an increase in the variance of the regression parameter estimates and obtaining unstable estimates. Forecasting chaotic time series represented by climate data affecting the evaporation time series often suffers from the problem of nonlinearity in addition to multicollinearity. The Echo State Network (ESN) is a neural network specialized in predicting time series after addressing the problem of synchronization with the time variable as a recurrent network to address time-dependent effects and accurate prediction of time series in addition to nonlinear modeling. RR provides accurate predictions due to its structural effect to avoid overfitting while ESN will address the nonlinearity problem in addition to the problems addressed by RR model which ESN structure is based on. The expected results show that ESN model based on RR significantly outperforms traditional models in multivariate time series forecasting.
References
[1] Duan, H., & Wang, X. (2015). Echo state networks with orthogonal pigeon-inspired optimization for image restoration. IEEE Transactions on Neural Networks and Learning Systems, 27(11), 2413-2425.
[2] Ebrahimi Khusfi, Z., Roustaei, F., Ebrahimi Khusfi, M., & Naghavi, S. (2020). Investigation of the relationship between dust storm index, climatic parameters, and normalized difference vegetation index using the ridge regression method in arid regions of Central Iran. Arid land research and management, 34(3), 239-263.
[3] Grover, R., & Sharma, S. (2024). Impact of Climate Change on Rainfall Pattern by using Ridge Regression Analysis. Paper presented at the 2024 International Conference on Computational Intelligence and Computing Applications (ICCICA).
[4] Han, M., & Xu, M. (2017). Laplacian echo state network for multivariate time series prediction. IEEE Transactions on Neural Networks and Learning Systems, 29(1), 238-244.
[5] Hyndman, R. J., & Koehler, A. B. (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22(4), 679-688.
[6] Kim, T., & King, B. R. (2020). Time series prediction using deep echo state networks. Neural Computing and Applications, 32(23), 17769-17787.
[7] Ma, Q., Chen, E., Lin, Z., Yan, J., Yu, Z., & Ng, W. W. (2019). Convolutional multitimescale echo state network. IEEE Transactions on Cybernetics, 51(3), 1613-1625.
[8] Malig, B. J., Pearson, D. L., Chang, Y. B., Broadwin, R., Basu, R., Green, R. S., & Ostro, B. (2016). A time-stratified case-crossover study of ambient ozone exposure and emergency department visits for specific respiratory diagnoses in California (2005–2008). Environmental health perspectives, 124(6), 745-753.
[9] Peng, Y., Lei, M., Li, J.-B., & Peng, X.-Y. (2014). A novel hybridization of echo state networks and multiplicative seasonal ARIMA model for mobile communication traffic series forecasting. Neural Computing and Applications, 24, 883-890.
[10] Qiao, J., Li, F., Han, H., & Li, W. (2016). Growing echo-state network with multiple subreservoirs. IEEE Transactions on Neural Networks and Learning Systems, 28(2), 391-404.
[11] Tobias, A., Armstrong, B., & Gasparrini, A. (2014). Analysis of time-stratified case-crossover studies in environmental epidemiology using Stata. Paper presented at the United Kingdom Stata Users' Group Meetings 2014.
[12] Viehweg, J., Worthmann, K., & Mäder, P. (2023). Parameterizing echo state networks for multi-step time series prediction. Neurocomputing, 522, 214-228.
[13] Yang, C., Qiao, J., Wang, L., & Zhu, X. (2019). Dynamical regularized echo state network for time series prediction. Neural Computing and Applications, 31, 6781-6794.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Raed Arif Snaan, Osamah Basheer Shukur (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Licensed under a CC-BY license: https://creativecommons.org/licenses/by-nc-sa/4.0/
