Conjugate Gradient Methods in Fitting Precipitation of Rainfall Data in Malaysia
Article Sidebar
Main Article Content
Abstract
Conjugate gradient method (CGM) is one of the most efficient numerical methods for solving unconstrained optimization problems. It is also known as an iterative method with simple formulation. The classical CGM has always been an interest to the current researchers in improving the formulation which are categorized into three-term (TTCGM), spectral (SCGM), hybrid and scaled CGM. Although there are many variations of the CGM available, choosing the most efficient and effective one for a particular problem can be a time-consuming process. In this study, spectral Hestenes-Stiefel (sHS) CGM with the greatest NOI and central processing time per unit (CPU time) is selected as the efficient method to be applied to the real-life problems in regression analysis. A data set of rainfall precipitation in Malaysia from year 2009 until 2019 is collected for data fitting purpose. The data set is transformed into a test function also defined as objective function. The approximate functions are generated from CG, Least Square, Trendline method for the relative error purpose. The estimation data for the year 2020 can be predicted using the approximate functions. The calculation of relative error of the linear and quadratic model for each method is calculated based on the estimation data for the year 2020 and its actual data. The numerical results show that the sHS CGM is a suitable and good alternative to solve the Least Square models.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
M. Dawahdeh, M. Mamat, M. Rivaie, and I. Sulaiman, “Application of conjugate gradient method for solution of regression models,” Journal of Advanced Science and Technology, vol. 29, no. 7, pp. 1754–1763, 2020.
E. Zuehlke, D. Yue, and F. You, “Conjugate gradient methods,” in Conjugate gradient methods. Available: https://optimization.mccormick.northwestern.edu/index.php/Conjugate_gradient_methods. [Accessed: Jul. 30, 2020].
A. Alhawarat, M. Mamat, M. Rivaie, & Z. Salleh, "An efficient hybrid conjugate gradient method with the strong wolfe-powell line search", Mathematical Problems in Engineering, vol. 2015, pp. 1-7, 2015, doi: 10.1155/2015/103517.
J. Nocedal and S. J. Wright, “Line search methods,” in Numerical Optimization, 2nd ed. New York, NY, USA: Springer, 2006, pp.30-65.
N. Zullpakkal, N. Aini, N. Ghani, N. Mohamed, N. Idalisa, and M. Rivaie, “Covid-19 data modelling using hybrid conjugate gradient method”, Journal of Information and Optimization Sciences, vol. 43, no. 4, pp. 837-853, 2022, doi:10.1080/02522667.2022.2060610.
M. Hestenes, “The conjugate-gradient method for solving linear systems”, Proceedings of Symposia in Applied Mathematics, pp. 83-102, 1956, doi:10.1090/psapm/006/0084178.
E. Polak and G. Ribiere, "Note sur la convergence de methodes de directions conjuguees," ESAIM: Mathematical Modelling and Numerical Analysis-Modelisation Mathematique et Analyse Numerique, vol. 3, pp. 35-43, 1969, doi: 10.1051/m2an/196903R100351.
R. Fletcher, “Function minimization by conjugate gradients”, The Computer Journal, vol. 7, no. 2, pp. 149-154, 1964, doi:10.1093/comjnl/7.2.149.
Y. Liu, and C. Storey, “Efficient generalized conjugate gradient algorithms, part 1: theory”, Journal of Optimization Theory and Applications, vol. 69, no. 1, p. 129-137, 1991, doi:10.1007/bf00940464.
Y. Dai, and Y. Yuan, “A nonlinear conjugate gradient method with a strong global convergence property”, SIAM Journal on Optimization, vol. 10, no. 1, pp. 177-182, 1999, doi:10.1137/s1052623497318992.
X. Wu, Y. Zhu, and J. Yin, "A HS-PRP-type hybrid conjugate gradient method with sufficient descent property", Computational Intelligence and Neuroscience, vol. 2021, no. 1, 2021, doi:10.1155/2021/2087438.
P. Kumam, A. Abubakar, M. Malik, A. Ibrahim, N. Pakkaranang, and B. Panyanak, “A hybrid HS-LS conjugate gradient algorithm for unconstrained optimization with applications in motion control and image recovery”, Journal of Computational and Applied Mathematics, vol. 433, pp. 115304, 2023, doi:10.1016/j.cam.2023.115304.
N. Mohanty, and R. Nayak, “A new efficient hybrid conjugate gradient method based on LS-DY-HS conjugate gradient parameter”, International Journal of Mathematical Modelling and Numerical Optimisation, vol. 10, no. 4, pp. 342, 2020, doi:10.1504/ijmmno.2020.10031725.
A. Abubakar, P. Kumam, M. Malik, P. Chaipunya, and A. Ibrahim, “A hybrid FR-DY conjugate gradient algorithm for unconstrained optimization with application in portfolio selection”, AIMS Mathematics, vol. 6, no. 6, pp. 6506-6527, 2021, doi:10.3934/math.2021383.
A. Y. Al-Bayati, and H. N. Al-Khayat, “Different types of three-term CG-methods with sufficient descent and conjugacy conditions,” Journal of Zankoy Suleimani Part-A for Pure and Applied Sciences, vol. 16, no. 2, pp. 27–45, 2014.
K. Amini, and P. Faramarzi, “Global convergence of a modified spectral three-term CG algorithm for nonconvex unconstrained optimization problems", Journal of Computational and Applied Mathematics, vol. 417, pp. 114630, 2023, doi:10.1016/j.cam.2022.114630.
K. Kamfa, M. Y. Waziri, M. Mamat, M. A. Mohamed, and P. Liza, “A new modified three term CG search direction for solving unconstrained optimization problems,” Journal of Advanced Research in Modeling and Simulations, vol. 5, no. 1, pp. 23–30, 2018.
G. Abbass, N. Katbar, I. Memon, H. Chen, F. Tolasa, and G. Lubo, “Numerical optimization of large-scale monotone equations using the free-derivative spectral conjugate gradient method”, Frontiers in Applied Mathematics and Statistics, vol. 11, 2025, doi:10.3389/fams.2025.1477774.
D. Sahu, S. Sharma, and P. Gautam, “Modified Dai-Liao spectral conjugate gradient method with application to signal processing,” arXiv preprint, 2025, doi:10.48550/arXiv.2501.15300.
I. Sulaiman, and N. Salihu, “Two sufficient descent spectral conjugate gradient algorithms for unconstrained optimization with application”, Optimization and Engineering, vol. 26, no. 1, pp. 655-679, 2024, doi”10.1007/s11081-024-09899-z.
Y. Z. Teoh and Y. L. Loo, “A fundamental framework for analysis of rainfall prediction features significance”, Journal of Informatics and Web Engineering, vol. 4, no. 2, pp. 36–52, Jun. 2025, doi:10.33093/jiwe.2025.4.2.3.
K. Sene, “Rainfall forecasting,” in Flash Floods: Forecasting and Warning. Heidelberg, Germany: Springer, 2012, pp. 101–132.
S. Chattopadhyay, “Anticipation of summer monsoon rainfall over India by artificial neural network with conjugate gradient descent learning,” arXiv preprint, 2006, doi:10.48550/arXiv.nlin/0611010.
N. Zull, M. Rivaie, M. Mamat, Z. Salleh, and Z. Amani, “Global Convergence of a New Spectral Conjugate Gradient by Using Strong Wolfe Line Search,” Applied Mathematical Sciences, vol. 9, no. 63, pp. 3105–3117, 2015.
L. Zhang, W. Zhou, and D. Li, “Global convergence of a modified Fletcher–Reeves conjugate gradient method with Armijo-type line search", Numerische Mathematik, vol. 104, no. 4, pp. 561-572, 2006, doi:10.1007/s00211-006-0028-z.
J. Liu, and Y. Jiang, “Global convergence of a spectral conjugate gradient method for unconstrained optimization”, Abstract and Applied Analysis, vol. 2012, no. 1, 2012, doi:10.1155/2012/758287.
X. Du and J. Liu, “Global convergence of a spectral HS conjugate gradient method,” Procedia Engineering, vol. 15, pp. 1487–1492, 2011.
J. Liu, Y. Feng, and L. Zou, “A spectral conjugate gradient method for solving large-scale unconstrained optimization”, Computers & Mathematics With Applications, vol. 77, no. 3, pp. 731-739, 2019, doi:10.1016/j.camwa.2018.10.002.
N. Andrei, “An unconstrained optimization test functions collection,” Advanced Modeling and Optimization, vol. 10, no. 1, pp. 147–161, 2008.
S. Anushalache, P. Naveen, N. Kok-Why and A. Sandhya, “Climate change analysis in Malaysia using machine learning”, Journal of Informatics and Web Engineering, vol. 4, No. 1. February 2025, doi:10.33093/jiwe.2025.4.1.22.