Performance Evaluation of Machine Learning Techniques on Resolution Time Prediction in Helpdesk Support System
Article Sidebar
Main Article Content
Abstract
Estimating incident resolution times accurately is critical to maintaining an effective resource allocation for customer service. In order to meet this need, this paper explores machine learning techniques widely applied in the Resolution Time Prediction and identify the performance of chosen approaches via benchmarking dataset. The proposed method starts with data preprocessing, such as removing outliers and missing values and determining any irregularities in the resolution times distribution. Subsequently, we automatically choose the most relevant features using various statistical techniques. As the last stage of our prediction pipeline, we will apply different machine learning approaches the dataset to find the effectiveness of model and conclude the best technique based on the model accuracy and model fitting time. By applying this strategy, we hope to gain a better understanding of the factors affecting incident resolution times, which will eventually result in better resource allocation and planning for customer support operations.
[Manuscript received: 19 Apr 2024 | Accepted: 24 Jun 2024 | Published: : 30 Sep 2024]
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Y. Ayodeji, H. Rjoub and H. Ozgit, “Achieving sustainable customer loyalty in airports: The role of waiting time satisfaction and self-service technologies”, Technology in Society, vol. 72, no. 102106, 2023.
DOI: https://doi.org/10.1016/j.techsoc.2022.102106
T.E. Tai, S.C. Haw, K.W. Ng, M. Al-Tarawneh and G.K. Tong, “Performance evaluation on resolution time prediction using machine learning techniques”, JOIV: International Journal on Informatics Visualization, vol. 8, no. 2, pp. 583-591, 2024.
DOI: https://doi.org/10.62527/joiv.8.2.2305
L. Jenneboer, C. Herrando and E. Constantinides, “The impact of chatbots on customer loyalty: a systematic literature review”, Journal of Theoretical and Applied Electronic Commerce Research, vol. 17, no. 1, pp. 212-229, 2022.
DOI: https://doi.org/10.3390/jtaer17010011
P. Ambardekar, A. Jamthe and M. Chincholkar, “Predicting defect resolution time using cosine similarity,” International Conference on Data and Software Engineering (ICoDSE), pp. 1-6, 2017.
DOI: https://doi.org/10.1109/ICODSE.2017.8285884
F. Al-Hawari and H. Barham, “A machine learning based help desk system for IT service management", Journal of King Saud University - Computer and Information Sciences, vol. 33, no. 6, pp. 702-718, 2021.
DOI: https://doi.org/10.1016/j.jksuci.2019.04.001
S.C. Haw, K. Ong, L.J. Chew, K.W. Ng, P. Naveen and E.A. Anaam, “Improving the prediction resolution time for customer support ticket system”, Journal of System and Management Sciences, vol. 12, no. 6, pp. 1-16, 2022.
DOI: https://doi.org/10.33168/JSMS.2022.0601
L.S.B. Pereira, R. Pizzio, S. Bonho, L.M.F. De Souza and A.C. Arnoni Junior, “Machine learning for classification of IT support tickets,” International Conference On Cyber Management And Engineering, pp. 210-213, 2023.
DOI: https://doi.org/10.1109/CyMaEn57228.2023.10051041
M.K. Yucel and A. Tosun, “Measuring bug reporter's reputation and its effect on bug resolution time prediction,” 7th International Conference on Computer Science and Engineering, pp. 110-115, 2022.
DOI: https://doi.org/10.1109/UBMK55850.2022.9919454
M. Mamedov, K. Vorontsova, E. Treshcheva and I. Itkin, “Building a reusable defect resolution time prediction model based on a massive open-source dataset: an industrial report,” IEEE International Conference on Artificial Intelligence Testing, pp. 73-80, 2021.
DOI: https://doi.org/10.1109/AITEST52744.2021.00023
H. Wu, L. Shi, C. Chen, Q. Wang and B. Boehm, “Maintenance effort estimation for open source software: a systematic literature review,” IEEE International Conference on Software Maintenance and Evolution, pp. 32-43, 2016.
DOI: https://doi.org/10.1109/ICSME.2016.87
M.N. Omri and W. Mribah, “Towards an intelligent machine learning-based business approach”, International Journal of Intelligent Systems and Applications, vol. 14, no. 1, pp. 1-23, 2022.
DOI: https://doi.org/10.5815/ijisa.2022.01.01
B.C. Holtom and T.C. Burch, “A model of turnover-based disruption in customer services”, Human Resource Management Review, vol. 26, no. 1, pp. 25-36, 2016.
DOI: https://doi.org/10.1016/j.hrmr.2015.09.004
K.K. Jha, R. Jha, A.K. Jha, M.A.M. Hassan, S.K. Yadav and T. Mahesh, “A brief comparison on machine learning algorithms based on various applications: a comprehensive survey,” IEEE International Conference on Computation System and Information Technology for Sustainable Solutions, pp. 1-5, 2021.
DOI: https://doi.org/10.1109/CSITSS54238.2021.9683524
J. Zhang, Y. Zeng and B. Starly, “Recurrent neural networks with long term temporal dependencies in machine tool wear diagnosis and prognosis,” Discover Applied Sciences, vol. 3, no. 442, 2021.
DOI: https://doi.org/10.1007/s42452-021-04427-5
J. Xue, R. Birke, L. Y. Chen and E. Smirni, “Managing data center tickets: prediction and active sizing,” IEEE/IFIP International Conference on Dependable Systems and Networks, pp. 335-346, 2016.
DOI: https://doi.org/10.1109/DSN.2016.38
N.A. Harun, S.H. Huspi and N.A. Iahad, “Question classification framework for helpdesk ticketing support system using machine learning,” 7th International Conference on Research and Innovation in Information Systems, pp. 1-7, 2021.
DOI: https://doi.org/10.1109/ICRIIS53035.2021.9617077
B.T. Jijo and A.M. Abdulazeez, “Classification based on decision tree algorithm for machine learning”, Journal of Applied Science and Technology Trends, vol. 2, no. 1, pp. 20 - 28, 2021.
DOI: https://doi.org/10.38094/jastt20165
S. Shah, “Automatic ticket assignment using machine learning and deep learning techniques”. Master of Science in Data Analytics thesis, School of Computing, National College of Ireland, Ireland, 2021.
URL: https://norma.ncirl.ie/4416/
S.P. Paramesh, C. Ramya and K.S. Shreedhara, “Classifying the unstructured IT service desk tickets using ensemble of classifiers,” 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions, pp. 221-227, 2018.
DOI: https://doi.org/10.1109/CSITSS.2018.8768734
G. Laudato, R. Oliveto, S. Scalabrino, A..R Colavita, L. De Vito, F. Picariello and I. Tudosa, “Identification of R-peak occurrences in compressed ECG signals,” IEEE International Symposium on Medical Measurements and Applications, pp. 1-6, 2020.
DOI: https://doi.org/10.1109/MeMeA49120.2020.9137207
S. Fatima, A. Hussain, S. bin Amir, S.H. Ahmed and S.M.H. Aslam, “XGBoost and random forest algorithms: An in depth analysis”, Pakistan Journal of Scientific Research, vol. 3, no. 1, pp. 26–31, 2023.
DOI: https://doi.org/10.57041/pjosr.v3i1.946
M. Zou, W.G. Jiang, Q.H. Qin, Y.C. Liu and M.L. Li, “Optimized XGBoost model with small dataset for predicting relative density of Ti-6Al-4V parts manufactured by selective laser melting”, Materials, vol. 15, no. 15, 5298, 2022.
DOI: https://doi.org/10.3390/ma15155298
R.K. Dhanaraj, V. Ramakrishnan, M. Poongodi, L. Krishnasamy, M. Hamdi, K. Kotecha and V. Vijayakumar, “Random forest bagging and X-Means clustered antipattern detection from SQL query log for accessing secure mobile data”, Wireless Communications and Mobile Computing, vol. 2021, no.1, pp. 1-9, 2021.
DOI: https://doi.org/10.1155/2021/2730246
R.Y. Sun, “Optimization for deep learning: an overview”, Journal of the Operations Research Society of China, vol. 8, pp. 249–294, 2020.
DOI: https://doi.org/10.1007/s40305-020-00309-6
A. Borg, J. Ahlstrand and M. Boldt, “Predicting e-mail response time in corporate customer support”, 22nd International Conference on Enterprise Information Systems, vol. 1, pp. 305-314, 2020.
DOI: https://doi.org/10.5220/0009347303050314
M. Yildiz, A. Alsaç, T. Ulusinan, M.C. Ganiz and M.M. Yenisey, “IT support ticket completion time prediction,” 7th International Conference on Computer Science and Engineering, pp. 198-203, 2022.
DOI: https://doi.org/10.1109/UBMK55850.2022.9919591
A.A. Gerunov, “Forecasting customer support resolution times through automated machine learning”, Economics and Management, vol. 19, no. 2, pp. 1-11, 2022.
J. Gesi, H. Wang, B. Wang, A. Truelove, J. Park and I. Ahmed, “Out of time: a case study of using team and modification representation learning for improving bug report resolution time prediction in eBay”, Information and Software Technology, unpublished.