AI-Based Load Balancing Using Decision Tree Regressor for Parallel Matrix Computation in Cloud Environments

Lina Sarkawt Hiwa; Zryan Najat Rashid

doi:10.24017/science.2025.2.4

Authors

Lina Sarkawt Hiwa Department of Information Technology, Technical College of Informatics, Sulaimani Polytechnic University
Zryan Najat Rashid Department of Computer Networks, Technical College of Informatics, Sulaimani Polytechnic University https://orcid.org/0000-0003-3479-5510

Abstract

Cloud computing is an evolving technology of current information systems that supports dynamic sharing and elastic provision of resources and services. With increasing demands for computational resources, efficient workload assignment has become an important challenge. Current load balancing methods based on traditional approaches fail to suit dynamic server performance and contribute to the inefficient utilization of available resources, latency, and delays. In response to this challenge, this paper suggests an AI-driven load balancer based on a decision tree regressor to dynamically control task allocation within a parallel cloud system. The system operates to handle computationally heavy tasks, i.e., matrix multiplication, across different servers based on real-time performance measures such as Central Processing Unit (CPU) usage, memory utilization, time of execution, and networking latency. Model training was done with historical data obtained from past executions, incorporated into the web server to facilitate adaptive decision-making. It was tested experimentally with different levels of server scalability as well as matrix complexity. It was contrasted with a static, manual load balancer. All critical performance measures were found to be significantly improved by the AI-based methodology, with the total execution time reduced from 7,060 milliseconds to 1,000 milliseconds; network latency was also reduced to 5.12 ms, down from 214 ms; and the method reduced the overall use of CPU by 33% and overall use of memory by more than 85%. These findings confirm that intelligent, data-driven load balancing offers superior scalability, responsiveness, and efficiency for cloud-based parallel processing systems.

Keywords:

AI-Based Load Balancing, Cloud computing, Parallel processing, Machine learning, Decision Tree Regressor

References

T. Khan, W. Tian, and R. Buyya, “Machine learning (ML)-centric resource management in cloud computing: A review and future directions,” arXiv preprint arXiv:2105.05079, May 2021. [Online]. Available: http://arxiv.org/abs/2105.05079

D. A. Shafiq, N. Z. Jhanjhi, and A. Abdullah, “Load balancing techniques in cloud computing environment: A review,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 7, pp. 3910–3933, Jul. 2022, doi: 10.1016/j.jksuci.2021.02.007. DOI: https://doi.org/10.1016/j.jksuci.2021.02.007

R. Islam et al., “The future of cloud computing: Benefits and challenges,” International Journal of Communications, Network and System Sciences, vol. 16, no. 04, pp. 53–65, 2023, doi: 10.4236/ijcns.2023.164004. DOI: https://doi.org/10.4236/ijcns.2023.164004

R. Younis, M. Iqbal, K. Munir, M. A. Javed, M. Haris, and S. Alahmari, “A comprehensive analysis of cloud service models: IaaS, PaaS, and SaaS in the context of emerging technologies and trend,” in 5th International Conference on Elec-trical, Communication and Computer Engineering, ICECCE 2024, Institute of Electrical and Electronics Engineers Inc., 2024. doi: 10.1109/ICECCE63537.2024.10823401. DOI: https://doi.org/10.1109/ICECCE63537.2024.10823401

N. S. Aldahwan and M. S. Ramzan, “Descriptive literature review and classification of community cloud computing research,” Scientific Programming, vol. 2022, 2022, doi: 10.1155/2022/8194140. DOI: https://doi.org/10.1155/2022/8194140

P. Goswami, N. Faujdar, S. Debnath, A. K. Khan, and G. Singh, “Investigation on storage level data integrity strategies in cloud computing: classification, security obstructions, challenges and vulnerability,” Journal of Cloud Computing, vol. 13, no. 1, Art. 45, Dec. 2024, Springer Science and Business Media Deutschland GmbH, doi: 10.1186/s13677-024-00605-z. DOI: https://doi.org/10.1186/s13677-024-00605-z

F. Khoda Parast, C. Sindhav, S. Nikam, H. Izadi Yekta, K. B. Kent, and S. Hakak, “Cloud computing security: A survey of service-based models,” Comput Secur, vol. 114, Mar. 2022, doi: 10.1016/j.cose.2021.102580. DOI: https://doi.org/10.1016/j.cose.2021.102580

N. Chauhan et al., “A systematic literature review on task allocation and performance management techniques in cloud data center,” Computer Systems Science and Engineering, vol. 48, no. 3, pp. 571–608, 2024, doi: 10.32604/csse.2024.042690. DOI: https://doi.org/10.32604/csse.2024.042690

K. Mishra and S. K. Majhi, “A state-of-art on cloud load balancing algorithms,” International Journal of Computing and Digital Systems, vol. 9, no. 2, pp. 201–220, Mar. 2020, doi: 10.12785/IJCDS/090206. DOI: https://doi.org/10.12785/ijcds/090206

A. K. Moses, A. J. Bamidele, O. R. Oluwaseun, S. Misra, and A. A. Emmanuel, “Applicability of MMRR load balancing algorithm in cloud computing,” International Journal of Computer Mathematics: Computer Systems Theory, vol. 6, no. 1, pp. 7–20, 2021, doi: 10.1080/23799927.2020.1854864. DOI: https://doi.org/10.1080/23799927.2020.1854864

N. Devi, K. Rajalakshmi, R. Parthasarathy, and G. Kousalya, “A systematic literature review for load balancing and task scheduling techniques in cloud computing,” Artificial Intelligence Review, vol. 57, no. 10, Oct. 2024, doi: 10.1007/s10462-024-10925-w. DOI: https://doi.org/10.1007/s10462-024-10925-w

Z. S. Ageed, M. R. Mahmood, M. S. Sadeeq, M. B. Abdulrazzaq, and H. I. Dino, “Cloud computing resources impacts on heavy load parallel processing approaches,” IOSR Journal of Computer Engineering (IOSR JCE), vol. 22, no. 3, Ser. IV, pp. 30–41, May–June 2020, doi: 10.9790/0661-2203043041.

K. Rajammal and M. Chinnadurai, “Dynamic load balancing in cloud computing using predictive graph networks and adaptive neural scheduling,” Scientific Reports, vol. 15, no. 1, Dec. 2025, doi: 10.1038/s41598-025-97494-2. DOI: https://doi.org/10.1038/s41598-025-97494-2

Z. A. Aziz, D. N. Abdulqader, A. B. Sallow, and H. K. Omer, “Python parallel processing and multiprocessing: a re-view,” Academic Journal of Nawroz University, vol. 10, no. 3, pp. 345–354, Aug. 2021, doi: 10.25007/ajnu.v10n3a1145. DOI: https://doi.org/10.25007/ajnu.v10n3a1145

M. H. Kashani and E. Mahdipour, “Load balancing algorithms in fog computing,” IEEE Transactions on Services Compu-ting, vol. 16, no. 2, pp. 1505–1521, Mar. 2023, doi: 10.1109/TSC.2022.3174475. DOI: https://doi.org/10.1109/TSC.2022.3174475

M. Vijayaraj, R. M. Vizhi, P. Chandrakala, L. H. Alzubaidi, K. Muzaffar, and R. Senthilkumar, “Parallel and distributed computing for high-performance applications,” E3S Web of Conferences, vol. 399, Art. no. 04039, 10 pp., Jul. 2023, doi: 10.1051/e3sconf/202339904039 DOI: https://doi.org/10.1051/e3sconf/202339904039

S. Dahake and R. Y. Nagpure, “Research paper on basic parallel processing,” IOSR Journal of Engineering (IOSR-JEN), vol. 2, pp. 77–83, presented at the 2nd National Conference on Recent Trends in Computer Science and Information Technology, Nagpur, India, 2019. [Online]. Available: https://www.iosrjen.org/Papers/Conf.19021-2019/Volume-2/14.%2077-83.pdf [Accessed: Jun. 2, 2025].

H. Blockeel, L. Devos, B. Frénay, G. Nanfack, and S. Nijssen, “Decision trees: from efficient prediction to responsible AI,” Frontiers in Artificial Intelligence, vol. 6, 2023, doi: 10.3389/frai.2023.1124553. DOI: https://doi.org/10.3389/frai.2023.1124553

I. D. Mienye, Y. Sun, and Z. Wang, “Prediction performance of improved decision tree-based algorithms: A review,” in Procedia Manufacturing, Elsevier B.V., 2019, pp. 698–703. doi: 10.1016/j.promfg.2019.06.011. DOI: https://doi.org/10.1016/j.promfg.2019.06.011

A. A. Mahamat et al., “Decision tree regression vs. gradient boosting regressor models for the prediction of hygroscopic properties of Borassus fruit fiber,” Applied Sciences (Switzerland), vol. 14, no. 17, Sep. 2024, doi: 10.3390/app14177540. DOI: https://doi.org/10.3390/app14177540

J. Singh Kushwah, A. Kumar, S. Patel, R. Soni, A. Gawande, and S. Gupta, “Comparative study of regressor and classi-fier with decision tree using modern tools,” Mater Today Proc, vol. 56, pp. 3571–3576, Jan. 2022, doi: 10.1016/j.matpr.2021.11.635. DOI: https://doi.org/10.1016/j.matpr.2021.11.635

S. Singhal et al., “Energy-efficient load balancing algorithm for cloud computing using rock hyrax optimization,” IEEE Access, vol. 12, pp. 48737–48749, 2024, doi: 10.1109/ACCESS.2024.3380159. DOI: https://doi.org/10.1109/ACCESS.2024.3380159

Y. Zhang, B. Liu, Y. Gong, J. Huang, J. Xu, and W. Wan, “Application of machine learning optimization in cloud com-puting resource scheduling and management,” Applied and Computational Engineering, vol. 64, no. 1, pp. 9–14, May 2024, doi: 10.54254/2755-2721/64/20241359. DOI: https://doi.org/10.54254/2755-2721/64/20241359

A. Pradhan, S. K. Bisoy, S. Kautish, M. B. Jasser, and A. W. Mohamed, “Intelligent decision-making of load balancing using deep reinforcement learning and parallel PSO in cloud environment,” IEEE Access, vol. 10, pp. 76939–76952, 2022, doi: 10.1109/ACCESS.2022.3192628. DOI: https://doi.org/10.1109/ACCESS.2022.3192628

A. B. Kanbar and K. Faraj, “Modern load balancing techniques and their effects on cloud computing,” Journal of Hunan University Natural Sciences, vol. 49, no. 7, pp. 37–43, Jul. 2022, doi: 10.55463/issn.1674-2974.49.7.5. DOI: https://doi.org/10.55463/issn.1674-2974.49.7.5

A. R. Malipatil, D. Gulyamova, A. Saravanan, et al., “Energy-efficient cloud computing through reinforcement learning-based workload scheduling,” International Journal of Advanced Computer Science and Applications, vol. 16, no. 4, Art. no. 64, May 2025. doi: 10.14569/IJACSA.2025.0160464. DOI: https://doi.org/10.14569/IJACSA.2025.0160464

N. S. Albalawi, “Dynamic scheduling strategies for cloud-based load balancing in parallel and distributed systems,” Journal of Cloud Computing, vol. 14, no. 1, Dec. 2025, doi: 10.1186/s13677-025-00757-6. DOI: https://doi.org/10.1186/s13677-025-00757-6

H. Mahmoud, M. Thabet, M. H. Khafagy, and F. A. Omara, “Multiobjective task scheduling in cloud environment using decision tree algorithm,” IEEE Access, vol. 10, pp. 36140–36151, 2022, doi: 10.1109/ACCESS.2022.3163273. DOI: https://doi.org/10.1109/ACCESS.2022.3163273

B. T. Jijo and A. M. Abdulazeez, “Classification based on decision tree algorithm for machine learning,” Journal of Ap-plied Science and Technology Trends, vol. 2, no. 1, pp. 20–28, Jan. 2021, doi: 10.38094/jastt20165. DOI: https://doi.org/10.38094/jastt20165

B. K. Gacar and İ. D. Kocakoç, “Regresyon analizleri mi karar ağaçları mı? [Regression analyses or decision trees?],” Celal Bayar Üniversitesi Sosyal Bilimler Dergisi, pp. 251–260, Dec. 2020, doi: 10.18026/cbayarsos.796172. DOI: https://doi.org/10.18026/cbayarsos.796172

A. Deva Kumari, J. Prem Kumar, V. S. Prakash, and Divya K. S., “Supervised learning algorithms: A comparison,” Kristu Jayanti Journal of Computational Sciences, vol. 1, no. 1, pp. 1–12, Nov. 2020 DOI: https://doi.org/10.59176/kjcs.v1i1.1259

I. D. Mienye and N. Jere, “A survey of decision trees: Concepts, algorithms, and applications,” IEEE Access, vol. 12, pp. 86716–86727, 2024, doi: 10.1109/ACCESS.2024.3416838. DOI: https://doi.org/10.1109/ACCESS.2024.3416838

S. H. Shetty, S. Shetty, C. Singh, and A. Rao, “Supervised machine learning: Algorithms and applications,” in Funda-mentals and Methods of Machine and Deep Learning: Algorithms, Tools, and Applications, Wiley, 2022, pp. 1–16. doi: 10.1002/9781119821908.ch1. DOI: https://doi.org/10.1002/9781119821908.ch1

Z. Ren, S. Wang, and Y. Zhang, “Weakly supervised machine learning,” CAAI Transactions on Intelligence Technology, vol. 8, no. 3, pp. 549–580, Sept. 2023, doi: 10.1049/cit2.12216. DOI: https://doi.org/10.1049/cit2.12216

T. W. Gyeera, A. J. H. Simons, and M. Stannett, “Regression analysis of predictions and forecasts of cloud data center KPIs using the boosted decision tree algorithm,” IEEE Trans Big Data, vol. 9, no. 4, pp. 1071–1085, Aug. 2023, doi: 10.1109/TBDATA.2022.3230649. DOI: https://doi.org/10.1109/TBDATA.2022.3230649

Priyanka and D. Kumar, “Decision tree classifier: a detailed survey,” International journal of information and decision sci-ences, vol. 12, no. 3, pp. 246–269, Jul. 2020, doi: 10.1504/IJIDS.2020.108141. DOI: https://doi.org/10.1504/IJIDS.2020.108141

D. D. Vecliuc, F. Leon, and D. Logofătu, “A comparison between task distribution strategies for load balancing using a multiagent system,” Computation, vol. 10, no. 12, Dec. 2022, doi: 10.3390/computation10120223. DOI: https://doi.org/10.3390/computation10120223