Efficient deep reinforcement learning based task scheduler in multi cloud environment.
Cloud computing
Deep reinforcement learning
Makespan
Resource cost
Task scheduling
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
19 Sep 2024
19 Sep 2024
Historique:
received:
10
01
2024
accepted:
10
09
2024
medline:
20
9
2024
pubmed:
20
9
2024
entrez:
19
9
2024
Statut:
epublish
Résumé
Task scheduling problem (TSP) is huge challenge in cloud computing paradigm as number of tasks comes to cloud application platform vary from time to time and all the tasks consists of variable length, runtime capacities. All these tasks may generated from various heterogeneous resources which comes onto cloud console directly effects the performance of cloud paradigm with increase in makespan, energy consumption, resource costs. Traditional task scheduling algorithms cannot handle these type of complex workloads in cloud paradigm. Many authors developed Task Scheduling algorithms by using metaheuristic techniques, hybrid approaches but all these algorithms give near optimal solutions but still TSP is a highly challenging and dynamic scenario as it resembles NP hard problem. Therefore, to tackle the TSP in cloud computing paradigm and schedule the tasks in an effective way in cloud paradigm, we formulated Adaptive Task scheduler which segments all the tasks comes to cloud console as sub tasks and fed these to the scheduler which is modeled by Improved Asynchronous Advantage Actor Critic Algorithm(IA3C) to generate schedules. This scheduling process is carried out in two stages. In first stage, all incoming tasks are segmented as sub tasks. After segmentation, all these sub tasks according to their size, execution time, communication time are grouped together and fed to the (ATSIA3C) scheduler. In the second stage, it checks for the above said constraints and disperse them onto the corresponding suitable processing capacity VMs resided in datacenters. Proposed ATSIA3C is simulated on Cloudsim. Extensive simulations are conducted using both fabricated worklogs and as well as realtime supercomputing worklogs. Our proposed mechanism evaluated over baseline algorithms i.e. RATS-HM, AINN-BPSO, MOABCQ. From results it is evident that our proposed ATSIA3C outperforms existing task schedulers by improving makespan by 70.49%. Resource cost is improved by 77.42%. Energy Consumption is improved over compared algorithms 74.24% in multi cloud environment by proposed ATSIA3C.
Identifiants
pubmed: 39300104
doi: 10.1038/s41598-024-72774-5
pii: 10.1038/s41598-024-72774-5
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
21850Informations de copyright
© 2024. The Author(s).
Références
Marinescu, D. C. Cloud Computing: Theory and Practice (Morgan Kaufmann, 2022).
Mangalampalli, S. et al. Cloud Computing and Virtualization. Convergence of Cloud with AI for Big Data Analytics: Foundations and Innovation: 13–40 (2023).
Mangalampalli, S. & Ganesh Reddy, K. Cloud Environment Limitations and Challenges. Big Data, Cloud Computing and IoT: Tools and Applications (2023).
Pirozmand, P. et al. An improved particle swarm optimization algorithm for task scheduling in cloud computing. J. Ambient Intell. Humaniz. Comput.14(4), 4313–4327 (2023).
doi: 10.1007/s12652-023-04541-9
Mikram, H., Kafhali, S. E. & Saadi, Y. HEPGA: A new effective hybrid algorithm for scientific workflow scheduling in cloud computing environment. Simul. Model. Pract. Theory. 130, 102864 (2024).
doi: 10.1016/j.simpat.2023.102864
Chandrashekar, C. et al. HWACOA scheduler: Hybrid weighted ant colony optimization algorithm for task scheduling in cloud computing. Appl. Sci.13, 3433 (2023).
doi: 10.3390/app13063433
Xiao, Z. et al. Multi-objective parallel task offloading and content caching in D2D-aided MEC networks. IEEE Trans. Mob. Comput.22(11), 6599–6615. https://doi.org/10.1109/TMC.2022.3199876 (2023).
doi: 10.1109/TMC.2022.3199876
Bal, P. et al. A joint resource allocation, security with efficient task scheduling in cloud computing using hybrid machine learning techniques. Sensors. 22(3), 1242 (2022).
doi: 10.3390/s22031242
pubmed: 35161987
pmcid: 8839025
Kruekaew, B. Multi-objective task scheduling optimization for load balancing in cloud computing environment using hybrid artificial bee colony algorithm with reinforcement learning. IEEE Access.10, 17803–17818 (2022).
doi: 10.1109/ACCESS.2022.3149955
Alghamdi, M. I. Optimization of load balancing and task scheduling in cloud computing environments using artificial neural networks-based binary particle swarm optimization (BPSO). Sustainability14(19), 11982 (2022).
Dai, X. et al. Task offloading for cloud-assisted fog computing with dynamic service caching in enterprise management systems. IEEE Trans. Ind. Inf.19(1), 662–672. https://doi.org/10.1109/TII.2022.3186641 (2023).
doi: 10.1109/TII.2022.3186641
Mahmoud, H. et al. An efficient load balancing technique for task scheduling in heterogeneous cloud environment. Cluster Comput.24(4), 3405–3419 (2021).
doi: 10.1007/s10586-021-03334-z
Dai, X. et al. Task co-offloading for D2D-assisted mobile edge computing in industrial internet of things. IEEE Trans. Ind. Inf.19(1), 480–490. https://doi.org/10.1109/TII.2022.3158974 (2023).
doi: 10.1109/TII.2022.3158974
Yao, F., Pu, C. & Zhang, Z. Task duplication-based scheduling algorithm for budget-constrained workflows in cloud computing. IEEE Access.9, 37262–37272 (2021).
doi: 10.1109/ACCESS.2021.3063456
Choudhary, A. et al. A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing. Future Gener. Comput. Syst.83, 14–26 (2018).
doi: 10.1016/j.future.2018.01.005
Rjoub, G. et al. Deep and reinforcement learning for automated task scheduling in large-scale cloud computing systems. Concurr. Comput. Pract. Exp. 33, e5919 (2021).
doi: 10.1002/cpe.5919
Jiang, H., Dai, X., Xiao, Z. & Iyengar, A. Joint task offloading and resource allocation for energy-constrained mobile edge computing. IEEE Trans. Mob. Comput.22(7), 4000–4015. https://doi.org/10.1109/TMC.2022.3150432 (2023).
doi: 10.1109/TMC.2022.3150432
Mangalampalli, S. & Shiva Rama Krishna, M. A novel fault-tolerant aware task scheduler using deep reinforcement learning in cloud computing. Appl. Sci.13, 12015 (2023).
doi: 10.3390/app132112015
Siddesha, K., Jayaramaiah, G. V. & Singh, C. A novel deep reinforcement learning scheme for task scheduling in cloud computing. Cluster Comput.25(6), 4171–4188 (2022).
doi: 10.1007/s10586-022-03630-2
Rugwiro, U., Gu, C. & Ding, W. Task scheduling and resource allocation based on ant-colony optimization and deep reinforcement learning. J. Internet Technol.20(5), 1463–1475 (2019).
Agarwal, M. & Gur Mauj Saran, S. Opposition-based learning inspired particle swarm optimization (OPSO) scheme for task scheduling problem in cloud computing. J. Ambient Intell. Humaniz. Comput.12, 9855–9875 (2021).
doi: 10.1007/s12652-020-02730-4
Nabi, S. et al. AdPSO: Adaptive PSO-based task scheduling approach for cloud computing. Sensors22(3) 920 (2022).
Mangalampalli, S. et al. DRLBTSA: Deep reinforcement learning based task-scheduling algorithm in cloud computing. Multimedia Tools Appl. 1–29 (2023).
Shingne, H. & Shriram, R. Heuristic deep learning scheduling in cloud for resource-intensive internet of things systems. Comput. Electr. Eng.108, 108652 (2023).
doi: 10.1016/j.compeleceng.2023.108652
Duan, Y., Zhao, Y. & Hu, J. An initialization-free distributed algorithm for dynamic economic dispatch problems in microgrid: Modeling, optimization and analysis. Sustain. Energy Grids Netw.. 34, 101004. https://doi.org/10.1016/j.segan.2023.101004 (2023).
doi: 10.1016/j.segan.2023.101004
Shingne, H. & Shriram, R. Mutated deep reinforcement learning scheduling in cloud for resource-intensive IoT systems. Wirel. Pers. Commun.132(3), 2143–2155 (2023).
doi: 10.1007/s11277-023-10709-5
Sharma, N. & Garg, P. Ant colony based optimization model for QoS-based task scheduling in cloud computing environment. Meas. Sens.24, 100531 (2022).
Mangalampalli, S. et al. Fault tolerant trust based task scheduler using Harris Hawks optimization and deep reinforcement learning in multi cloud environment. Sci. Rep.13(1), 19179 (2023).
doi: 10.1038/s41598-023-46284-9
pubmed: 37932308
pmcid: 10628144
Cheng, Y. et al. Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning. J. Supercomputing 1–29 (2023).
Uma, J., Vivekanandan, P. & Shankar, S. Optimized intellectual resource scheduling using deep reinforcement Q-learning in cloud computing. Trans. Emerg. Telecommun. Technol.33, e4463 (2022).
doi: 10.1002/ett.4463
Zhou, G. et al. Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical cloud computing. J. Netw. Comput. Appl.208, 103520 (2022).
doi: 10.1016/j.jnca.2022.103520
Meng, Q., Jin, X., Luo, F., Wang, Z. & Hussain, S. Distributionally robust scheduling for benefit allocation in regional integrated energy system with multiple stakeholders. J. Mod. Power Syst. Clean Energy 1–12. https://doi.org/10.35833/MPCE.2023.000661 (2024).
Sun, C., Yang, T. & Lei, Y. DDDQN-TS: A task scheduling and load balancing method based on optimized deep reinforcement learning in heterogeneous computing environment. Int. J. Intell. Syst.37(11), 9138–9172 (2022).
doi: 10.1002/int.22983
Palani, S. & Rameshbabu, K. A secured energy aware resource allocation and task scheduling based on improved cuckoo search algorithm and deep reinforcement learning for e-healthcare applications. Meas. Sens. 100988 (2023).
Huang, Y. et al. Deep adversarial imitation reinforcement learning for QoS-aware cloud job scheduling. IEEE Syst. J.16(3), 4232–4242 (2021).
doi: 10.1109/JSYST.2021.3122126
He, H., Li, X., Chen, P., Chen, J., Liu, M., & Wu, L. Efficiently localizing system anomalies for cloud infrastructures: A novel dynamic graph transformer based parallel framework. J. Cloud Comput.13(1), 115 (2024). https://doi.org/10.1186/s13677-024-00677-x .
Shi, J. et al. Priority-aware task offloading in vehicular fog computing based on deep reinforcement learning. IEEE Trans. Veh. Technol.69, 16067–16081 (2020).
doi: 10.1109/TVT.2020.3041929
Amer, D. A. et al. Elite learning Harris hawks optimizer for multi-objective task scheduling in cloud computing. J. Supercomputi. 1–26 (2022).
Zhang, S. et al. Data-intensive workflow scheduling strategy based on deep reinforcement learning in multi-clouds. J. Cloud Comput.12(1), 125 (2023).
doi: 10.1186/s13677-023-00504-9
Cui, D. et al. A reinforcement learning-based mixed job scheduler scheme for grid or IaaS cloud. IEEE Trans. Cloud Comput.8(4), 1030–1039 (2017).
doi: 10.1109/TCC.2017.2773078
Calheiros, R. N. et al. CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp.. 41(1), 23–50 (2011).
doi: 10.1002/spe.995
Mangalampalli, S., Karri, G. R. & Kose, U. Multi objective trust aware task scheduling algorithm in cloud computing using Whale optimization. J. King Saud Univ. Inf. Sci.35(2), 791–809 (2023).
Madni, S. H. et al. Hybrid gradient descent cuckoo search (HGDCS) algorithm for resource scheduling in IaaS cloud computing environment. Cluster Comput.22, 301–334 (2019).
doi: 10.1007/s10586-018-2856-x