Impact of Wireless Network Packet Loss on Real-Time Video Streaming Application: A Comparative Study of H.265 and H.266 Codecs

Miran Taha Abdullah; Najmadin Wahid Abdulrahman; Aree Ali Mohammed; Diary Nawzad Hama

doi:10.24017/science.2024.2.3

Authors

Miran Taha Abdullah Computer Department, College of Science, University of Sulaimani, Sulaymaniyah, Iraq https://orcid.org/0000-0002-3501-6999
Najmadin Wahid Abdulrahman Computer Department, College of Science, University of Sulaimani, Sulaymaniyah, Iraq
Aree Ali Mohammed Computer Department, College of Science, University of Sulaimani, Sulaymaniyah, Iraq https://orcid.org/0000-0002-1843-1656
Diary Nawzad Hama Computer Department, College of Science, University of Sulaimani, Sulaymaniyah, Iraq

Abstract

The transmission of real-time videos over wireless networks is prone to the negative consequences of packet loss and delay, which can have a potential effect on the video quality during streaming. These impairments can lead to interruptions, buffering, and degradation of visual and auditory elements, resulting in an unsatisfactory user experience. In this paper, we aim to address the challenges associated with packet loss and delay parameters in wireless networks, and propose an approach to alleviate their impact on real-time video transmission. The proposed approach involves utilizing the H.265/H.266 video coding standards. For Versatile Video Coding (VVC), a patch support for VVdeC and VVenC to FFmpeg (Fast Forward Moving Picture Expert Group) is added. As a result, FFmpeg is used to encode, stream and decode all videos. Raw videos of 2K qualities are encoded based on the adaptive quantization (QP) for the above-mentioned codecs. By selecting optimal transmission data based on various network conditions, this approach enhances the Quality of Experience (QoE) for end-users while minimizing resource usage in the wireless network. Furthermore, the proposed approach selects the codec standards according to their bitrates and frame rates. Simulation results indicate that the proposed approach has a significant improvement for real-time video streaming over wireless networks to satisfy the end user experience. The approach also outperforms other related work by gaining a PSNR of +12 dB for H.265 and +13 dB for H.266 when the network packet loss is 1%.

Keywords:

Wireless Network, Quantization Parameter, VVC, QoS, QoE

References

Cisco report, [Online]. Available: http://bit.ly/2gg1F6B. [Accessed: June 2023].

M. Taha, A. Canovas, J. Lloret, and A. Ali, "A QoE Adaptive Management System for High-Definition Video Streaming over Wireless Networks," Journal of Telecommunication Systems (Springer), vol. 77, no. 1, pp. 63-81, 2021. DOI: 10.1007/s11235-020-00741-2. DOI: https://doi.org/10.1007/s11235-020-00741-2

Z. Li, S. Drew, J. Liu, Fundamentals of Multimedia, 2nd ed., Prentice Hall, 2021. DOI: https://doi.org/10.1007/978-3-030-62124-7

M. Ashkan, M. Ghasempour, and M. Ghanbari, "A Smart Packet Type Identification Scheme for Selective Discard of Video Packets," e-Prime-Advances in Electrical Engineering, Electronics and Energy, vol. 4, no. 1, pp. 100149, Jan. 2023. DOI: 10.1016/j.prime.2023.100149. DOI: https://doi.org/10.1016/j.prime.2023.100149

O. Khandu, R. Singh, A. Kaur, T. McGill, M. Dixon, K. Wong, and P. Koutsakis, "Artificial Intelligence-Based Video Traffic Policing for Next Generation Networks," Simulation Modelling Practice and Theory, vol. 121, pp. 102650, Nov. 2022. DOI: 10.1016/j.simpat.2022.102650. DOI: https://doi.org/10.1016/j.simpat.2022.102650

S. Seyedmohammad, A. Alnajim, X. Zhu, M. Smith, C. Shen, and L. Cimini, "Traffic Characteristics of Virtual Reality over Edge-Enabled Wi-Fi Networks," arXiv preprint, arXiv:2011.09035, Nov. 2020. DOI: 10.48550/arXiv.2011.09035.

J. Malebary, W. Ali, and M. Barukab, "Smart Traffic Shaping Based on Distributed Reinforcement Learning for Multimedia Streaming over 5G-VANET Communication Technology," Mathematics, vol. 11, no. 3, pp. 700, Feb. 2023. DOI: 10.3390/math11030700. DOI: https://doi.org/10.3390/math11030700

U. Tadeus, C. Choppe, and J. Klink, "H.264/AVC and H.265/HEVC Codecs in the IP Environment: A Comparison Study of QoE, QoS and UX," International Conference on Software, Telecommunications and Computer Networks (SoftCOM), pp. 1-6, Sept. 2021. DOI: https://doi.org/10.23919/SoftCOM52868.2021.9559087

B. Soulef, R. Khemiri, S. Messaoud, O. Ahmed, and F. E. Sayadi, "Deep Learning-Based Video Quality Enhancement for the New Versatile Video Coding," Neural Computing and Applications, vol. 34, no. 17, pp. 14135-14149, Nov. 2022. DOI: 10.1007/s00500-022-05840-1. DOI: https://doi.org/10.1007/s00521-021-06491-9

J. Bienik, M. Uhrina, L. Sevcik, and A. Holesova, "Impact of Packet Loss Rate on Quality of Compressed High Resolution Videos," Sensors, vol. 23, no. 5, pp. 2744, Mar. 2023. DOI: 10.3390/s23052744. DOI: https://doi.org/10.3390/s23052744

C. Stuart and M. Sayıt, "Low Latency Low Loss Media Delivery Utilizing In-Network Packet Wash," Journal of Network and Systems Management, vol. 31, no. 1, pp. 1-24, Feb. 2023. DOI: 10.1007/s10922-022-09712-1. DOI: https://doi.org/10.1007/s10922-022-09712-1

B. Bross, Y.-K. Wang, Y. Ye, S. Liu, J. Chen, G. J. Sullivan, and J.-R. Ohm, "Overview of the Versatile Video Coding (VVC) Standard and its Applications," IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3736-3764, Oct. 2021. DOI: 10.1109/TCSVT.2021.3101953. DOI: https://doi.org/10.1109/TCSVT.2021.3101953

B. Lehmann, B. Marpe, D. Biatek, T. Raulet, and M. Le Feuvre, "A Complete End-to-End Open Source Toolchain for the Versatile Video Coding (VVC) Standard," Proceedings of the 29th ACM International Conference on Multimedia, pp. 3795-3798, Oct. 2021. DOI: https://doi.org/10.1145/3474085.3478320

V. Marko, J. Sainio, A. Mercat, G. Gautier, J. Vanne, I. Farhat, P. Cabarat, W. Hamidouche, and D. Menard, "Open-Source Toolkit for Live End-to-End 4K VVC Intra Coding," Proceedings of the 14th Conference on ACM Multimedia Systems, pp. 312-317, Feb. 2023. DOI: https://doi.org/10.1145/3587819.3593938

M. Sugawara and K. Masaoka, "UHDTV Image Format for Better Visual Experience," Proceedings of the IEEE, vol. 101, no. 10, pp. 8–17, Oct. 2013. DOI: https://doi.org/10.1109/JPROC.2012.2194949

B. Charles, W. Hamidouche, J. Fournier, N. Sidaty, J. Travers, and O. Déforges, "Perceptual Quality Assessment of HEVC and VVC Standards for 8K Video," IEEE Transactions on Broadcasting, vol. 68, no. 1, pp. 246-253, Mar. 2021. DOI: 10.1109/TBC.2021.3059348. DOI: https://doi.org/10.1109/TBC.2022.3140710

Z. Shang, J. P. Ebenezer, Y. Wu, H. Wei, S. Sethuraman, and A. C. Bovik, "Study of the Subjective and Objective Quality of High Motion Live Streaming Videos," IEEE Transactions on Image Processing, vol. 31, no. 2, pp. 1027-1041, Feb. 2022. DOI: 10.1109/TIP.2021.3136723. DOI: https://doi.org/10.1109/TIP.2021.3136723

M. Taha, J. Lloret, A. Ali, and L. Garcia, "Adaptive Video Streaming Testbed Design for Performance Study and Assessment of QoE," International Journal of Communication Systems, vol. 31, no. 9, e3551, Sept. 2018. DOI: 10.1002/dac.3551. DOI: https://doi.org/10.1002/dac.3551

M. Taha and A. Ali, "Smart Algorithm in Wireless Networks for Video Streaming Based on Adaptive Quantization," Concurrency and Computation: Practice and Experience, vol. 35, no. 9, e7633, Mar. 2023. DOI: 10.1002/cpe.7633. DOI: https://doi.org/10.1002/cpe.7633

M. Malekzadeh, "Perceptual Service-Level QoE and Network-Level QoS Control Model for Mobile Video Transmission," Telecommunication Systems, vol. 77, pp. 523–541, May 2021. DOI: 10.1007/s11235-021-00777-y. DOI: https://doi.org/10.1007/s11235-021-00777-y

M. Šilić, M. Sužnjević, L. Skorin-Kapov, N. Skorin-Kapov, and M. I. Lorenzana, "The Impact of Video Encoding Parameters on QoE of Simulated FPV Drone Control," Multimedia Tools and Applications, vol. 83, no. 28, pp. 71525–71557, Feb. 2024. DOI: 10.1007/s11042-024-18442-2. DOI: https://doi.org/10.1007/s11042-024-18442-2

B. Bross, Y.-K. Wang, Y. Ye, S. Liu, J. Chen, G. J. Sullivan, and J.-R. Ohm, "Overview of the Versatile Video Coding (VVC) Standard and its Applications," *IEEE

F. Chiariotti, "A Survey on 360-Degree Video: Coding, Quality of Experience, and Streaming," Computer Communications, vol. 177, pp. 133-155, June 2021. DOI: 10.1016/j.comcom.2021.06.029. DOI: https://doi.org/10.1016/j.comcom.2021.06.029

B. Zatt, M. Porto, and G. Correa, "A Systematic Literature Review on Video Transcoding Acceleration: Challenges, Solu-tions, and Trends," Multimedia Tools and Applications, vol. 83, pp. 1-30, 2024. DOI: 10.1007/s11042-023-13987-7. DOI: https://doi.org/10.1007/s11042-023-17862-w

C. J. Huang, H. W. Cheng, Y. H. Lien, and M. E. Jian, "A Survey on Video Streaming for Next-Generation Vehicular Net-works," Electronics, vol. 13, no. 3, pp. 649, 2024. DOI: 10.3390/electronics13030649. DOI: https://doi.org/10.3390/electronics13030649

H. Mareen, P. Lambert, and G. Van Wallendael, "P-Frame Injection for Efficient Packet-Loss Repair in Ultra-Low-Latency Video Streaming," IEEE International Conference on Visual Communications and Image Processing (VCIP), pp. 1-5, Dec. 2023. DOI: 10.1109/VCIP59821.2023.10402720. DOI: https://doi.org/10.1109/VCIP59821.2023.10402720

P. Topiwala, W. Dai, and K. Bush, "Bandlimited Wireless Video Communications over Lossy Channels," in Applications of Digital Image Processing XLIV, vol. 11842, pp. 105-117, Aug. 2021. SPIE. DOI: https://doi.org/10.1117/12.2571310

G. Esakki, A. Panayides, S. Teeparthi, and M. Pattichis, "A Comparative Performance Evaluation of VP9, x265, SVT-AV1, and VVC Codecs Leveraging the VMAF Perceptual Quality Metric," in Applications of Digital Image Processing XLIII, vol. 11510, pp. 181-191, Aug. 2020. DOI: 10.1117/12.2567392. DOI: https://doi.org/10.1117/12.2567392

T. Uhl and C. Hoppe, "A New Parameterized Model for Determining Quality of Online Video Service Using Modern H.265/HEVC and VP9 Codecs," Journal of Telecommunications and Information Technology, vol. 2020, pp. 13-22, 2020. DOI: 10.26636/jtit.2020.146220. DOI: https://doi.org/10.26636/jtit.2020.146220

M. O. Elbasheer, A. Aldegheishem, N. Alrajeh, and J. Lloret, "Video Streaming Adaptive QoS Routing with Resource Res-ervation (VQoSRR) Model for SDN Networks," Electronics, vol. 11, no. 8, p. 1252, 2022. DOI: 10.3390/electronics11081252. DOI: https://doi.org/10.3390/electronics11081252

Multimedia Communication, [Online]. Available: https://multimediacommunication.blogspot.com/2020/10/happy-world-standards-day-2020.html. [Accessed: July 2023].

J. Klink and T. Uhl, "Video Quality Assessment: Some Remarks on Selected Objective Metrics," in International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Split, Croatia, pp. 1-6, Sept. 2020. DOI: 10.1109/Soft-COM50211.2020.9238248. DOI: https://doi.org/10.23919/SoftCOM50211.2020.9238303

M. Behzadpour and M. Ghanbari, "Improving Precision of Objective Image/Video Quality Meters," Multimedia Tools and Applications, vol. 82, no. 3, pp. 4465–4478, Mar. 2023. DOI: 10.1007/s11042-022-13416-8. DOI: https://doi.org/10.1007/s11042-022-13416-8