QoE estimation for different adaptive streaming techniques in mobile networks
DOI:
https://doi.org/10.22517/23447214.24746Keywords:
Adaptive Transmission, LTE, MOS, QoE, VideoAbstract
Video services are becoming more and more popular for mobile network users and require greater and greater resources and provisions from telecommunications service providers. But operators suffer from problems of interoperability between the different adaptive transmissions techniques they employ in an attempt to satisfy the quality of experience (QoE) of the service provided to users and improve network performance. This article presents a comparison of four such streaming techniques - DASH (dynamic adaptive streaming over HTTP), HDS (HTTP dynamic streaming), HLS (HTTP2 live streaming) and HSS (HTTP smooth streaming) - used in a live video playback by a user in different test scenarios on an emulated long-term evolution (LTE) network. Comparison of performance was carried out using the mean opinion score (MOS) metric calculated based on ITU-T Recommendation P.1203. The streaming techniques that performed best in each of the different test scenarios are revealed.
Downloads
References
[2] O. B. Maia, H. C. Yehia, and L. de Errico, “A concise review of the quality of experience assessment for video streaming,” Computer Communications, vol. 57, pp. 1–12, Feb. 2015, doi: 10.1016/j.comcom.2014.11.005.
[3] D. Tse and P. Viswanath, Fundamentals of Wireless Communication. Cambridge University Press, 2005.
[4] L. Guo and Y. Meng, “What is wrong and right with MSE?,” 2006, pp. 212–215.
[5] H.-F. Bermudez, “Modelado de tráfico para el servicio de streaming de video en vivo -LVS en redes móviles LTE con calidad de la experiencia,” Tesis Doctoral, Universidad del Cauca, Popayán - Colombia, 2020.
[6] D. Ghadiyaram, J. Pan, and A. C. Bovik, “A Subjective and Objective Study of Stalling Events in Mobile Streaming Videos,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 1, pp. 183–197, Jan. 2019, doi: 10.1109/TCSVT.2017.2768542.
[7] ISO, “ISO/IEC 23009-1:2014(E). Information technology — Dynamic adaptive streaming over HTTP (DASH).” 2014.
[8] Jbocharov, “Smooth Streaming Transport Protocol,” 2008. https://docs.microsoft.com/en-us/iis/media/smooth-streaming/smooth-streaming-transport-protocol (accessed Jun. 03, 2020).
[9] Apple, “HTTP Live Streaming (HLS) - Apple Developer,” 2014. https://developer.apple.com/streaming/ (accessed Jun. 03, 2018).
[10] Adobe, “Adobe HTTP Dynamic Streaming (HDS) Technology Center | Adobe Developer Connection,” 2014. https://www.adobe.com/devnet/hds.html?origref=https%3A%2F%2Fwww.google.es%2F (accessed Jun. 03, 2020).
[11] ISO/IEC, “MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH),” 2010. https://mpeg.chiariglione.org/standards/mpeg-dash (accessed Jun. 03, 2018).
[12] T. Stockhammer, “Dynamic adaptive streaming over HTTP --: standards and design principles,” Munich, Germany, Feb. 2011, pp. 133–144. doi: 10.1145/1943552.1943572.
[13] H. F. Bermúdez, J. L. Arciniegas, and E. Astaiza, “State of the art of QoE assessment methods, and emulation environments for the video service in LTE networks,” Entre Ciencia e Ingeniería, vol. 10, no. 20, pp. 66–75, Dec. 2016, Accessed: May 27, 2017. [Online]. Available: http://www.scielo.org.co/scielo.php?script=sci_abstract&pid=S1909-83672016000200010&lng=en&nrm=iso&tlng=es
[14] ITU-T, “P.911: Subjective audiovisual quality assessment methods for multimedia applications,” Dec. 1998. https://www.itu.int/rec/T-REC-P.911-199812-I/en (accessed Apr. 12, 2018).
[15] ITU-T, “P.910: Subjective video quality assessment methods for multimedia applications,” Apr. 1999. https://www.itu.int/rec/T-REC-P.910-200804-I/en (accessed Apr. 12, 2020).
[16] ITU-T, “P.1201.2 : Parametric non-intrusive assessment of audiovisual media streaming quality - Higher resolution application area,” 50 2013. https://www.itu.int/rec/T-REC-P.1201.2 (accessed Apr. 12, 2018).
[17] ITU-T, “P.1203.3 : Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module,” Jan. 2019. http://www.itu.int/rec/T-REC-P.1203.3-201710-I (accessed Dec. 02, 2020).
[18] A. Aloman, A. I. Ispas, P. Ciotirnae, R. Sanchez-Iborra, and M. D. Cano, “Performance Evaluation of Video Streaming Using MPEG DASH, RTSP, and RTMP in Mobile Networks,” in 2015 8th IFIP Wireless and Mobile Networking Conference (WMNC), Oct. 2015, pp. 144–151. doi: 10.1109/WMNC.2015.12.
[19] V. Mata G., “Análisis y Comparativa de los Protocolos de Transmisión de vídeo Adaptativo por Internet,” Tesis, Carlos III de Madrid, Leganés España, 2014.
[20] Albedo, “Net.Time clock,” PTP clocks, 10GbE testers, C37.94 test, 2019. http://www.albedotelecom.com/ (accessed Jun. 05, 2020).
[21] E. Intriago A., “Análisis de Tecnologías de Streaming: Evaluación de Protocolos y Diseño de un Caso de Estudio,” Trabajo fin de Máster, Universidad Politécnica de Madrid, Madrid, 2016.
[22] M. Taha, “A Novel CDN Testbed for Fast Deploying HTTP Adaptive Video Streaming,” Jun. 2016, pp. 65–71. Accessed: Jun. 07, 2018. [Online]. Available: http://dl.acm.org/citation.cfm?id=3021385.3021399
[23] M. Taha, J. Lloret, A. Canovas, and L. Garcia, “Survey of Transportation of Adaptive Multimedia Streaming service in Internet,” Network Protocols and Algorithms, vol. 9, no. 1–2, pp. 85–125, Jun. 2017, doi: 10.5296/npa.v9i1-2.12412.
[24] M. Taha, J. Lloret, A. Ali, and L. Garcia, “Adaptive video streaming testbed design for performance study and assessment of QoE,” International Journal of Communication Systems, vol. 31, no. 9, Mar. 2018, doi: 10.1002/dac.3551.
[25] F. Abdurrahman et al., “Real Time Video Streaming over NS3 based Emulated LTE Networks,” 2014, vol. 4, pp. 659–663.
[26] H.-F. Bermudez, R. Sanchez-Iborra, J. L. Arciniegas, W. Y. Campo, and M.- Cano, “Performance validation of NS3-LTE emulation for live video streaming under QoS parameters,” in 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), Rome, Italy, Oct. 2017, pp. 300–307. doi: 10.1109/WiMOB.2017.8115836.
[27] H.-F. Bermudez, R. Sanchez-Iborra, J. L. Arciniegas, W. Y. Campo, and M.-D. Cano, “Statistical validation of an LTE emulation tool using live video streaming over reliable transport protocols,” Telecommun Syst, vol. 71, no. 3, pp. 491–504, Jul. 2019, doi: 10.1007/s11235-018-0521-6.
[28] Blender, “Big Buck Bunny » Download,” 2008. https://peach.blender.org/download/ (accessed Sep. 09, 2020).
[29] ITU-T, “Y.1541 : Objetivos de calidad de funcionamiento de red para servicios basados en el protocolo Internet,” Dec. 2011. https://www.itu.int/rec/T-REC-Y.1541-201112-I/es (accessed Nov. 08, 2020).
Downloads
-
Vistas(Views): 657
- PDF Descargas(Downloads): 411
- HTML (Español (España)) Descargas(Downloads): 28
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Scientia et Technica
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The undersigned authors declare that the article submitted to the journal Scientia et Technica is an original work and that all its content is free of third-party copyright restrictions or has the corresponding authorizations. Consequently, the authors assume responsibility for any litigation or claim related to intellectual property rights, releasing the Technological University of Pereira and the journal Scientia et Technica from any liability.
If the submitted work is accepted for publication, the authors retain copyright to the article and grant the journal Scientia et Technica the right of first publication, as well as a non-exclusive, perpetual license to reproduce, edit, distribute, display, and publicly communicate the article in any medium or format, including print, electronic, databases, repositories, the Internet, or other scientific dissemination systems. The authors agree that the article will be published in open access and distributed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0).
The journal Scientia will respect in all cases the moral rights of the authors, in accordance with the provisions of article 30 of Law 23 of 1982 of the Republic of Colombia, recognizing the authorship of the work, the right to integrity and the right of disclosure, which are inalienable and non-waivable.