Media Playout Techniques for Video Intra-Stream Synchronization: Review and Analysis

Farij Ehtiba; Ayoub Elgassier

المؤلفون

Farij Ehtiba Faculty of Information Technology, Misrata University, Misrata- Libya
Ayoub Elgassier Faculty of Information Technology, Misrata University, Misrata- Libya

الكلمات المفتاحية:

Adaptive Media Playout، About، Multimedia Synchronization، Playout Delay، Video streaming

الملخص

Video streaming over best-effort networks is a challenging problem due to network delay and packet loss. To deal with video playout disruptions, client-side data buffering is a public and known technique. Increasing of data buffering inevitably prevents playout interruption. As a result, more memory requirement is needed and playout delay is increased. Thus, Adaptive media playout (AMP) is a client-side technique which reduces the data buffering and avoids buffer outage. The playout adaptation technique takes on the responsibility of temporal reconstruction of the stream, that is, the restoration of its intra-stream synchronization quality. This article surveys the Adaptive Media Playout techniques, aiming to succinctly merge established concepts and schemes have been proposed for the adaptation playout rate, and classify AMP techniques based on playout rate control. In addition, the pros and cons of each technique are briefly discussed. This study also deliberates challenges and issues related to video stream quality, playout rate control, adapt playout rate based on network conditions handling of buffer outage and quality evaluation metrics.

المراجع

Xiao, Y., X. Du, and J. Zhang, “Internet protocol television (IPTV): the killer application for the next-generation internet,” in Institute of Electrical and Electronics Engineers. 2007.

Ahmad, K. and A.C. Begen, “IPTV and video networks in the 2015 timeframe: The evolution to medianets,” IEEE Communications Magazine, 2009. 47(12), pp. 68-74.

Girod, B., et al. “Advances in network-adaptive video streaming,” In 2002 Tyrrhenian Inter. Workshop on Digital Communications. 2002. Citeseer.

Sun, Y., et al., “An experimental study of multimedia traffic performance in mesh networks,” In Papers presented at the 2005 workshop on Wireless traffic measurements and modeling. 2005. USENIX Association.

Hsiao, Y.-M., et al., “H. 264 video transmissions over wireless networks: Challenges and solutions,” Computer Communications, 2011. 34(14): pp. 1661-1672.

Luo, H. and M.-L. Shyu, “Quality of service provision in mobile multimedia-a survey,” Human-centric computing and information sciences, 2011. 1(1): pp. 1.

Wu, D., Y.T. Hou, and Y.-Q. Zhang, “Scalable video coding and transport over broadband wireless networks,” Proceedings of the IEEE, 2001. 89(1), pp. 6-20.

Steinbach, E., N. Farber, and B. Girod. Adaptive playout for low latency video streaming. in Image Processing, 2001. Proceedings. 2001 International Conference on. 2001. IEEE.

Stone, D.L. and K. Jeffay, “An empirical study of delay jitter management policies,” Multimedia Systems, 1995. 2(6), pp. 267-279.

Laoutaris, N. and I. Stavrakakis, “Adaptive playout strategies for packet video receivers with finite buffer capacity,” In Communications, ICC 2001. IEEE International Conference on. 2001. IEEE.

Laoutaris, N. and I. Stavrakakis, “An analytical design of optimal playout schedulers for packet video receivers,” Computer Communications, 2003. 26(4), pp. 294-303.

Yuang, M.C., et al. “Dynamic video playout smoothing method for multimedia applications,” In Communications, 1996. ICC'96, Conference Record, Converging Technologies for Tomorrow's Applications. 1996 IEEE International Conference on. 1996. IEEE.

Yuang, M.C., P.L. Tien, and S.T. Liang, “Intelligent video smoother for multimedia communications,” Selected Areas in Communications, IEEE Journal on, 1997. 15(2): pp. 136-146.

Biersack, E., W. Geyer, and C. Bernhardt, “Intra-and inter-stream synchronisation for stored multimedia streams,” In Multimedia Computing and Systems, 1996., Proceedings of the Third IEEE International Conference on. 1996. IEEE.

Goyal, P., et al., “A reliable, adaptive network protocol for video transport,” In INFOCOM'96. Fifteenth Annual Joint Conference of the IEEE Computer Societies. Networking the Next Generation. Proceedings IEEE. 1996. IEEE.

[16] Laoutaris, N. and I. Stavrakakis, “Intrastream synchronization for continuous media streams: a survey of playout schedulers,” Network, IEEE, 2002. 16(3), pp. 30-40.

Özden, B., R. Rastogi, and A. Silberschatz, “On the design of a low-cost video-on-demand storage system,” Multimedia Systems, 1996. 4(1), pp. 40-54.

Janssen, J., et al., “Delay bounds for voice over IP calls transported over satellite access networks,” Mobile Networks and Applications, 2002. 7(1), pp. 79-89.

Van Der Wal, K., M. Mandjes, and H. Bastiaansen, “Delay performance analysis of the new Internet services with guaranteed QoS,” Proceedings of the IEEE, 1997. 85(12): pp. 1947-1957.

Dua, A. and N. Bambos, “Buffer management for wireless media streaming,” In Global Telecommunications Conference, 2007. GLOBECOM'07. IEEE. 2007. IEEE.

Stockhammer, T., H. Jenkac, and G. Kuhn, “Streaming video over variable bit-rate wireless channels,” Multimedia, IEEE Transactions on, 2004. 6(2), pp. 268-277.

Deshpande, S., “Underflow prevention for AV streaming media under varying channel conditions,” in Proceedings of SPIE. 2007.

Kalman, M., S. Eckehard, and B. Girod, “Adaptive playout for real-time media streaming. in Circuits and Systems,” 2002. ISCAS 2002. IEEE International Symposium on. 2002. IEEE.

Kalman, M., E. Steinbach, and B. Girod, “Adaptive media playout for low-delay video streaming over error-prone channels,” Circuits and Systems for Video Technology, IEEE Transactions on, 2004. 14(6), pp. 841-851.

Conklin, G.J., et al., “Video coding for streaming media delivery on the Internet” IEEE Transactions on Circuits and Systems for Video Technology, 2001. 11(3), pp. 269-281.

Ali, A., A. Al Ajami, and J. Alotaibi, Subjective and Objective Evaluation of the Effect of Packet Loss and Delay on Video Streaming Quality. International Journal of Computer and Information Technology, 2016(2).

Wiegand, T., et al., “Overview of the H. 264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, 2003. 13(7), pp. 560-576.

Yan, C., et al., “Efficient parallel framework for HEVC motion estimation on many-core processors,” IEEE Transactions on Circuits and Systems for Video Technology, 2014. 24(12), pp. 2077-2089.

Yan, C., et al., “A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors,” IEEE Signal Processing Letters, 2014. 21(5), pp. 573-576.

Cao, X., et al., “High Capacity Reversible Data Hiding in Encrypted Images by Patch-Level Sparse Representation,” IEEE Transactions on Cybernetics, 2016. 46(5), pp. 1132-1143.

Dai, W., et al., “,”erge frame design for video stream switching using piecewise constant functions. IEEE Transactions on Image Processing, 2016. 25(8), pp. 3489-3504.

Yan, C., et al., “Parallel deblocking filter for HEVC on many-core processor,” Electronics Letters, 2014. 50(5): pp. 367-368.

Wien, M., et al., Real-time system for adaptive video streaming based on SVC. IEEE Transactions on Circuits and Systems for Video Technology, 2007. 17(9): pp. 1227-1237.

Tian, G. and Y. Liu, “Towards agile and smooth video adaptation in http adaptive streaming,” IEEE/ACM Transactions On Networking, 2016. 24(4): pp. 2386-2399.

Dubin, R., et al., “Real Time Video Quality Representation Classification of Encrypted HTTP Adaptive Video Streaming-the Case of Safari,” arXiv preprint arXiv:1602.00489, 2016.

Stockhammer, T., “Dynamic adaptive streaming over HTTP--: standards and design principles,” In Proceedings of the second annual ACM conference on Multimedia systems. 2011. ACM.

Wu, D., et al., “Streaming video over the Internet: approaches and directions,” IEEE Transactions on Circuits and Systems for Video Technology, 2001. 11(3): pp. 282-300.

Akhshabi, S., A.C. Begen, and C. Dovrolis, “An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP,” In Proceedings of the second annual ACM conference on Multimedia systems. 2011. ACM.

Lederer, S., C. Müller, and C. Timmerer. “Dynamic adaptive streaming over HTTP dataset,” in Proceedings of the 3rd Multimedia Systems Conference. 2012. ACM.

Thang, T.C., et al., Adaptive streaming of audiovisual content using MPEG DASH. IEEE Transactions on Consumer Electronics, 2012. 58(1), pp. 78-85.

Li, M., T.-W. Lin, and S.-H. Cheng, “Arrival process-controlled adaptive media playout with multiple thresholds for video streaming,” Multimedia Systems, 2012. 18(5), pp. 391-407.

Yang, J., et al., “Online buffer fullness estimation aided adaptive media playout for video streaming,” Multimedia, IEEE Transactions on, 2011. 13(5), pp. 1141-1153.

Hu, H., et al., “Scene aware smooth playout control for portable media players over random VBR channels,” Consumer Electronics, IEEE Transactions on, 2010. 56(4), pp. 2330-2338.

Su, Y.-F., et al., “Smooth control of adaptive media playout for video streaming. Multimedia,” IEEE Transactions on, 2009. 11(7), pp. 1331-1339.

Siripongwutikorn, P., S. Banerjee, and D. Tipper, “Adaptive bandwidth control for efficient aggregate QoS provisioning,” In Global Telecommunications Conference, 2002. GLOBECOM'02. IEEE. 2002. IEEE.

Li, M. and C.-Y. Lee, “A cost-effective and real-time QoE evaluation method for multimedia streaming services,” Telecommunication Systems, 2015. 59(3), pp. 317-327.

Li, M. and S.-H. Cheng, “Arrival process-controlled adaptive media playout for video streaming,” In Future Multimedia Networking. 2009, Springer, pp. 26-37.

Chuang, H.-C., C. Huang, and T. Chiang, “Content-aware adaptive media playout controls for wireless video streaming,” Multimedia, IEEE Transactions on, 2007. 9(6), pp. 1273-1283.

Li, Y., et al., “Joint power/playout control schemes for media streaming over wireless links,” in Proc. 14th IEEE Int’l Packet Video Workshop. 2004.

Li, Y., et al., “Joint power-playout control for media streaming over wireless link,” IEEE Transactions on Multimedia, 2006, 8(4), pp. 830-843.

Chuang, H.-C., C. Huang, and T. Chiang, “A novel adaptive video playout control for video streaming over mobile cellular environment,” In Circuits and Systems, 2005. ISCAS 2005. IEEE International Symposium on. 2005. IEEE.

Chuang, H.-C., C. Huang, and T. Chiang, “On the buffer dynamics of scalable video streaming over wireless network,” In Vehicular Technology Conference, 2004. VTC2004-Fall. 2004 IEEE 60th. 2004. IEEE.

Hung, T.-Y., Z. Chen, and Y.-P. Tan, “Playout adaptation based packet scheduling for scalable video delivery over wireless links,” In Multimedia and Expo (ICME), 2010 IEEE International Conference on. 2010. IEEE.

Hu, H., et al., “A scene-aware adaptive media playout algorithm for wireless video streaming,” In Computer and Automation Engineering (ICCAE), 2010 The 2nd International Conference on. 2010. IEEE.

Rui, C. and M. Zhengkun, “Safety guaranteed smooth playout algorithm for wireless video streaming,” in Wireless and Optical Communications Conference (WOCC), 2010 19th Annual. 2010. IEEE.

Yang, Y.-H., M.-T. Lu, and H.H. Chen, “Smooth playout control for video streaming over error-prone channels,” In Multimedia, 2006. ISM'06. Eighth IEEE International Symposium on. 2006. IEEE.