Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services

Tho Nguyen Duc, Chanh Tran Minh, Tan Phan Xuan, Eiji Kamioka

Research output: Contribution to journalArticlepeer-review

17 Citations (Scopus)


In video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence factors has introduced challenges to continuous QoE prediction. To deal with that, existing studies have utilized the Long Short-Term Memory model (LSTM) to effectively capture such complex dependencies, resulting in excellent QoE prediction accuracy. However, the high computational complexity of LSTM, caused by the sequential processing characteristic in its architecture, raises a serious question about its performance on devices with limited computational power. Meanwhile, Temporal Convolutional Network (TCN), a variation of convolutional neural networks, has recently been proposed for sequence modeling tasks (e.g., speech enhancement), providing a superior prediction performance over baseline methods including LSTM in terms of prediction accuracy and computational complexity. Being inspired of that, in this paper, an improved TCN-based model, namely CNN-QoE, is proposed for continuously predicting the QoE, which poses characteristics of sequential data. The proposed model leverages the advantages of TCN to overcome the computational complexity drawbacks of LSTM-based QoE models, while at the same time introducing the improvements to its architecture to improve QoE prediction accuracy. Based on a comprehensive evaluation, we demonstrate that the proposed CNN-QoE model can provide a high QoE prediction performance on both personal computers and mobile devices, outperforming the existing approaches.

Original languageEnglish
Article number9122485
Pages (from-to)116268-116278
Number of pages11
JournalIEEE Access
Publication statusPublished - 2020


  • Convolutional neural networks
  • quality of experience
  • temporal convolutional network
  • video streaming

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)
  • Electrical and Electronic Engineering


Dive into the research topics of 'Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services'. Together they form a unique fingerprint.

Cite this