Nikolas Wehner M. Sc.

Providing sophisticated Web Quality of Experience (QoE) has become paramount for web service providers and network operators alike. Due to advances in Web technologies (HTML5, responsive design, etc.), traditional Web QoE models focusing mainly on loading times have to be refined and improved. In this work, we relate Google's Core Web Vitals, a set of metrics for improving user experience, to the loading time aspects of Web QoE. To this end, we first perform objective measurements in the Web using Google's Lighthouse. To close the gap between metrics and experience, we complement these objective measurements with subjective assessment by performing multiple crowdsourcing QoE studies. In these studies, we use CWeQS, a customized framework to emulate the entire web page loading process, and ask users for their experience while controlling the Core Web Vitals. Our results suggest that the Core Web Vitals have less predictive value for Web QoE than expected and that page loading times remain the main influence factor in this context.

The wide adoption of end-to-end encryption is drastically limiting the visibility Internet Service Providers (ISPs) have on the performance of the services consumed by their customers. In times of strong competition, where customer experience plays a key role in churn management, ISPs require novel solutions enabling network-wide Quality of Experience (QoE) monitoring. To this end, we present DeepQoE, a deep-learning based approach to infer the QoE of web services and mobile applications from the ISP perspective, relying exclusively on the analysis of encrypted network traffic. Using raw features derived from the encrypted stream of bytes as input to deep Convolutional Neural Networks (CNNs), DeepQoE infers the Speed Index of web browsing sessions and general mobile apps with unprecedented accuracy, improving the state of the art by more than 25%, and reducing the QoE inference error in terms of mean opinion scores by nearly 40%. DeepQoE implements a web fingerprinting solution to identify individual web browsing sessions within concurrent web pages traffic, enabling highly detailed, per web page QoE inference in practical deployments. Extensive evaluations over a large and heterogeneous dataset composed of web and app measurements, using different device types and for top-popular websites and apps, confirm the out-performance of DeepQoE over previously used shallow-learning models, as well as the deep-model generalization to different devices, web pages, apps, and network setups. DeepQoE is the first deployable system providing such a deep, highly-detailed QoE for individual web browsing and mobile apps over encrypted traffic, using deep learning models on heterogeneous measurements.

Web Quality of Experience (QoE) monitoring is a critical task for Internet Service Providers (ISPs), especially due to the key role played by customer experience in churn management. Previously, we have tackled the problem of Web QoE inference from the ISP perspective, relying on passive measurement of encrypted network traffic and machine learning models. In this paper, we exploit the broad heterogeneity of contents embedded in web pages to improve the state of the art performance in Web QoE inference, relying on web-content learning model tailoring. By analyzing the top-500 most popular web pages of the Internet through unsupervised learning, we discover different web page content classes which realize significantly different Web QoE inference performance. We train supervised learning inference models separately for each of these classes, using the well-known Speed Index (SI) metric as proxy to Web QoE. Empirical evaluations on a large corpus of Web QoE measurements for top popular websites demonstrate that our combined content-tailored approach improves the inference performance of the SI by almost 30% with respect to previous single-model approaches, reducing the QoE inference error in terms of mean opinion scores by more than 40%.

We introduce DeepCrypt, a deep-learning based approach to analyze YouTube video streaming Quality of Experience (QoE) from the Internet Service Provider (ISP) perspective, relying exclusively on the analysis of encrypted network traffic. Using raw features derived on-line from the encrypted stream of bytes, DeepCrypt can infer six different video QoE indicators capturing the user-perceived performance of the service, including the initial playback delay, the number and frequency of rebuffering events, the video playback quality, the video encoding bitrate, and the number of quality changes. DeepCrypt offers deep visibility into the behavior of the end-user, enabling the fingerprinting and detection of different user actions on the video player, such as video pauses and playback scrubbing (forward, backward, out-of-buffer), offering a complete visibility on the video streaming process from in-network traffic measurements. Extensive evaluations over a large and heterogeneous dataset composed of mobile and fixed-line measurements, using the YouTube HTML5 player, the native YouTube mobile app, as well as a generic HTML5 video player built on top of open source libraries, and considering measurements collected at different ISPs, confirm the out-performance of DeepCrypt over previously used shallow-learning models, as well as the deep-model generalization to different video players and network setups. To the best of our knowledge, this is the first paper tackling such a combined QoE and user-actions approach for video streaming applications, using deep learning models over heterogeneous measurements.

This work presents a novel concept for learning embeddings from encrypted network traffic. In contrast to existing approaches, we evaluate the feasibility of hierarchical embeddings by iteratively aggregating packet embeddings to flow embeddings, and flow embeddings to trace embeddings. The hierarchical embedding concept was designed to especially consider complex dependencies of Internet traffic on different time scales. We describe this novel embedding concept for the domain of network traffic in full detail, and evaluate its performance for the downstream task of website fingerprinting, i.e., identifying websites from encrypted traffic, which is relevant for network management, e.g., as a prerequisite for QoE monitoring or for intrusion detection. Our evaluation reveals that embeddings are a promising solution for website fingerprinting as our model correctly labels up to 99.8% of traces from 500 target websites.