An Automated System for Visual Monitoring of Software Performance on Mobile Devices

Description

An Automated System for Visual Monitoring of Software Performance on Mobile Devices: Abstract

Complex applications such as Google Chrome require testing over a vast array of devices. Thousands of updates to the software are made every day and new releases are distributed on a regular basis. However, standard software testing and analysis of internal system logs are not always enough to assess impacts from the point of view of the user experience especially across a growing number of different mobile devices.

We describe an automated visual monitoring system whose goal is to evaluate timings of visual events displayed on a mobile device screen. A high speed camera is used to record test sessions. Test scripts are implemented via the Sikuli visual tool. This report presents the overall test system and discussing some of the challenges encountered.