Performance Testing

So how does Scan My App tests your mobile app? We evaluate 8 common performance metrics:

• Crash Rate; how many uncaught exceptions were detected during usage of your app, which type of exceptions and when possible, their cause.
• Time-to-First-Byte; Time-to-First-Byte of a mobile application is a performance metric measuring the time needed to get from the beginning of a user’s initial interaction to displaying the result on the screen.
• Rendering Time; Time it takes to load the various graphical components of your mobile app on different networks speeds;
• Resource Utilization; How much CPU cycles, memory and disk space does your app use at low, medium and high usage;
• Time-to-Load; How long does it take your app to load all dependencies and resources prior to displaying the intro screen to the user;
• Data Utilization; How much network traffic is generated by your app at low, medium and high usage;
• Battery Usage; Does your app cause the battery to deplete more rapidly; and
• React Time; How long does it takes for a user to get a response from your app once a request has been made.

Use Cases

When we conduct performance testing on your app, we will generally be interested in assessing its behavior under different conditions to reduce the risk of unexpected crashes or degradation causing the users to stop interacting with the application. Unless given additional instruction, Scan My App will assess the following use cases;

1. Assess whether the application performs as expected under different load conditions;
2. Assess whether different networks are able to support peak application load;
3. Assess whether response time between the client and server in various conditions remains under the expected threshold;
4. Assess memory or network bottlenecks causing the applications to exceed expected response times;
5. Assess response time of the application under various hardware specification, including processor, memory and/or graphical peripherals;
6. Assess whether the app speeds up power consumption and/or the battery life can support the application at peak volumes;
7. Assess application performance changes when transitioning between WIFI,2G/3G or vice versa;
8. Assess battery consumption;
9. Assess potential memory leaks;
10. Assess application performance when only intermittent phases of connectivity is required.

Custom Use Cases

We can also design custom test cases for specific needs depending on the industry, or focus testing on specific metrics depending on your particular situation, e.g. testing along with different apps, no internal SD card or using a specific set of devices for your company. Just contact us with your requirements and we will tailor a custom solution for you.