mobile app performance testing with open source tools

Post on 09-May-2015

1.877 Views

Category:

Technology

2 Downloads

Preview:

Click to see full reader

DESCRIPTION

Performance Testing of Mobile Apps and Websites using JMeter, the most popular open source tool for load testing. This deck goes along with a webinar with detailed step-by-step instructions and a real-time demo. You can view it here: http://go.blazemeter.com/performance-testing-mobile/

TRANSCRIPT

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Performance Testing for Mobile Apps & Sites

(using open source tools)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

BlazeMeterOphir Prusak VP Customer Success & Product Evangelist

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Today’s Agenda

• Current Mobile Trend

• Challenges and Importance of a Fast Mobile Experience

• Mobile Performance Testing Solution Walkthrough

• Q&A

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Current State of Affairs

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Current State of Affairs

Internet Searches

mobile applicationdevelopment

mobile application testing

mobile performance testing

mobile application performance testing

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Mobile Challenges

Desktop Mobile

Client “Standard” Browser Multitude of clients

Technology HTML HTML / Native

Bandwidth Fast (1-20 Mb/s) Slow (0.1 Mb/s and up)

Latency Small (less than 100ms) Large (100-1000ms)

Visual Feedback Immediate After data has loaded*

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Network Challenges

Latency effect on page load times

Source: http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Development Life Cycle (old)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Development Life Cycle (new)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Performance Testing Solution Walkthrough

Load Testing Steps• Record the mobile user scenario• Configure test parameters• Run load test• Analyze the results

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Recording a Mobile User

Simulation Techniques• Browser Spoofing- Over-ride user-agent string- Only applicable for mobile websites- Does not simulate mobile hardware or functionality

• Proxy Recording- Works with almost all mobile apps - Requires setting up mobile device to use a proxy

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Setup the Proxy

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Get Your Local IP

Local IP address on a Mac

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Point Device to the Proxy

Defining proxy settings on an iPhone

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Run the App

Real usage of a mobile app (CNN iPhone app)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

View Requests in JMeterAll of the requests made by the app.

Request Headers

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Full Recording of All Data

DifferentUser Agent

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Define Test Parameters

- Number of Users - Number of Servers- Test Duration- Ramp Up Time- Load Server Geo Location(s)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Mobile Network Emulation

Define bandwidth and latency for each simulated user

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Developer Integrations- Plug-ins for integration into agile / continuous integration tools- Full REST API for custom integration- APM integration for detailed application monitoring- Detailed error reporting- Fully automated spin up / down of dedicated servers- 100% compatible with open source scripting (JMeter)

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Detailed Reporting- Performance Testing KPIs- Error Report- Waterfall Report with Detailed Timings- Load Server Monitoring- Application Performance Monitoring- JMeter Logs

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Detailed ReportingLoad Results APM - New Relic Real Browser - Selenium

Waterfall Front End Recommendations Errors

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com

Thanks!

Thank you for attending.We’ll send out an email with the recording and the deck.

Q & AFor more information about Performance Testing and JMeter:http://BlazeMeter.com/blog/support@blazemeter.com@BlazeMeter

top related