mobile app performance testing with open source tools
DESCRIPTION
Performance Testing of Mobile Apps and Websites using JMeter, the most popular open source tool for load testing. This deck goes along with a webinar with detailed step-by-step instructions and a real-time demo. You can view it here: http://go.blazemeter.com/performance-testing-mobile/TRANSCRIPT
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Performance Testing for Mobile Apps & Sites
(using open source tools)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
BlazeMeterOphir Prusak VP Customer Success & Product Evangelist
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Today’s Agenda
• Current Mobile Trend
• Challenges and Importance of a Fast Mobile Experience
• Mobile Performance Testing Solution Walkthrough
• Q&A
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Current State of Affairs
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Current State of Affairs
Internet Searches
mobile applicationdevelopment
mobile application testing
mobile performance testing
mobile application performance testing
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Mobile Challenges
Desktop Mobile
Client “Standard” Browser Multitude of clients
Technology HTML HTML / Native
Bandwidth Fast (1-20 Mb/s) Slow (0.1 Mb/s and up)
Latency Small (less than 100ms) Large (100-1000ms)
Visual Feedback Immediate After data has loaded*
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Network Challenges
Latency effect on page load times
Source: http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Development Life Cycle (old)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Development Life Cycle (new)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Performance Testing Solution Walkthrough
Load Testing Steps• Record the mobile user scenario• Configure test parameters• Run load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Recording a Mobile User
Simulation Techniques• Browser Spoofing- Over-ride user-agent string- Only applicable for mobile websites- Does not simulate mobile hardware or functionality
• Proxy Recording- Works with almost all mobile apps - Requires setting up mobile device to use a proxy
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Setup the Proxy
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Get Your Local IP
Local IP address on a Mac
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Point Device to the Proxy
Defining proxy settings on an iPhone
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Run the App
Real usage of a mobile app (CNN iPhone app)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
View Requests in JMeterAll of the requests made by the app.
Request Headers
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Full Recording of All Data
DifferentUser Agent
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Define Test Parameters
- Number of Users - Number of Servers- Test Duration- Ramp Up Time- Load Server Geo Location(s)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Mobile Network Emulation
Define bandwidth and latency for each simulated user
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Developer Integrations- Plug-ins for integration into agile / continuous integration tools- Full REST API for custom integration- APM integration for detailed application monitoring- Detailed error reporting- Fully automated spin up / down of dedicated servers- 100% compatible with open source scripting (JMeter)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Detailed Reporting- Performance Testing KPIs- Error Report- Waterfall Report with Detailed Timings- Load Server Monitoring- Application Performance Monitoring- JMeter Logs
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Detailed ReportingLoad Results APM - New Relic Real Browser - Selenium
Waterfall Front End Recommendations Errors
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]
Thanks!
Thank you for attending.We’ll send out an email with the recording and the deck.
Q & AFor more information about Performance Testing and JMeter:http://BlazeMeter.com/blog/[email protected]@BlazeMeter