mobile testing, agile methodologies & you! - · pdf fileissue: agile project, with...

Mobile Testing, Agile Methodologies & You!

&

Before We Begin...

• It's Quiet in Here

• Q&A at End of Webinar

• Contact Details Available

• Let’s Go!

Today’s Presenters

William AndersonGo2Group

Alan TrefzgerXBOSoft

Today’s Agenda

Mobile Testing

(Alan / XBOSoft)

Agile Methodologies

(William / Go2Group)

You (Q&A)

^

^

Mobile Testing

• Mobile Current Market Situation, Trends

• Mobile Application Challenges

• Mobile QA• Issues and solutions

• Mobile Testing Case Study

Current Situation, Trends

• 100 Android devices released in 2011

• 428 Million Mobile Communication Devices Sold Worldwide in Q1 2011

• More manufacturers, carriers, and 3rd party application aggregators will join the competition

Global SmartphonePenetration (by OS)

Source: Gartner

SmartphonePenetration

Source: comScore

0.00%$

5.00%$

10.00%$

15.00%$

20.00%$

25.00%$

30.00%$

35.00%$

40.00%$

45.00%$

United$Kingdom$

Spain$ Italy$ Canada$ United$States$

France$ Germany$ Japan$

Lots of Opportunity

• Lot of competition

• Quality and especially usability both more than ever take a front seat for user acceptance and usage

• Low usability and / or low quality applications may be only used once

• If the user cannot learn how to intuitively use in 30 seconds, forget it

Mobile Testing

• Mobile Current Market Situation, Trends

• Mobile Application Challenges

• Mobile QA• Issues and solutions

• Mobile Testing Case Study

Mobile App Challenges

• Limited display areas, miniature keyboards, less processing power and memory capacity

• Battery-power usage

• Lower bandwidth (but increasing)

• Proliferated mobile platform/OS combos

• Differences for the same application from different manufacturers and carriers

Mobile Networks andFeature Implementation

Mobile OS Features

Source: Tangerine Soup

Mobile Testing

• Mobile Current Market Situation, Trends

• Mobile Application Challenges

• Mobile QA• Issues and solutions

• Mobile Testing Case Study

Mobile Testing Typesand Peculiarities

• Testing• Functional Testing

• User Interface or Usability Testing

• Performance, Stress Testing, Compatibility Testing

• Publishing Compliance Testing

• Interruption Testing 

• Negative Network Testing

• Peculiarities• Location based, Ad Hoc

Mobile Testing Tools

Choosing A Mobile Automation Testing Tool

Testing Strategy

Mobile QA Issues

• Proliferation of devices, networks, OS• Costs and complications

• Manual testing is easier yet more difficult: environment proliferation and replication

• Performance bottlenecks difficult to pinpoint

• Limits of automation tools

• Configuration Management

Mobile QA Issuesand Solutions

• Issue: Different tools to cover different test cases can be overwhelming and complicated to track results

• For instance, use adb (Android Debug Bridge) to test application installation on android mobile, and use another tool to do automation test against mobile application

• Tools need to be manually switched from one to another

Solution: AndroidDebug Bridge

• Use Windows framework to integrate tools• Develop a script or a batch file to trigger different

tools using the windows command line

• Build a mobile automation framework (based on Windows API as previous means); call different tools with certain sequence; interval time between two calls

• Can test application installation, application itself, un-installation with one executable file

• Example: Test browser installation, functions, un-installation in 1 run, with Windows API & MonkeyRunner integrated with Eclipse & Python

Issue: Agile Project, with Changing UI Styles

• Under time pressure, test task is intensive in the final phase of a release

• Solution: Prototype or UI design with fixed element ID or position is provided to testers

• Application is learned by testers, test tools in advance

• Tester can develop automation test easily with tool based on the prototype/design

• Apply test in various platforms or configurations, saving manual testing time

Mobile QAIssues & Solutions

• Issue: Configuration management for Apple applications via App Store

• Solution: App Store has version control• New downloads get the latest version

• Old users are prompted to upgrade via app store

• Incompatible versions are forced to upgrade

• Users forced to have either most recent, or a compatible version

Mobile QAIssues & Solutions

• When to test an actual device?• UI

• Location

• Multimedia

• Internet connectivity

Mobile Testing

• Mobile Current Market Situation, Trends

• Mobile Application Challenges

• Mobile QA• Issues and solutions

• Mobile Testing Case Study

Case StudyMobile Devices & Speed

• Please contact XBOSoft for more details!

services@xbosoft.com

Summary

• Mobile QA requires an adapted strategy

• Decompose where you can in order to gain efficiencies

• Manual testing and real devices are still necessary

• But needs can be reduced through selective automation and environment simulation

Let’s Talk Agile!

3 Steps toAgile Success!

• Fundamental understanding

• Which methodology?

• Find the right tools!

Fundamental Understanding

• Why the need for agile?

• Who benefits from agile?

• Is it just one-and-done?

Which Methodology Is Right For You?

• There are many!

• Benchmark, measure, discover

• Likely a hybrid approach is best

Find theRight Tools!

• Requirements, test management

• Software development

• Project management (ie, Scrum masters)

• Examples:• Atlassian JIRA, GreenHopper, Bonfire, Confluence

• Go2Group JaM Plugin, synapseRT, ConnectALL

• HP QC / ALM, Salesforce, SugarCRM

An Exampleof Agile

• Pre-Agile: Waterfall-based• Backlog of requirements not being developed

• Lots of missed deadlines!

• Why Agile?• Many bugs, parallel / distributed development

• It’s An Agile Life• Training: “Start thinking in stories, sprints, etc.”

• Periodic releases and iterative updates

Where ToGet Started

• One Day Agile Training from Go2Group• Includes Agile Tools Demonstration!

• Demo / example sprints and release cycles

• Great place to get your toes wet

Q&A

You Have Questions?We Have Answers!

Contact Us!

William AndersonGo2Group

sales@go2group.com

Alan TrefzgerXBOSoft

services@xbosoft.com

Thank You!

Go2Group synapseRT WebinarTuesday, March 29 @ 11AM ET

Go2Group JaM Plugin WebinarWednesday, April 4 @ 10AM ET