mobile automation uamobile

Автоматизация Тестирования Мобильных Приложений

Андрей Дзыня

Andrii Dzynia

http://adzynia.com

Test Engineer/Consultant/Trainer

@adzynia

Сегодня

Почему я начал заниматься автоматизацией мобильных приложений?

Какие есть инструменты?

Какие проблемы решены, а какие нет?

Мой опыт

Кто у нас в зале?

Особенность мобильной разработки?

Типы приложений?

Web

Native

Hybrid

OpenGL

Flash & Flex

Widgets

• Скорость

• Дизайн

• Возможности платформы

• Кроссплатформенность

Автоматизация

UI

API

Integration

Unit

Какие бывают роботы?

Multiplatform tools

Native tools UI Automation, iPhone

WebDriver, NativeDriver, Frank, TAF, KIF, calabash

Android WebDriver, NativeDriver, Robotium,

calabash

Record’n’play

Инструменты

Дорого и ненадежно

Device Anywhere

Бесплатно и ненадежно

@Test public void testFindInROI() throws Exception { JButtons frame = new JButtons(); Screen scr = new Screen();

Match m = scr.wait("test-res/network.png", 10);

scr.setRect(new Rectangle(m.x-9, m.y-10, m.w+10, m.h+11));

Match m2 = scr.doFind("test-res/network.png");

assertEquals(m, m2); frame.dispose(); }

https://github.com/sikuli/sikuli

Не очень дорого но и не нужно

M-eux

Бесплатно но могло быть и лучше

Keep It Functional

@implementation KIFTestScenario (EXAdditions) + (id)scenarioToLogIn; { KIFTestScenario *scenario = [KIFTestScenario scenarioWithDescription:@"Test that a user can successfully log in."]; [scenario addStep:[KIFTestStep stepToReset]]; [scenario addStepsFromArray:[KIFTestStep stepsToGoToLoginPage]]; [scenario addStep:[KIFTestStep stepToEnterText:@"user@example.com" intoViewWithAccessibilityLabel:@"Login User Name"]]; [scenario addStep:[KIFTestStep stepToTapViewWithAccessibilityLabel:@"Log In"]]; // Verify that the login succeeded [scenario addStep:[KIFTestStep stepToWaitForTappableViewWithAccessibilityLabel:@"Welcome"]]; return scenario; } @end

https://github.com/square/KIF

UI Automation

Код UI Automation

// create a new account table.cells().firstWithName("twitter").tap(); mainWindow = app.mainWindow(); table = mainWindow.tableViews()[0]; userName = table.cells().firstWithName("user name"); userName.textFields()[0].setValue("mrfoobar"); finish = table.cells().firstWithName("finish"); finish.tap();

https://github.com/alexvollmer/tuneup_js

test("my test", function(target, app) { {

mainWindow = app.mainWindow(); tableViews = mainWindow.tableViews(); assertEquals(1, tableViews.length); table = tableViews[0]; assertEquals("First Name", table.groups()[0].staticTexts()[0].name()); assertEquals("Last Name", table.groups()[1].staticTexts()[0].name()); assertEquals("Fred", table.cells()[0].name()); assertEquals("Flintstone", table.cells()[1].name());

}

Jasmine

describe("Hello World App", function() {{ var target = UIATarget.localTarget(); function getLabel() { { return target.frontMostApp(). mainWindow().staticTexts()[0].value(); } it("should display \"Hello World !\" in the label after pressing the \"Click Me :)\" button", function() { target.frontMostApp(). mainWindow().buttons()["Click Me :)"].tap(); expect(getLabel()).toEqual("Hello World !"); });

});

Jasmine

https://github.com/pivotal/jasmine-iphone

https://github.com/mczenko/UIAutomation-jasmine-iphone

https://github.com/shaune/jasmine-ios-acceptance-tests

https://github.com/jhaynie/iphonesim

https://github.com/robholland/WaxSim

iOS Native Driver Java Test

public void testNativeDriver() throws Exception { WebDriver driver = new IosNativeDriver(); driver.manage().timeouts().implicitlyWait(10, TimeUnit.SECONDS); // Type user name WebElement userName = driver.findElement(By.placeholder("User Name")); userName.clear(); userName.sendKeys("NativeDriver");

}

http://code.google.com/p/nativedriver

Not maintained

http://code.google.com/p/nativedriver

Some updates

https://github.com/sonixlabs/nativedriver

https://github.com/leandog/nativedriver

Ruby API

https://github.com/jarib/nativedriver-rb

EPAM-Mobile-TAF

https://github.com/EPAM-Systems/EPAM-Mobile-TAF

TAF Java Code

@BeforeClass public static void beforeAll() { logger = TAFLoggerFactory. getLogger(ProjectExampleSmokeTestSet.class); setUpAllTests(); } @Test(timeout = test_timeout) @TestFixture(username=test_desktop_user, password=test_desktop_pass) public void isAuthenticateLogin() {

expecteds = AppModel.HomeScreen.getScreenModel(); actuals = ScreenFactory.getInstance().getLoginScreen(). login(username, password).getScreenModel(); Assert.assertArrayEquals(expecteds, actuals);

}

Behavior Driven

Feature: Various scenarios that exercise different parts of Frank Scenario: Scrolling to the bottom of the table Given I launch the app When I touch "Larry Stooge" And I touch "User Roles" Then I should not see "Returns" When I scroll to the bottom of the table Then I should see "Returns"

Step Definition

When /^I touch the "([^\"]*)" nav bar button$/ do |mark|

touch( "navigationButton marked:'#{mark}'" )

end

Frameworks

https://github.com/robholland/icuke

https://github.com/moredip/Frank

https://github.com/calabash/calabash-ios

http://cukes.info/

https://github.com/cucumber/cucumber-jvm

https://github.com/baalexander/Mother-May-UI

BDD is Behavior Driven not Test Steps Driven

Jenkins

https://wiki.jenkins-ci.org/display/JENKINS/iOS+Device+Connector+Plugin

Android Testing

http://developer.android.com/tools/testing/testing_android.html

Using Android SDK

Нажатия на View

• TouchUtils.tapView(view)

Нажатия на кнопки

• getInstrumentation().sendKeyDownUpSync(KeyEvent.KEYCODE_MENU)

Ввод текста

• sendKey(“some text”)

Activity Test

@UiThreadTest public void testAdd() {

MainActivity main = (MainActivity) getActivity(); EditText val1Edit = (EditText) main.findViewById(R.id.EditText1); val1Edit.setText("3"); EditText val2Edit = (EditText) main.findViewById(R.id.EditText2); val2Edit.setText("4"); Button addButton = (Button) main.findViewById(R.id.ButtonAdd); addButton.performClick(); TextView resultText = (TextView) main.findViewById(R.id.Result); assertEquals("Result incorrect", resultText.getText(), "7");

}

В чем проблема?

Нужно знать структуру кода приложения

Очень часто приходится добавлять Thread.sleep(3000)

Большие приложения автоматизировать очень сложно

Тесты выполняются очень долго

Robotium API

getCurrentActivity()

clickOnButton(String regex)

clickInList(int line)

enterText(int index, String text)

searchText(String regex)

waitForText(), waitForActivity(), waitForView()

clickOnMenuItem(String text)

goBack(), goBackToActivity(String name)

Robotium

public void testPreferenceIsSaved() throws Exception { solo.sendKey(Solo.MENU); solo.clickOnText("Preferences"); solo.clickOnText("Edit File Extensions"); Assert.assertTrue(solo.searchText("rtf")); solo.clickOnText("txt"); solo.clearEditText(2); solo.enterText(2, "robotium"); solo.clickOnButton("Save"); solo.goBack(); solo.clickOnText("Edit File Extensions"); Assert.assertTrue(solo.searchText("application/robotium")); }

http://code.google.com/p/robotium/

Robotium with WebView

private ExtSolo solo; public void setUp() throws Exception {

super.setUp(); solo = new ExtSolo(getInstrumentation(), getActivity(), this.getClass().getCanonicalName(), getName());

} public void test() {

solo.clickOnHtmlElement(“userName”); solo.enterTextIntoHtmlElement(“User”, ”userName”); solo.htmlGoBack();

} http://docs.testdroid.com/_pages/extsolo.html

Robotium выводы

Автоматические ожидания

Автоматический поиск View

Автоматическое переключение на Activity

Сам принимает решения, например scroll

jUnit 3

Работает только с однопроцессными

приложениями

Требует базовое Activity для работы

Запуск тестов in Parallel или in Cloud

http://testdroid.com/product/testdroid-server

http://testdroid.com/product/testdroid-cloud

Jenkins

https://wiki.jenkins-ci.org/display/JENKINS/Building+an+Android+app+and+test+project

https://wiki.jenkins-ci.org/display/JENKINS/Android+Emulator+Plugin

Helper Tools

http://developer.android.com/tools/help/hierarchy-viewer.html

http://developer.android.com/tools/help/monkey.html

https://github.com/robomorphine/testrunner

Android Native Driver Java Test private AndroidNativeDriver driver; @Override protected void setUp() { driver = getDriver(); } @Override protected void tearDown() { driver.quit(); } protected AndroidNativeDriver getDriver() { return new AndroidNativeDriverBuilder().withDefaultServer().build(); } private void startListViewActivity() { driver.startActivity("com.google.android.testing.nativedriver." + "simplelayouts.ListViewActivity"); } public void testClickListItems_scrollsGradually() { startListViewActivity(); for (String state : states) { driver.findElement(AndroidNativeBy.text(state)).click(); }}

http://code.google.com/p/nativedriver https://github.com/alfredz/android-nativedriver

ANDROID UI API

UiScrollable settingsItem = new UiScrollable(new UiSelector() .className("android.widget.ListView"));

UiObject about = settingsItem.getChildByText(new UiSelector() .className("android.widget.LinearLayout"), "About tablet");

about.click()

http://developer.android.com/tools/help/uiautomator/index.html

http://developer.android.com/tools/testing/testing_ui.html

Monkey Runner Python device = MonkeyRunner.waitForConnection() package = 'com.example.android.notepad' device.wake() device.shell("am start -a android.intent.action.INSERT -t vnd.android.cursor.dir/contact -e name 'Vasya Pupkin' -e phone 555-1111") device.startActivity(component="com.android.contacts/.TwelveKeyDialer") device.installPackage('d:\\NotePadTraining.apk') device.press('KEYCODE_MENU', MonkeyDevice.DOWN_AND_UP) device.type("asdsadsad")

http://developer.android.com/tools/help/monkeyrunner_concepts.html

Monkey Runner Extension

def testViewFactory_TextView(self):

attrs = {'class': 'android.widget.EditText', 'text:mText': 'Button with ID'}

view = View.factory(attrs, None, -1) self.assertTrue(isinstance(view, EditText))

https://github.com/dtmilano/AndroidViewClient

Other Android Tools

http://developer.android.com/tools/help/monkey.html

https://github.com/calabash/calabash-android

https://github.com/eing/moet

http://www.ranorex.com/mobile-automation-testing/android-test-automation.html

https://github.com/kaeppler/calculon

https://github.com/pivotal/robolectric

https://www.lesspainful.com/

Demo

For Web Applications

Selenium WebDriver

public void testGoogle() throws Exception { WebDriver driver =

new AndroidDriver() or IPhoneDriver();

driver.get("http://www.google.com"); WebElement element = driver.findElement(By.name("q")); element.sendKeys("Cheese!"); element.submit(); driver.quit(); }

Сегодня узнали

Какие есть инструменты для UI автоматизации тестирования:

• iOS приложений

• Android приложений

Какие стоит использовать, а какие нет

@adzynia

http://adzynia.com

me@adzynia.com