using crowdsourced testing to turbocharge your development team
TRANSCRIPT
Using Crowdsourced Testing to Turbocharge your Development Team
What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
QA that FITS IN THE DEV PROCESS
“Shifting Left”Building quality in from the start
Dev-Owned QAThe Upside
- Bugs are caught faster- There’s less room for
communication errors- Keeps development agile
Dev-Owned QAThe Downside
- Time is spent on testing, not building
- Delays in release schedule - Because of this “double
duty,” things fall through the cracks
Solution?Testing that keeps up with agile development
Crowdsourced TestingHow does it turbocharge your team?
Write TestsWrite & run functional tests through UI, API or CLI
How Rainforest Works
Run TestsEach test is sent to 3 trained testers from our on-demand crowd of 50K testers
Result VerificationRainforest algorithms verify the accuracy and quality of the tester results
Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers
ExpertiseThe average tester has been working with Rainforest for 16 months
The Rainforest Crowd Difference
Consistency68% of testers execute more than 50 Rainforest tests each week
Continued LearningOur tester pool completes over 15,000 QA training sessions each week
Machine LearningEnsures that each test run meets our standard for quality
Rainforest DevXUsing crowdsourced testers to run tests and provide deterministic results within existing workflows
How Rainforest DevX Works
Rainforest CLI
Benefits of Rainforest DevX
Run all tests synchronously for quick resultsSave developer time and resources by allowing the crowd to execute test cases
Testing FlexibilityTest at any point within your release process
Reduce test management overheadEliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into Your Development Workflow
“
”
Our devs realized that they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our testsMitch Stewart, CTO, Guru
“
”
We love that we can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests onWelling LaGrone, Director of Software Engineering, America’s Test Kitchen
$3.3 MM Saved annually over in-house QA
557 HRSSaved on testing per month
30 X Speed of an in-house team
Customer Stats
LEARN MORETo find out more about streamlining testing…
Contact: [email protected]: @rainforestappFollow: @rainforest_eng