Slide deck from the ministry of testing Boston, 5/15/2018.
Hosting John Crawford from Liberty Mutual. Led by Eran Kinsbruner Lead evangelist at Perfecto
3. Who Am I?
Principal Software Engineer at Liberty
Mutual
15+ Years of Experience in Open Source
Platforms
Organize the Liberty Mutual Testing Guild
Never been in a boating accident
4. Waterfall - A Scenic River Cruise
Encourages detailed records
You have well-defined expectations
Easy to on-board new team members
In a word: Safe
In a second word: Slow
5. Agile – Cruising on the Open Sea
Get changes to market faster
Pivot quickly based on learnings
Iterate, learn and improve ideas
frequently
In a word: Fast
In a second word: Dangerous
6. Testing – Your Lifeboat, Life Vest,
Radio, Flare Gun and First Aid Kit
Different types of tests give you layers of
protection
Valuable tests are worth the effort
No such thing as too many types of testing
Don’t ignore manual testing
7. Closing - Smooth Sailing From Here
A good testing setup will prevent most
errors from getting to your users
Public mistakes hurt your reputation far
more than any missed deadline
Strong testing will raise internal confidence
in your product and team
Again… never crashed a boat
9. About Me
• Lead Technical Evangelist at Perfecto
• Blogger and Speaker
• http://continuoustesting.blog
• https://www.infoworld.com/author/Eran-Kinsbruner/
• 18+ Years in Development & Testing
• Author of The Digital Quality Handbook
Weekly Podcast - Testiumpod
Twitter: @ek121268
Email: Erank@perfectomobile.com
11. Digital is breaking new grounds
Drop of 32% in branch visits in last 4 years
Chatbots as the new Digital
Interface - everywhere
$380B industry by 2024 (26% CAGR)
Face ID Authentication
AR As a Digital Engagement
Enabler
12. Cross-Browser Testing != Desktop Web Testing
There is no Web Testing vs.
Mobile Testing
• 4 out of 10 transactions today take place on multiple
devices
• 48% of users today complain that the websites they use are
not optimized for their smartphones and tablets
14. Top 5 Automation Challenges
Tighter release schedule
leaves less time to
automate and test
(lack of) Test
automation stability
and reliability block
continuous testing
Test execution
management isn’t
intelligent and
optimized enough to
guide teams through
the DevOps pipeline
activities
Evolving and
maintaining test sets
and maximizing
productivity isn’t an
ongoing practice
Overall test automation
tool stack isn’t in sync
with organizational
capabilities
People – Process - Technology
16. Mobile Testing Landscape
Criteria Appium Espresso XCUITests
Language any Java swift/objective-C
By Open source google Apple
App supported APK and IPA APK IPA
Code required No yes yes
Testtype Black box White box White box
Speed 8t t 2t
Setup Hard Easy Medium
CI medium easy Hard
Flakiness of test very low Low
Object Locators Xpath (external) Id (from R file) id
Used by QA Android dev* iOS dev*
29. • Identify your object in a robust fashion that fits all digital Platforms
• Build object repository and use smart locators
Responsive Web Design (RWD) - Objects
The average website includes nearly 400
different objects.
Now try locating them on each and every
DIGITAL platform in your lab…
30. • Take screenshot and use Visual Checkpoint/assertion to
validate responsive aspects
Responsive Web Design (RWD) – visual validation w/ Screenshots