Contenu connexe
Similaire à Paweł Gutowski - Test Automation for Database Solutions (20)
Plus de Trójmiejska Grupa Testerska (20)
Paweł Gutowski - Test Automation for Database Solutions
- 1. © 2013 Acxiom Corporation. All Rights Reserved. © 2013 Acxiom Corporation. All Rights Reserved.
Paweł Gutowski
Test Automation
for Database Solutions
2015-04-09
- 2. © 2013 Acxiom Corporation. All Rights Reserved.
Agenda
• Acxiom
• Solution description
• Engine test automation framework
• End 2 End test automation framework
• CI approach
• Questions
- 3. © 2013 Acxiom Corporation. All Rights Reserved.
Acxiom
• Who we are?
• What do we do?
- 4. © 2013 Acxiom Corporation. All Rights Reserved.
Project Description
• Brief description
• Engine vs configuration
• Why different approaches to automate testing?
- 5. © 2013 Acxiom Corporation. All Rights Reserved.
Tools
• Tools & Technologies
• Why use similar set as dev team?
• Need for reporting
- 6. © 2013 Acxiom Corporation. All Rights Reserved.
Engine Test Automation
• Isolated scripts
• Golden tables approach
- 7. © 2013 Acxiom Corporation. All Rights Reserved.
Engine Test Automation
• Approach pros:
- Easy to automate
- Quick to run
- Catches severe defects early
- Can help Test Driven Development
Approach cons:
- Harder to maintain (hard to add more data,
easy to add new test)
- Harder to get good test documentation
- 8. © 2013 Acxiom Corporation. All Rights Reserved.
End 2 End test automation
• End 2 End integration with semi prod files
• Configuration changes are frequent
• Over 770 audits, but how to make them right?
- 9. © 2013 Acxiom Corporation. All Rights Reserved.
End 2 End test automation
• Tests are environment independent
(schema etc)
• Test framework is data independent
(where possible)
• Audits SQLs not care about intermediate
processing
• Audits use dynamic SQL
- 10. © 2013 Acxiom Corporation. All Rights Reserved.
End 2 End test automation
Approach pros:
- Easy to add more data files
- Easier to maintain
- Regression testing for the whole solution
- Independent from environment
Approach cons:
- Hard to build
- Long to run
- Does not tell what the failure root cause is
- 11. © 2013 Acxiom Corporation. All Rights Reserved.
CI environment
• CI advantages
• Nightly vs commit based approach
• How did it work for us?