Building up on the 2013 talk "OpenERP Testing Tools" by Alexandre Fayolle [1], I will present the state of the art of automatic testing for Odoo, in areas like expressiveness, maintainability and speed. I will show how to effectively use the testing techniques available, with examples on how to improve readability, isolation, output and failures. Next, I will discuss some open problems, with possible solutions for the near future. [1] http://www.slideshare.net/openobject/why-and-how-to-develop-open-test-scenarios-in-python-and-using-oerp-scenario-alexandre-fayolle-camptocamp

1. odoo testing on steroids
Leonardo Pistone
Camptocamp
1 / 52

2. About me
Leonardo Pistone
Developer @ Camptocamp
OCA committer & delegate member
@lepistone
2 / 52

3. what I'd love
3 / 52

4. deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
4 / 52

5. deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
defcompute_tax(base,rate=0):
return0
5 / 52

6. deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
defcompute_tax(base,rate=0):
return0
deftest_zero_rate(self):
assertcompute_tax(50,0)==50
6 / 52

7. defcompute_tax(base,rate=0):
returnbase
deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
deftest_zero_rate(self):
assertcompute_tax(50,0)==50
7 / 52

8. defcompute_tax(base,rate=0):
returnbase
deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
deftest_zero_rate(self):
assertcompute_tax(50,0)==50
deftest_positive_rate(self):
assertcompute_tax(100,0.05)==105
deftest_negative_rate(self):
assertcompute_tax(100,0.05)==95
8 / 52

9. defcompute_tax(base,rate=0):
returnbase*(1+rate)
deftest_no_price_no_tax(self):
assertcompute_tax(0)==0
deftest_zero_rate(self):
assertcompute_tax(50,0)==50
deftest_positive_rate(self):
assertcompute_tax(100,0.05)==105
deftest_negative_rate(self):
assertcompute_tax(100,0.05)==95
9 / 52

10. #python-munittestdiscover
....
---------------------
Ran4testsin0.002s
OK
10 / 52

11. #python-munittestdiscover
....
---------------------
Ran4testsin0.002s
OK
$python-munittestdiscover
F.F.
======================================================================
FAIL:test_positive_rate_increases_amount(test_tax.TestTax)
----------------------------------------------------------------------
Traceback(mostrecentcalllast):
File"tdd/test_tax.py",line13,intest_positive_rate_increases_amount
self.assertEqual(compute_tax(100,0.05),105)
AssertionError:100!=105
----------------------------------------------------------------------
Ran4testsin0.000s
FAILED(failures=2)
11 / 52

12. expressive
12 / 52

13. expressive
fast
13 / 52

14. expressive
fast
relevant output
14 / 52

15. expressive
fast
relevant output
maintainable
15 / 52

16. expressive
fast
relevant output
maintainable
¯_(ツ)_/¯
16 / 52

17. ...really?
17 / 52

18. 2015-03-1913:24:51,80623693INFOopenerp_testopenerp.addons.sale_exception_nostock.tests.test
2015-03-1913:24:51,81123693INFOopenerp_testopenerp.addons.sale_exception_nostock.tests.test
2015-03-1913:24:51,81223693INFOopenerp_testopenerp.addons.sale_exception_nostock.tests.test
2015-03-1913:24:51,81223693INFOopenerp_testopenerp.addons.sale_exception_nostock.tests.test
2015-03-1913:24:52,93323693INFOopenerp_testopenerp.modules.module:modulesale_owner_stock_
2015-03-1913:24:53,04823693INFOopenerp_testopenerp.modules.loading:loadingsale_owner_stoc
2015-03-1913:24:53,15523693INFOopenerp_testopenerp.modules.loading:loadingsale_owner_stoc
2015-03-1913:24:53,22723693INFOopenerp_testopenerp.modules.module:openerp.addons.sale_owne
2015-03-1913:24:53,22823693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:54,61823693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:55,71623693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:56,80923693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:58,53723693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:58,53723693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:58,53723693INFOopenerp_testopenerp.modules.module:openerp.addons.sale_owne
2015-03-1913:24:58,53823693INFOopenerp_testopenerp.modules.module:openerp.addons.sale_owne
2015-03-1913:24:58,53823693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:59,57223693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:59,99823693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:24:59,99923693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:24:59,99923693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:25:00,00023693ERRORopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.
2015-03-1913:25:00,00023693INFOopenerp_testopenerp.addons.sale_owner_stock_sourcing.tests.t
2015-03-1913:25:00,00023693ERRORopenerp_testopenerp.modules.module:Modulesale_owner_stock
2015-03-1913:25:01,30523693INFOopenerp_testopenerp.modules.module:modulesale_partner_orde
2015-03-1913:25:01,45923693INFOopenerp_testopenerp.modules.loading:loadingsale_partner_or
2015-03-1913:25:01,61123693INFOopenerp_testopenerp.modules.loading:loadingsale_partner_or
2015-03-1913:25:01,75323693INFOopenerp_testopenerp.modules.loading:45modulesloadedin25
2015-03-1913:25:03,31423693ERRORopenerp_testopenerp.modules.loading:Atleastonetestfail
2015-03-1913:25:03,34723693INFOopenerp_testopenerp.modules.module:openerp.addons.base.test
2015-03-1913:25:03,34823693INFOopenerp_testopenerp.addons.base.tests.test_xmlrpc:test_01_x
18 / 52

19. (╯°□°）╯︵ ┻━┻)
19 / 52

20. (╯°□°）╯︵ ┻━┻)
20 / 52

21. Problems
21 / 52

22. Problems
output
22 / 52

23. Problems
output
slowness
23 / 52

24. Problems
output
slowness
dependencies
24 / 52

25. Problems
output
slowness
dependencies
brittleness
25 / 52

26. unittest
classTestItBlocks(TransactionCase):
deftest_it_can_block(self):
self.order.order_line.budget_tot_price=80.0
self.order.order_line.price_unit=100.0
self.order.action_button_confirm()
self.assertEqual('draft',self.order.state)
26 / 52

27. unittest
classTestItBlocks(TransactionCase):
deftest_it_can_block(self):
self.order.order_line.budget_tot_price=80.0
self.order.order_line.price_unit=100.0
self.order.action_button_confirm()
self.assertEqual('draft',self.order.state)
defsetUp(self):
super(TestItBlocks,self).setUp()
#boringstuff
27 / 52

28. YAML
-
Icreateaquotationwithadropshippingline.
-
!record{model:sale.order,id:so_4}:
partner_id:base.res_partner_3
order_line:
-product_id:product.product_product_7
product_uom_qty:8
route_id:route_drop_shipping
-
Iconfirmthesaleorder,runthescheduler,andcheckthattheaddressof
thesaleorderhasbeenpropagatedtotheautomaticallygeneratedpurchase
order.
-
!python{model:sale.order,id:so_4}:|
fromnose.toolsimport*
self.action_button_confirm()
self.env['procurement.order'].run_scheduler()
proc=self.order_line[0].procurement_ids
assert_equal(
proc.purchase_id.dest_address_id.id,
ref('base.res_partner_3'),
)
28 / 52

29. OERPScenario
Feature:Invoiceworkflow
Scenario:Validationofaninvoice
GivenIenteredasupplierinvoicefor1000EUR
WhenIvalidatetheinvoice
Thenthestateoftheinvoiceis"open"
29 / 52

30. OERPScenario
Feature:Invoiceworkflow
Scenario:Validationofaninvoice
GivenIenteredasupplierinvoicefor1000EUR
WhenIvalidatetheinvoice
Thenthestateoftheinvoiceis"open"
need to write steps to implement phrases
30 / 52

31. OERPScenario
Feature:Invoiceworkflow
Scenario:Validationofaninvoice
GivenIenteredasupplierinvoicefor1000EUR
WhenIvalidatetheinvoice
Thenthestateoftheinvoiceis"open"
need to write steps to implement phrases
can abstract from implementation
31 / 52

32. OERPScenario
Feature:Invoiceworkflow
Scenario:Validationofaninvoice
GivenIenteredasupplierinvoicefor1000EUR
WhenIvalidatetheinvoice
Thenthestateoftheinvoiceis"open"
need to write steps to implement phrases
can abstract from implementation
same test could be used for backend + browser
32 / 52

33. OERPScenario
Feature:Invoiceworkflow
Scenario:Validationofaninvoice
GivenIenteredasupplierinvoicefor1000EUR
WhenIvalidatetheinvoice
Thenthestateoftheinvoiceis"open"
need to write steps to implement phrases
can abstract from implementation
same test could be used for backend + browser
readable by non-developers
33 / 52

34. new()
classTestUnitCheck(TransactionCase):
deftest_over_budget(self):
order=self.env['sale.order'].new({
'total_budget':80.0,
'amount_total':100.0,
})
self.assertTrue(order.over_budget())
34 / 52

35. new()
classTestUnitCheck(TransactionCase):
deftest_over_budget(self):
order=self.env['sale.order'].new({
'total_budget':80.0,
'amount_total':100.0,
})
self.assertTrue(order.over_budget())
required fields are not enforced
35 / 52

36. new()
classTestUnitCheck(TransactionCase):
deftest_over_budget(self):
order=self.env['sale.order'].new({
'total_budget':80.0,
'amount_total':100.0,
})
self.assertTrue(order.over_budget())
required fields are not enforced
not stored to the database
36 / 52

37. new()
classTestUnitCheck(TransactionCase):
deftest_over_budget(self):
order=self.env['sale.order'].new({
'total_budget':80.0,
'amount_total':100.0,
})
self.assertTrue(order.over_budget())
required fields are not enforced
not stored to the database
otherwise pretty real
37 / 52

38. mock
product=Mock(
spec_set=self.env['product.product'],
qty_available=20,
)
38 / 52

39. mock
product=Mock(
spec_set=self.env['product.product'],
qty_available=20,
)
fake objects
39 / 52

40. mock
product=Mock(
spec_set=self.env['product.product'],
qty_available=20,
)
fake objects
canned responses
40 / 52

41. anybox.buildout.odoo / nosetests
41 / 52

42. anybox.buildout.odoo / nosetests
$bin/nosetests_odoo-dd---wmodule_dir
INFO?anybox.recipe.openerp.runtime.session:Openingdatabase'd'
.........
------------------------------------------------------------------
Ran9testsin21.794s
OK
42 / 52

43. anybox.buildout.odoo / nosetests
$bin/nosetests_odoo-dd---wmodule_dir
INFO?anybox.recipe.openerp.runtime.session:Openingdatabase'd'
.........
------------------------------------------------------------------
Ran9testsin21.794s
OK
no update
43 / 52

44. anybox.buildout.odoo / nosetests
$bin/nosetests_odoo-dd---wmodule_dir
INFO?anybox.recipe.openerp.runtime.session:Openingdatabase'd'
.........
------------------------------------------------------------------
Ran9testsin21.794s
OK
no update
no irrelevant logging
44 / 52

45. anybox.buildout.odoo / nosetests
$bin/nosetests_odoo-dd---wmodule_dir
INFO?anybox.recipe.openerp.runtime.session:Openingdatabase'd'
.........
------------------------------------------------------------------
Ran9testsin21.794s
OK
no update
no irrelevant logging
rerun only failing tests
45 / 52

46. anybox.buildout.odoo / nosetests
$bin/nosetests_odoo-dd---wmodule_dir
INFO?anybox.recipe.openerp.runtime.session:Openingdatabase'd'
.........
------------------------------------------------------------------
Ran9testsin21.794s
OK
no update
no irrelevant logging
rerun only failing tests
keep your old tests
46 / 52

47. split decisions and dependencies
47 / 52

48. split decisions and dependencies
classInvoice:
defcompute(amount,rate): #putdecisionshere
returnamount*(rate+1)
48 / 52

49. split decisions and dependencies
classInvoice:
defcompute(amount,rate): #putdecisionshere
returnamount*(rate+1)
defupdate_tax(self): #putdependencieshere
tax=Tax.search(self.partner.tax_conditions)
self.amount_with_tax=self.compute(
self.amount_untaxed,
tax.rate,
)
49 / 52

50. split decisions and dependencies
classInvoice:
defcompute(amount,rate): #putdecisionshere
returnamount*(rate+1)
defupdate_tax(self): #putdependencieshere
tax=Tax.search(self.partner.tax_conditions)
self.amount_with_tax=self.compute(
self.amount_untaxed,
tax.rate,
)
functional core, imperative shell (Gary Bernhardt)
50 / 52

51. thanks!
51 / 52

52. thanks!
OCA sponsors
52 / 52