BigData & Data Engineering

1. Visual search results
validation or where is my ninja
turtles bucket?
NOV 3, 2018

2. 2CONFIDENTIAL
ATLAS project

3. Search products
A simple interface
to a very complex
problem

4. ATLAS timeline

5. Why can’t Elasticsearch solve
the problem?

7. ATLAS toolbox
Adaptive strategies Computer visionIntelligence

8. Automated synonym detection teaser
Picture is photo
Drama is show
Love is hate

9. Search products
A simple interface
to a very complex
system

10. Search products

11. 11CONFIDENTIAL
A quick test

12. Test 1:
select a dark t-shirt

14. Test 1:
select a cheap t-shirt

16. Sometimes less is more
Unsatisfied customer
Time Choices
We have to respect human nature

17. Another example
t-shirt
T-Shirt Soft Cotton
Are you
kidding me?

18. 18CONFIDENTIAL
The problem

19. A proper way to start
Let’s search for
“mutant ninja turtles”

23. Expected Experienced

24. Full text search has flaws
Full text searching is likely to retrieve many
documents that are not relevant to the
intended search question.
The retrieval of irrelevant documents is
often caused by the inherent ambiguity of
natural language.
Product description and specifications
might affect relevancy badly.

25. 25CONFIDENTIAL
Any solution?

26. Basic idea
Top
queries
Product images from
Google/Amazon/etc
Phase1: Training
AI and
Computer
vision

27. Basic idea
Top
queries
AI and
Computer
vision
Product images from
Google or/and Amazon
Phase1: Training
Trained
models

28. Basic idea
Top
queries
AI and
Computer
vision
Product images from
Google or/and Amazon Products
Trained
models
OK
NOT OK
Phase2: TestingPhase1: Training

29. Basically, it is an
artificial eye

31. Technology we use

32. 32CONFIDENTIAL
Results

36. 36CONFIDENTIAL
Self-learning?

37. Self-learning problem: cultural perspective

38. Where is my
rectangle?!?
Computer vision is not that accurate

40. TV – 72%

41. Evil test (TBD)
Nice dress!
Nice dress!
TBD
TBD

42. 42CONFIDENTIAL
Additional validation

43. Non uniform products in the feed
Vision
NOT OK
NOT OK

46. Identify product shape
• No manual operations are allowed
• All products should be uniform
Small area Big area

47. Example #1
I’m so tired…

48. Product shape 01
TBD

49. Product shape 02
TBD

50. Uniform products improve the experience
OK!
OK!

51. Good model – Good results

52. 52CONFIDENTIAL
The solution at scale

53. Splitting axe model training
Trained
model
… additional 1000 000 examples

54. Multiple data sources
Trained
models
Amazon Google Wikipedia
Verified
training sets

55. Complete solution
• Fast
• Extremely fast comparing to
a manual testing
• Knows everything
• Validates visual results
• Adapts and learns on the fly
• Works 24/7
Trained models
“splitting axe” model

56. 56CONFIDENTIAL
Question & Answers