Web-Scale Language-Independent Cataloging of Noisy Product Listings for E-Commerce
1. Web-Scale Language-Independent
Cataloging of Noisy Product
Listings for E-Commerce
Pradipto Das
Yandi Xia
Aaron Levine
Giuseppe Di Fabbrizio
Ankur Datta
Rakuten Institute of Technology – Boston | Rakuten USA
Boston, MA
USA
9. The opinions expressed are solely my own and do
not express the views or opinions of my employer
It is severely imbalanced
Toys
Home Furniture & Patio
Jewelry & Watches
Bag Handbags & Accessories
Health Beauty & Fragrance
Shoes
Electronics & Computers
Office
Sports & Fitness
Automotive
Industrial
Baby Products
Food
Baby & Kids Clothes
Men's Clothing
Women's Clothing
Other Clothing
3.42
32.54
4.41
2.20
6.34
3.48
11.14
4.73
3.19
8.20
6.09
0.36 1.57 0.82 1.71 2.84
0.14
Number of *deduplicated* instances in raw feeds (Millions)
10. The opinions expressed are solely my own and do
not express the views or opinions of my employer
But some, we assume are good data
Gradual Tan Plus Firming Four-in-One
Tan Tone Firm & Moisturize 5oz
Health & Personal Care > Skin Care > Sun > Self-tanners & Bronzers
Brand
Title
http://shop.nordstrom.com/s/st-tropez-gradual-tan-plus-firming-four-in-one-tan-tone-firm-moisturize/3865243#29533668
Home > Women > Beauty & Fragrance > Spa Nordstrom > Shop Spa Products > Sunless Tanning
13. The opinions expressed are solely my own and do
not express the views or opinions of my employer
Noise is unavoidable – bigly!
(X)Learn: Y=
Women’s Shoes
Comfort
Shoes
Pumps Sneakers Flats …
Machine Learning
Model
100MM
Runway
Felt Mule
Sandals
Lips Too Women's
'Too Sliver' Patent
Casual Shoes
Size 6
10 Crosby Women's
Ynez Pump
1883 by Wolverine
Women's Maisie
Oxford Tan/Taupe
Leather/Suede
1803 Women's
'Nome' Crocodile
Dress Shoes Size 9
…
x1
x2
x3 x4
x5
y1
y2 y3 y4
yL
xN
• We also have no control over the external
vendor’s categorization accuracy
18. The opinions expressed are solely my own and do
not express the views or opinions of my employer
Shoes – Rule based filtering
Blacklisted Titles
1 Chronicles Thru Job (Hardcover)
"She Was a Sister Sailor" (Hardcover)
1 & 2 Thessalonians: A Critical and Exegetical Commentary (Hardcover)
1. Fachtagung Uber Programmiersprachen: Munchen, 9.?11. Marz 1971 (Paperback)
...Keeping Clarke: One Son. One Day. One Mom's Personal Journey Through Grief (Paperback)
"Messiah" from Scratch Tenor Edition (Paperback)
"Lucky Streak" (Compact Disc)
10 Hymns & Gospel Songs for Medium High Voice (Compact Disc)
2030 (Compact Disc)
(Un) Armed And Dangerous, Vol. 2 (VHS)
100 Years of Irish Dancing 1897-1997 (VHS)
101 Classic Goals of the World Cup (VHS)
10 Movie Mega Pack, Vol. 4 (DVD)
101 Greatest Moments From 1992 World Cup (DVD)
30-Day Guitar Workout - Book Included (DVD)
1.00 CTW Emerald Three Stone Pendant Necklace 14K Gold yellow
21. The opinions expressed are solely my own and do
not express the views or opinions of my employer
Impossible to inspect 3.4M label,
instance pairs
Women’s Shoes
Comfort Pumps Sneakers Sandals …
100MM
Runway
Felt
Mule
Sandals
Lips Too Women's
'Too Sliver' Patent
Casual Shoes
Size 6
10 Crosby Women's
Ynez Pump
1883 by
Wolverine
Women's Maisie
Oxford Tan/Taupe
Leather/Suede
God’s Big Idea:
Reclaiming God’s
Original Purpose
for Your Life
(CompactDisc)
…
x1
x2
x3
x4
x5
y1 y2 y3 y4 yL
xN
Men’s Shoes Girl’s Shoes…
Shoes
27. The opinions expressed are solely my own and do
not express the views or opinions of my employer
What is the minimal relevant field of
information that causes errors?
Category Title Brandname Storename Breadcrumbs List price Image
Sneakers &
Athletic
Shoes >
Men’s Shoes
> Shoes
Walk Ultra IV
DMX
Max White
Other brands Reebok 74.99
Slippers >
Men’s Shoes
> Shoes
Tumi Alpha
Anthracite
Multi Wndow
Card Case
Tumi ABT
Electronics
Home >
Watches &
Fashion >
Luggage &
Accessories >
Wallets >
Men’s Wallets
65.00
Signals: Highly-Relevant Relevant Neutral
31. The opinions expressed are solely my own and do
not express the views or opinions of my employer
Amazon (McAuley et al. 2015)
0
10
20
30
40
50
60
70
80
90
100
appliances
arts, crafts & sewing
automotive
baby products
beauty
books
cds & vinyl
cell phones & accessories
clothing, shoes & jewelry
collectibles & fine art
electronics
grocery & gourmet food
health & personal care
home & kitchen
industrial & scientific
movies & tv
musical & instruments
office products
patio, lawn & garden
pet supplies
software
sports & outdoors
tools & home improvement
toys & games
video games
NB
LogReg ElasticNet (OvA)
LogReg L1 (OvO)
GBT
CNN w/ pretraining
49.013
69.393
66.647
67.171
72.659
Average Micro
precision on
10% test sets
for 25 top level
categories
Micro precision on 10% test set
Total training instances: 7.4M
Total test instances : 0.9M
Average Level 1
KL(empirical | uniform) =
1.654
Amazon dataset from: Julian McAuley, Rahul Pandey, and Jure Leskovec. 2015. Inferring
networks of substitutable and complementary products. In Proceedings of the 21th ACM
SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’15,
pages 785–794, New York, NY, USA