In the data industry, having correctly labelled datasets is vital. Timothy Thatcher explains how tagging your data while considering time and location and complex hierarchical rules at scale can be handled.

2. Point in Time Labelling
for Alternative Data
Timmy Thatcher

3. hello@timm.yt

4. - Culture capital of Australia
hello@timm.yt

5. - Culture capital of Australia
- Bachelor of Mechatronics Engineering
hello@timm.yt

6. - Culture capital of Australia
- Bachelor of Mechatronics Engineering
- Legoland
hello@timm.yt

7. - Culture capital of Australia
- Bachelor of Mechatronics Engineering
- Legoland
- Software in Amsterdam for 1.5yrs
hello@timm.yt

8. Suburbia.io

9. - Alternative Data - Better Decisions
Suburbia.io

10. - Alternative Data - Better Decisions
- Messy data from many sources and polish it into a
useable dataset
Suburbia.io

11. - Alternative Data - Better Decisions
- Messy data from many sources and polish it into a
useable dataset
- Current focus is on POS data
Suburbia.io

12. - Alternative Data - Better Decisions
- Messy data from many sources and polish it into a
useable dataset
- Current focus is on POS data
- Easy tasks and hard tasks
Suburbia.io

13. Easy tasks

14. -unifyingschemas
Easytasks

15. - unifying schemas
- removing bad rows
Easy tasks

16. - unifying schemas
- removing bad rows
- extracting location information
Easy tasks

17. Difficult tasks

18. - Extracting brands
Difficult tasks

19. - Extracting brands
- Point in time mapping
Difficult tasks

20. What is Point in Time Mapping?

21. What is Point in Time Mapping?
t

22. What is Point in Time Mapping?
tti

23. What is Point in Time Mapping?
tti
value

24. What is Point in Time Mapping?
tti
value
vali

25. What is Point in Time Mapping?
tti
value
vali

26. What is Point in Time Mapping?
tti
value
vali

27. What is Point in Time Mapping?
tti
value
vali
Fn(t) = val

28. What is Point in Time Mapping?
valiti

29. Real world example

30. Real world example
¥ 8100

31. Real world example
¥ 8100
€ 64

32. Real world example
¥
8100
¥ 8100

33. Real world example
¥ 8100
€ 60

34. Real world example
val1t1
valiti
val3
t3
val2t2
.
.
.

35. Example 2

36. Example 2
2015

37. Example 2

38. Example 2
hcraeS
grolsch stock ticker
SAB Miller
(LSE:SAB)

39. Example 2
2017

40. Example 2
hcraeS
grolsch stock ticker
Asahi Breweries
(TYO:2502)

41. Example 3

42. Example 3

43. Example 3
hcraeS
dr pepper stock ticker
Keurig Dr Pepper
(NYSE:KDP)

44. Example 3

45. Example 3
hcraeS
dr pepper stock ticker
The
Coca-cola
company
(NYSE:KO)

46. Example 3

47. Example 3
hcraeS
dr pepper stock ticker
PepsiCo
(NASDAQ:PEP)

48. Visual representation

49. Visual representation
coca-cola
grolsch
dr pepper
fanta
pepsi
gatorade

50. Visual representation
coca-cola
grolsch
dr pepper
fanta
pepsi
gatorade
pepsico
asahi
SAB
Miller
keurig
dr pepper
coca-cola
company

51. Visual representation
pepsico
coca-cola
asahi
SAB
Miller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company

52. Visual representation
pepsico
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*

53. Visual representation
pepsico
coca-
pepsi-co
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*
t: 2023, c:RU
t: 2023, c:RU

54. Visual representation
- Brand
pepsico
coca-
pepsi-co
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*
t: 2023, c:RU
t: 2023, c:RU

55. Visual representation
- Brand
- Time
pepsico
coca-
pepsi-co
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*
t: 2023, c:RU
t: 2023, c:RU

56. Visual representation
- Brand
- Time
- Location
pepsico
coca-
pepsi-co
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*
t: 2023, c:RU
t: 2023, c:RU

57. Visual representation
- Brand
- Time
- Location
- Parent
pepsico
coca-
pepsi-co
coca-cola
asahi
SABMiller
grolsch
dr pepper
fanta
pepsi
gatorade
keurig
dr pepper
coca-cola
company
t:1978, c:*
t:1893, c:*
t:1885, c:oceania
t:1885, c:US
t:1885, c:Europe
t:1940, c:*
t:1886, c:*
t:2008, c:*
t: 2016, c:*
t: 2023, c:RU
t: 2023, c:RU

58. New visual representation

59. New visual representation
brand

60. New visual representation
brand
t

61. New visual representation
brand
t
location

62. New visual representation
brand
t
location
loc_1
loc_2
parent_a parent_f
parent_d parent_eparent_c
parent_b

63. Dr Pepper example
Dr Pepper
t
location
US
Oceania
Europe
Keurig Dr Pepper
PepsiCo
The Coca-Cola Company

64. Grolsch example
Grolsch
t
location
*
SABMiller AsahiRoyal Grolsch NV

65. Contrived example
A B

66. Contrived example
A
β σ
B
t:1, l:* t:1, l:*

67. Contrived example
A
β σ
B
t:1, l:* t:1, l:*
α
t:2, l:DE
t:2, l:US

68. Contrived example
A
β σ
B
t:1, l:*
t:3, l:* t:3, l:US
t:3, l:AU
t:1, l:*
α
λω φ
t:2, l:DE
t:2, l:US

69. Contrived example
A
β σ
ε
B
t:1, l:*
t:3, l:* t:3, l:US t:4, l:*
t:3, l:AU
t:1, l:*
α
λω φ
t:2, l:DE
t:2, l:US

70. Contrived example
A
β σ
ε
B
t:1, l:*
t:3, l:* t:3, l:US t:4, l:*
t:3, l:AU
t:1, l:*
αρ
λω φ
t:2, l:DE
t:2, l:US
t:5, l:*

71. β
σ
σ
ε
λ
A
t
location
1 2 5 63 4
B
t
location
1 2 5 63 4
α
*
*
US
DE
ρ
β
t
location
1 2 5 63 4
ω
φ
*
US
AU
σ
t
location
1 2 5 63 4
*

72. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
DE
ρ

73. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
DE
[
{
location: DE,
from: 2,
to: ∞,
parent: σ,
},
{
location: US,
from: 2,
to: ∞,
parent: α,
},
{
location: *,
from: 2,
to: 5,
parent: β,
},
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
]
ρ

74. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
DE
[
{
location: DE,
from: 2,
to: ∞,
parent: σ,
},
{
location: US,
from: 2,
to: ∞,
parent: α,
},
{
location: *,
from: 2,
to: 5,
parent: β,
},
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
]
ρ

75. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
* *
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
σ+DE
ρ ε
σ
t
location
1 2 5 63 4

76. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
* *
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
[
{
location: *,
from: 4,
to: ∞,
parent: ε,
},
]
ρ ε
σ
t
location
1 2 5 63 4
σ+DE

77. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
* *
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
{
location: *,
from: 4,
to: ∞,
parent: ε,
}
ρ ε
σ
t
location
1 2 5 63 4
σ+DE
ε
t
location
1 2 5 63 4

78. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
* *
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
ρ ε
σ+
t
location
1 2 5 63 4
σ+DE
[
{
location: *,
from: 4,
to: ∞,
parent: ε,
},
]

79. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
* *
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
ρ ε
σ+
t
location
1 2 5 63 4
σ+DE
[
{
location: *,
from: 4,
to: ∞,
parent: ε,
},
]
ε

80. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
DE
{
location: DE,
from: 2,
to: ∞,
parent: σ,
}
ρ
σDE
[
{
location: *,
from: 4,
to: ∞,
parent: ε,
},
]
ε

81. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
DE
ρ
σDE ε
[
{
location: DE,
from: 2,
to: ∞,
parent: σ,
},
{
location: US,
from: 2,
to: ∞,
parent: α,
},
{
location: *,
from: 2,
to: 5,
parent: β,
},
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
]

82. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
US
DE
ρ
σDE ε
{
location: US,
from: 2,
to: ∞,
parent: α,
}
α
t
location
1 2 5 63 4
α+

83. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
US
DE
ρ
σDE ε
{
location: US,
from: 2,
to: ∞,
parent: α,
}
α+
t
location
1 2 5 63 4
α+

84. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
US
DE
ρ
σDE ε
{
location: US,
from: 2,
to: ∞,
parent: α,
}
α+

85. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
US
DE
ρ
σDE ε
{
location: US,
from: 2,
to: ∞,
parent: α,
}
α

86. β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
US
US
DE
ρ
σDE ε
α
[
{
location: DE,
from: 2,
to: ∞,
parent: σ,
},
{
location: US,
from: 2,
to: ∞,
parent: α,
},
{
location: *,
from: 2,
to: 5,
parent: β,
},
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
]

87. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β
t
location
1 2 5 63 4
ω
φ
*
US
AU
[
{
location: AU,
from: 3,
to: ∞,
parent: ω,
},
{
location: US,
from: 3,
to: ∞,
parent: φ,
},
{
location: *,
from: 3,
to: ∞,
parent: λ,
},
]

88. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β
t
location
1 2 5 63 4
ω
φ
*
US
AU
ω
t
location
1 2 5 63 4
[
{
location: AU,
from: 3,
to: ∞,
parent: ω,
},
{
location: US,
from: 3,
to: ∞,
parent: φ,
},
{
location: *,
from: 3,
to: ∞,
parent: λ,
},
]

89. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β
t
location
1 2 5 63 4
ω
φ
*
US
AU
φ
t
location
1 2 5 63 4
[
{
location: AU,
from: 3,
to: ∞,
parent: ω,
},
{
location: US,
from: 3,
to: ∞,
parent: φ,
},
{
location: *,
from: 3,
to: ∞,
parent: λ,
},
]

90. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β
t
location
1 2 5 63 4
ω
φ
*
US
AU
λ
t
location
1 2 5 63 4
[
{
location: AU,
from: 3,
to: ∞,
parent: ω,
},
{
location: US,
from: 3,
to: ∞,
parent: φ,
},
{
location: *,
from: 3,
to: ∞,
parent: λ,
},
]

91. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β+
t
location
1 2 5 63 4
ω
φ
*
US
AU
[
{
location: AU,
from: 3,
to: 5,
parent: ω,
},
{
location: US,
from: 3,
to: 5,
parent: φ,
},
{
location: *,
from: 3,
to: 5,
parent: λ,
},
]

92. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
λ
β+
t
location
1 2 5 63 4
ω
φ
*
US
AU
[
{
location: AU,
from: 3,
to: 5,
parent: ω,
},
{
location: US,
from: 3,
to: 5,
parent: φ,
},
{
location: *,
from: 3,
to: 5,
parent: λ,
},
]
ω
λ
φ

93. β
β+
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
[
{
location: AU,
from: 3,
to: 5,
parent: ω,
},
{
location: US,
from: 3,
to: 5,
parent: φ,
},
{
location: *,
from: 3,
to: 5,
parent: λ,
},
]
ω
λ
φ

94. β
β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
{
location: *,
from: 2,
to: 5,
parent: β,
},
[
{
location: AU,
from: 3,
to: 5,
parent: ω,
},
{
location: US,
from: 3,
to: 5,
parent: φ,
},
{
location: *,
from: 3,
to: 5,
parent: λ,
},
]
ω
λ

95. β
β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
ω
λ
[
{
location: DE,
from: 2,
to: ∞,
parent: σ,
},
{
location: US,
from: 2,
to: ∞,
parent: α,
},
{
location: *,
from: 2,
to: 5,
parent: β,
},
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
]

96. β
β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
ω
λ
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
ρ
t
location
1 2 5 63 4
ρ+

97. β
β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
ω
λ
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
ρ+
t
location
1 2 5 63 4
ρ+

98. β
β
σ
A
t
location
1 2 5 63 4
A+
t
location
1 2 5 63 4
α
*
*
US
US
DE
ρ
σDE
AU
ε
α
ω
λ
{
location: *,
from: 5,
to: ∞,
parent: ρ,
},
ρ

99. β
A+
t
location
1 2 5 63 4
*
US
σDE
AU
ε
α
ω
λ ρ
A
β σ
ε
B
t:1, l:*
t:3, l:* t:3, l:US t:4, l:*
t:3, l:AU
t:1, l:*
αρ
λω φ
t:2, l:DE
t:2, l:US
t:5, l:*

100. Questions?