How can you improve complex video software when your performance indicators are highly variable? The answer is proper methodology, proper data infrastructure and analysis.
27. 201: Chi-Squared Test
Test dependency of two variables: Label vs. Metric X
● If X and Label are truly independent (Null
Hypothesis), the Chi Squared distribution is known.
● Comparison of the observed Chi Squared distribution
versus the theoretical one gives us the probability
that the difference we see isn’t just noise.
32. 5 What’s Next for us?
● More statistical significance visuals
● User clusters based on how they interact with our tech
● ML for client configuration optimization