Project for Insight Data Engineering

1. SceneFindr
Stephanie Stark

2. Motivation
● Interested in hearing live music, but don’t
know where to go?

3. Demo
recommendations demo
metro api
artist api

4. Pipeline

5. Data Sources

6. Data Sources

7. Data Sources

8. Data Sources

9. Data Sources

10. Pipeline

11. ETL
Artists
Events
Feature
Extraction
K-Means
Clustering
Recommendations

12. Database

13. Pipeline

14. Lessons Learned (the hard way!)
● Scala
● Parallelized ML algorithms

15. About Me
B.A., Mount Holyoke College
Major: Mathematics
Minor: Computer Science
Education
Interests Reading
Art History
Hiking
Stephanie Stark

16. Future Work
Implement TF/IDF compatibility for project
Use PCA
Implement cosine similarity for feature
clustering
Cluster within metro area
Use Redis as a cache for feature vectors

17. Scaling
500GB of artist data
500GB of event data