Adaptive Filtering of Tweets with Machine Learning by Neri Van Otten
•Download as PPTX, PDF•
1 like•1,191 views
Adaptive Filtering of Tweets with Machine Learning by Neri Van Otten
Recommended
More Related Content
Similar to Adaptive Filtering of Tweets with Machine Learning by Neri Van Otten
Similar to Adaptive Filtering of Tweets with Machine Learning by Neri Van Otten (20)
More from PyData
More from PyData (20)
Recently uploaded
Recently uploaded (20)
Adaptive Filtering of Tweets with Machine Learning by Neri Van Otten
- 1. ADAPTIVE FILTERING OF TWEETS WITH MACHINE LEARNING Neri Van Otten Data Scientist, Conversocial
- 2. About Conversocial • Social customer service platform
- 4. Continual Improvement • Incorporate feedback from customers • Constant monitoring performance
- 5. How to Process Text • Create features • Tf-idf for bag of words • N-grams • Other features e.g. length of text, contains url, … • Convert to matrix of 0/1 • Singular value decomposition (SVD) • Machine learning models
- 6. Parameter Optimization • Separate server • Runs on backup copy of database
- 7. Training Models • Daily training • Queued and trained when servers are under utilized • Lower priority as the system still has working models • Store to S3
- 8. Models in Production • Servers specific for prioritization • Chef to configure new servers • Servers download models from S3 • Cache as many models in memory as possible • Evict older models • Use the client specific model to classify message
- 9. Questions