applications-of-lang-tech.pdf
•
0 j'aime•35 vues
Introduction to language technology on social media: Answers to following questions 1) What is social media? 2) What is language technology? 3) What do you do on social media? 4) How does language technology help you on social media? 5) How does language technology harm you on social media?
Recommandé
Contenu connexe
Similaire à applications-of-lang-tech.pdf
Similaire à applications-of-lang-tech.pdf (20)
Dernier
Dernier (20)
applications-of-lang-tech.pdf
- 1. Introduction to language technology on social media Ali Hürriyetoğlu May 9, 2023 Utrecht University
- 2. What will we learn? • What is social media? • What is language technology? • What do you do on social media? • How does language technology help you on social media? • How does language technology harm you on social media?
- 3. Outline • Social media (SM) • Language Technology (LT) • Privacy • Ethics • Limitations • Do it yourself!
- 4. Social media • User-generated content • Official writing rules do not apply • Any character can be used • Network of users, hashtags, etc. • Real-time communication • Two-way • Global reach
- 5. • How many social media platforms do you use? • Any niche social media platform you may suggest us? • How many hours a day do you spend on social media?
- 9. Language technology - TC • Text classification • Language identification • Spam detection • Sentiment analysis, etc. https://doi.org/10.1016/j.neucom.2018.07.044
- 10. Language technology - IE • Information extraction • Named Entity recognition • Event extraction • Semantic role labeling, etc. https://techblog.smc.it/en/2020-12-11/nlp-ner
- 11. Language technology - LG • Language generation • Machine translation • Text summarization • Text simplification • Question answering https://devopedia.org/text-summarization
- 12. Demo time • Please go and try • https://demo.allennlp.org/reading-comprehension/bidaf-elmo • Pick and try a demo from https://allenai.org/demos • https://huggingface.co/facebook/bart-large-mnli • Pick and try a model from https://huggingface.co (use the search box on top- left) • What do you observe? • Pros • Cons
- 13. You must know this! • Language technology shapes your worldview! It determines • The content you see • The follow recommendations you get • How people find you • The job recommendations you see • How recruiters find you • … • Be aware of it! https://ourworldindata.org/artificial-intelligence
- 14. Language technology – User level tasks • User-based analyses • Ban content/accounts if they are offensive, fake, misinformation, etc. • Detect bots • Detect trust level: should I trust this user? • Recommend relevant users
- 15. Language technology – Post level tasks • Post/message level analyses • Convert text to standard language • Hide a comment if it does not contribute to the discussion • Show relevant posts • Show similar questions on Stackoverflow • Detect hate speech, cyberbullying, and threats • Detect fake or deceptive posts • Detect sarcasm • Detect fiction • Summarize a set of posts • Simplify or paraphrase a post for specific groups • Translate between languages • Detect trends
- 16. Language technology - Domains • Humanitarian purposes • What do people need? • Identify relevant information in the scope of a disaster • Health • Supporting mental health, Suicide prevention • Early detection of epidemics/pandemics • Criminal • Open-source intelligence, OSINT • Improving public safety • Politic behavior • What do people want? • Voting preference detection • Consumer behavior • What do people buy? • What do people think about a product? • What is the effect of a marketing campaign? • Economics, finances • Predicting stock market trends • Linguistics • Identify endangered languages • Is the content appropriate for kids? Is a simplification or summarization needed and at what level?
- 17. • How else would you like to analyze text on social media?
- 18. Privacy • Full anonymization is almost impossible • Your content is utilized (or not) for creating language technology, do you consent? • Pros? • Cons? https://ai.googleblog.com/2020/12/privacy-considerations-in- large.html
- 19. Ethics • The development of social media platforms and many language technologies are mainly revenue- oriented • Companies do (may) not care how they affect you. • Check https://unqover.apps.allenai.org • You may be in a filter bubble.
- 20. Limitations • Although the text is everywhere, technologies utilized for social media are increasingly multimodal: network, image, image+text, etc. • The performance of language technology tools may significantly decrease on a new text • Meaning determined by the time, user, etc. • LT may not work well on content from and on minority groups
- 21. Do it yourself • Spacy: https://spacy.io • Transformers: https://huggingface.co/docs/transformers/index • Scikit-learn: https://scikit- learn.org/stable/tutorial/text_analytics/working_with_text_data.html • NLTK: https://www.nltk.org • Corpus tools: https://corpus.tools • Finnish tools: https://www.kielipankki.fi/tools/
- 22. • What is social media? • What is language technology? • What do you do on social media? • How does language technology help you on social media? • How does language technology harm you on social media?
- 23. Further … • Zaghouani, W., & City, E. Language Technologies for Social Media. INTEGRATING ICTIN SOCIETY, 11. URL: http://infoz.ffzg.hr/infuture/2017/images/papers/1- 02_Zaghouani,_Language_Technologies_for_Social_Media.pdf • https://ourworldindata.org/rise-of-social-media • Tools and Demos • Sense clustering over time: https://www.inf.uni- hamburg.de/en/inst/ab/lt/resources/demos/scot.html • Various demos: https://www.inf.uni- hamburg.de/en/inst/ab/lt/resources/demos.html
- 24. • Thanks for your time! • What questions do you have? • Contact: ali.hurriyetoglu@gmail.com @hurrial