Machine learning and link spam - how hard can it be?
•
21 j'aime•7,434 vues
My presentation from LinkLove 2013. All about link spam, machine learning and my fumbling around with both.
Recommandé
Recommandé
Contenu connexe
En vedette
En vedette (20)
Similaire à Machine learning and link spam - how hard can it be?
Similaire à Machine learning and link spam - how hard can it be? (20)
Plus de Ian Lurie
Plus de Ian Lurie (20)
Dernier
Dernier (20)
Machine learning and link spam - how hard can it be?
- 1. Enterprise Link Spam Analysis Ian Lurie @portentint ian@portent.com
- 3. MACHINE LEARNING How hard can it be? Ian Lurie Portent, Inc @portentint
- 4. http://portent.co/machine-spam yes, this is right, no ‘m’
- 6. 1: There’s gotta be a better way 2: How hard can it be? 3: Lessons learned
- 7. ONE: THESE ARE GOOD LINKS!!!!
- 9. Some of these are real
- 10. BUILD A REALLY BIG SPREADSHEET.
- 11. GET ALL LINKS FROM GOOGLE WEBMASTER TOOLS OPENSITE EXPLORER MAJESTIC SEO
- 13. URL TITLE ANCHOR TEXT MAJESTIC TRUSTFLOW MOZ DA AND PA
- 15. EVALUATE TITLES BAD GRAMMAR JUST STUPID MAKES YOU ITCH NO
- 16. CONTACT DISAVOW
- 19. 500 LINKS: THE LOSERS ARE OBVIOUS
- 20. 500,000 LINKS: YOU GET A MIGRAINE
- 22. A KNOWLEDGEPROBLEM
- 23. Anchor Text Distribu1on Col Von Miseryburgen Alp d' Huez Sufferlandria Grunter von Agony Mithril Shirt The Devil's Den John Snow Broad Street Pump GalacDca Bagshot Row Li<le Round Top Pegasus The Lonely Mountain 0 10000 20000 30000 40000 50000 60000 70000 80000 90000 100000
- 24. BUT THESE ARE GOOD LINKS!!!!
- 25. WE CAN’T READ GOOGLE’S MIND
- 26. MACHINE LEARNING
- 27. TWO: HOW HARD CAN IT BE?
- 28. MACHINE LEARNING IN 60 SECONDS
- 29. START WITH A QUESTION
- 30. START WITH A IS THIS PAGE QUESTION SPAM?
- 31. THE ANSWER IS A CLASSIFICATION
- 32. + TRAINING SET ALGORITHM CLASSIFICATION
- 33. + TRAINING SET ALGORITHM CLASSIFICATION
- 34. + TRAINING SET ALGORITHM PREDICTION
- 35. + TRAINING SET TEXT-BASED? ALGORITHM SUPERVISED? UNSUPERVISED? CLASSIFICATION
- 36. + TRAINING SET ALGORITHM CORRECT? CLASSIFICATION OR MORONIC?
- 37. CLASSIFICATION = QUESTION
- 38. CLASSIFICATION = SPAM? TRUE OR FALSE
- 39. TRAINING SET 1 JUST WORDS
- 40. A home cooking blog featuring healthy low-glycemic recipes with step-by-step photos, as well as cooking tips, vegetable gardening, and products Kalyn loves. Mouse Trap (originally titled Mouse Trap Game) is a board game first published by Ideal in 1963 for two or more players. Over the course of the game, players at first. A delicious and refreshing cherry pie and a story about making friends of enemies :). Brady Bunch Punch drink recipe made with Amaretto,Cranberry juice,Orange juice,Triple Sec,Vodka,. How to make a Brady Bunch Punch with all the instructions and. A blog about a foreigner's life in Japan, on a mountainside above Lake Biwa. SEE the world's greatest collection of tattoo designs! Sample FREE Downloads! Cutting Edge Art by Famous Tattoo Artists! YOUR TATTOO DESIGN IS HERE!.
- 41. + TRAINING SET BAYESIAN FAIL
- 42. +
- 43. TRAINING SET 2 WORDS INTO NUMBERS
- 44. who da nerd?!!! WHO DA NERD?!!!!! + TRAINING SET LOGISTIC REGRESSION WIN
- 47. python nltk scikit-learn mongodb
- 48. Flesch-Kincaid (FK) FK grade level FK reading ease word count sentence count syllable count
- 49. links/word MajesticSEO Page TrustFlow Domain TrustFlow Unique c-blocks
- 50. THE TRAINING SET python nltk scikit-learn mongodb
- 51. seogadget.co.uk
- 52. Is seogadget.co.uk spam? true = 1.93% false = 98.07%
- 58. ABOUT GOOGLE
- 59. IT’S ABOUT LINKS. NOT PAGES. HREF=“HTTP:// GETYERLINKS HEREFREE.COM
- 60. TRUST FLOW 71 DA 97 PA 47
- 66. LESSON 1: THERE IS NO SPAM
- 67. HOW LIKELY IS IT THAT THIS LINK, FROM THIS PAGE, IN THE CONTEXT OF ALL OTHER LINKS TO THIS SITE, MIGHT SEEM SPAM-LIKE?
- 68. USEFUL INTERFLORA CNN.COM MANIPULATIVE TRUSTWORTHY GODX.NET DAILY SQUEE NOPE
- 69. LINKS FROM EDU SITES 45
- 70. LINKS FROM EDU SITES 45
- 72. 2: DECLINING SPAM TOLERANCE
- 73. Percent spam links 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%
- 74. THIS WAS SPAM IN APRIL
- 75. THIS MAY BE SPAM NOW http://www.cs.hiram.edu/ ~oliphantlt/cpsc171/links.html
- 77. CLEAN UP. NOW.
- 79. NEED A BIGGER TRAINING SET TOO BIG.
- 80. USE WORDS, TOO
- 82. ian wtf!!!!
- 83. MACHINE LEARNING IS GROWING
- 84. MACHINE LEARNING IS BECOMING EASIER
- 85. GOOGLE PREDICTION API BIGML EXCEL DATASCOPE ….?
- 86. How hard can it be? EASY TO UNDERSTAND
- 87. How hard can it be? SO UNDERSTAND IT
- 88. http://portent.co/machine-spam yes, this is right, no ‘m’
- 89. THE END. Ian Lurie Portent, Inc @portentint