Crawl visualisation has evolved dramatically within the last few years, with several new tools launching that enable you to visualise crawl data without knowing how to code Python or R. This talk will let you discover the different tools available for crawl visualisation and how you can employ a visual approach to bring your clients a better understanding of the structure of their websites. Talk presented at BrightonSEO April 2019.

1. SLIDESHARE.NET/ANDERSRIISEKOCH
SIMPLE WAYS TO VISUALISE YOUR
CRAWL DATA WITH NO CODING
KNOWLEDGE REQUIRED
ANDERS RIISE KOCH // DATAWORDS //
@WHATSUPANDERS

2. @WHATSUPANDERS #BRIGHTONSEO
STORIES > STATS

3. @WHATSUPANDERS #BRIGHTONSEO
HOW MANY MEDALS DID THE UK
WIN IN THE 2012 OLYMPICS?

4. @WHATSUPANDERS #BRIGHTONSEO
YOU REMEMBER WHERE YOU
WERE WHEN THIS HAPPENED

5. THAT’S ME!
@WHATSUPANDERS #BRIGHTONSEO

6. YOU KNOW THIS GUY
@WHATSUPANDERS #BRIGHTONSEO

7. @WHATSUPANDERS #BRIGHTONSEO

8. THIS GUY NEEDS THE
FULL PICTURE
@WHATSUPANDERS #BRIGHTONSEO

9. THERE’S A LOT OF
PEOPLE LIKE THIS GUY
@WHATSUPANDERS #BRIGHTONSEO

10. 65% OF PEOPLE ARE
VISUAL LEARNERS
Source: Social Science Research Network

11. VISUALISING YOUR POINT
IS
AN IMPORTANT SKILL
@WHATSUPANDERS #BRIGHTONSEO

12. THERE ARE MANY WAYS
TO PRESENT DATA
@WHATSUPANDERS #BRIGHTONSEO

13. FOR EXAMPLE
@WHATSUPANDERS #BRIGHTONSEO

14. 15% OF YOUR
URLS RETURN A
404 ERROR
@WHATSUPANDERS #BRIGHTONSEO

15. 404, 15%
Response Code
200 404 301
@WHATSUPANDERS #BRIGHTONSEO

16. 0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
200 404 301
Response Code
200 404 301
@WHATSUPANDERS #BRIGHTONSEO

17. @WHATSUPANDERS #BRIGHTONSEO
CONTEXT IS KING

18. SEO ISSUES
=
PAGE TEMPLATE ISSUES
@WHATSUPANDERS #BRIGHTONSEO

19. THERE ARE MANY OTHER
WAYS TO PRESENT CRAWL
STATS
@WHATSUPANDERS #BRIGHTONSEO

20. YOU COULD LEARN
PYTHON OR R
@WHATSUPANDERS #BRIGHTONSEO

21. OR YOU COULD START
TODAY
@WHATSUPANDERS #BRIGHTONSEO

22. IT’S SIMPLER THAN YOU
MIGHT THINK
@WHATSUPANDERS #BRIGHTONSEO

24. LET’S GET
MESSY
@WHATSUPANDERS

25. SEO CRAWL
VISUALISATION TOOLS
@WHATSUPANDERS #BRIGHTONSEO

26. OPTION 1
ADVANCED
@WHATSUPANDERS #BRIGHTONSEO

27. GEPHI
https://gephi.org/

28. WHAT YOU’LL NEED
@WHATSUPANDERS #BRIGHTONSEO

29. A CRAWLER
@WHATSUPANDERS #BRIGHTONSEO

30. EXPORT ALL INLINKS
@WHATSUPANDERS #BRIGHTONSEO

31. TOP PAGES BY
BACKLINKS
@WHATSUPANDERS #BRIGHTONSEO

33. ANY BACKLINK DATABASE
WILL DO
@WHATSUPANDERS #BRIGHTONSEO

34. PC WITH A GPU
@WHATSUPANDERS

35. EXCEL TO COMBINE YOUR
INLINK DATA WITH LINK
METRICS
@WHATSUPANDERS #BRIGHTONSEO

36. 1 2 3
@WHATSUPANDERS

37. IMPORT
CSV
@WHATSUPANDERS #BRIGHTONSEO

38. SELECT EDGES TABLE

39. UPDATE
IMPORT
SETTINGS

41. SELECT A
LAYOUT

42. APPLY A
COLOUR
SCHEME TO
YOUR NODES

43. SET THE SIZE
OF YOUR
NODES FROM
10 TO 30

44. APPLY A DARKER
COLOUR SCHEME TO
YOUR EDGES BASED
ON LINK METRICS

45. START YOUR
VISUALISATION

46. NOW WAIT

47. LAYOUTS FOR CRAWL
VISUALISATION
@WHATSUPANDERS #BRIGHTONSEO

48. FORCE ATLAS 2
@WHATSUPANDERS #BRIGHTONSEO

49. ▪ Content
▪ Comments
▪ Images
@WHATSUPANDERS #BRIGHTONSEO

50. ▪ 200
▪ 3xx
▪ 5xx
@WHATSUPANDERS #BRIGHTONSEO

51. FRUCHTERMAN REINGOLD
@WHATSUPANDERS #BRIGHTONSEO

52. @WHATSUPANDERS #BRIGHTONSEO

53. YIFAN HU
@WHATSUPANDERS #BRIGHTONSEO

54. @WHATSUPANDERS #BRIGHTONSEO

55. EXPORT TO JS WITH
SIGMAEXPORTER
@WHATSUPANDERS #BRIGHTONSEO

56. @WHATSUPANDERS #BRIGHTONSEO

57. PLAY AROUND WITH
YOUR DATA IN-BROWSER
@WHATSUPANDERS #BRIGHTONSEO

58. @WHATSUPANDERS #BRIGHTONSEO

59. PROS: CUSTOMISATION
@WHATSUPANDERS #BRIGHTONSEO

60. CONS:
LOTS OF EFFORT
TIME CONSUMING
LEARNING CURVE
@WHATSUPANDERS #BRIGHTONSEO

61. OPTION 2
SIMPLE
@WHATSUPANDERS #BRIGHTONSEO

62. WHAT YOU’LL NEED
@WHATSUPANDERS #BRIGHTONSEO

63. THE SEO’S OLDEST
FRIEND
@WHATSUPANDERS #BRIGHTONSEO

64. @WHATSUPANDERS #BRIGHTONSEO

65. 65

66. CRAWL SETTINGS
#BRIGHTONSEO

67. STORE HTML
#BRIGHTONSEO

68. TICK THIS
BOX
#BRIGHTONSEO@WHATSUPANDERS

69. RUN YOUR CRAWL AS
NORMAL
#BRIGHTONSEO@WHATSUPANDERS

70. ACCESS THE
VISUALISATION MENU
#BRIGHTONSEO@WHATSUPANDERS

71. CHOOSE YOUR OWN ADVENTURE

72. DEPTH VS DIRECTORY
#BRIGHTONSEO@WHATSUPANDERS

73. CRAWL TREE BY DEPTH
#BRIGHTONSEO@WHATSUPANDERS

74. @WHATSUPANDERS #BRIGHTONSEO

75. CRAWL TREE BY
DIRECTORY
#BRIGHTONSEO@WHATSUPANDERS

76. @WHATSUPANDERS #BRIGHTONSEO

77. FORCE-DIRECTED CRAWL
DIAGRAM
#BRIGHTONSEO@WHATSUPANDERS

78. @WHATSUPANDERS #BRIGHTONSEO

79. THIS WILL BE BASED ON
DEPTH FROM START URL
BY DEFAULT
#BRIGHTONSEO@WHATSUPANDERS

80. @WHATSUPANDERS
VISUALISE THE
POINT YOU WANT
TO HIGHLIGHT
#BRIGHTONSEO

81. STRUCTURED DATA
ERROR COUNT
#BRIGHTONSEO@WHATSUPANDERS

82. @WHATSUPANDERS #BRIGHTONSEO

83. UNIQUE INLINKS
#BRIGHTONSEO@WHATSUPANDERS

84. @WHATSUPANDERS #BRIGHTONSEO

85. WORD COUNT
#BRIGHTONSEO@WHATSUPANDERS

86. @WHATSUPANDERS #BRIGHTONSEO

87. FORCE-DIRECTED
DIRECTORY CRAWL
DIAGRAM
#BRIGHTONSEO@WHATSUPANDERS

88. @WHATSUPANDERS
EXACTLY THE
SAME BUT
BASED ON URL
PATH
#BRIGHTONSEO

89. WORD CLOUDS
#BRIGHTONSEO@WHATSUPANDERS

90. INLINK ANCHOR TEXT
#BRIGHTONSEO@WHATSUPANDERS

91. #BRIGHTONSEO@WHATSUPANDERS

92. BODY TEXT
#BRIGHTONSEO@WHATSUPANDERS

93. #BRIGHTONSEO@WHATSUPANDERS

94. EXPORTING YOUR DATA
#BRIGHTONSEO

95. @WHATSUPANDERS
CHOOSE
HTML OR SVG
#BRIGHTONSEO

96. VISUALISATION IS A TOOL
TO TELL YOUR STORY
#BRIGHTONSEO@WHATSUPANDERS

97. KNOW THE STORY YOU
WANT TO TELL
#BRIGHTONSEO@WHATSUPANDERS

98. IT’S EASY TO GO
OVERBOARD WITH
VISUALISATION
@WHATSUPANDERS #BRIGHTONSEO

99. PEOPLE LIKE THIS
#BRIGHTONSEO@WHATSUPANDERS

100. NOT THIS
#BRIGHTONSEO@WHATSUPANDERS

101. THANK YOU!
H T T P S : / / S L I D E S H A R E . N E T / A N D E R S R I I S E K O C H
@WHATSUPANDERS #BRIGHTONSEO