SlideShare une entreprise Scribd logo
1  sur  4
Télécharger pour lire hors ligne
Page 1
POINT OF
VIEW
Among the top tactics to improve your brand website’s organic rankings sits Googlebot optimization, a
way to play well with Google’s web crawler in order to improve your drug or disease-state website’s
results. This POV defines the role of Googlebot in SEO and offers a checklist of how to improve your
results. (Don’t worry, Googlebot is not a bad bot and doesn’t count as non-human traffic. Googlebot
is a good bot that you want crawling your site.)
Many folks know about search engine optimization, which is essential for a website to rank well in
search engines. But chances are, you may not have heard of Googlebot optimization, which focuses
on how Google’s crawlers access your site. Technical SEO is a very important and often overlooked
piece of the SEO process. In order for a site to rank well, all the technical aspects need to be working
correctly so Google is receiving the best possible signals from your website.
Optimizing for Googlebot is an essential step in the technical SEO process and a must if you want to
rank well in today’s search landscape.
To get organic traffic, a website must be in Google's index. And a site cannot get into the index if it
cannot be crawled. Thus a site’s crawlability is the crucial first step to ensuring its searchability within
the index.
What is Googlebot?
Googlebot is Google’s search bot, also known as
a spider or crawler, which crawls the web and
creates an index. Googlebot will crawl every
page it’s allowed access to, and adds that page
to the index where it can be returned by a user’s
search query.
Understanding how Google crawls your site is
crucial to understanding Googlebot optimization.
Here are the basics:
1. Googlebot spends more time crawling sites
with higher PageRank
The Beginner’s Guide to
Googlebot Optimization
Executive Summary
“ Don’t worry –
Googlebot is not a
bad bot.”
Background
PageRank (PR) is a quality metric invented by
Google's owners Larry Page and Sergey Brin.
PageRank is a 0 to 10 scale that assigns a
number to a web page based on that page's
importance, reliability and authority on the web
according to Google.
Page 2
To put PageRank into perspective, Google.com
is a 9, most consumer brand pages are around
3, most pharma company brand pages are 2 or
3, and health related websites like WebMD or
Healthline are 7s. The breadth of content, the
amount of inbound links and website history
are all factors that go into PageRank. The
amount of time that Googlebot gives to your
site during the crawling process is called “crawl
budget”. The greater a page’s authority or
PageRank, the more crawl budget it receives.
2. Googlebot is always crawling your site
Fresh, consistent content always gains
Googlebot's attention and improves the
likelihood of ranking better. New backlinks and
social mentions will do the same. It’s important
to note that Googlebot does not crawl every
page on your site all the time.
3. Googlebot first accesses a site’s robots.txt
file to find out the site’s crawling rules
Your robots.txt file tells Googlebot where it
cannot go. Pages with sensitive user
information and checkout pages are common in
a robots file. Any pages that you would not
want in the index would get added to your
robots file. Pages that are within the robots file
will not be crawled or indexed by Googlebot.
4. Googlebot uses the sitemap.xml to discover
any and all areas of the site to be crawled and
indexed
On the flip side, Googlebot uses your XML
sitemap to find a list of pages that you do want
indexed. Due to the many ways in how sites are
structured, the crawler might not get to every
page or section. In this case, Googlebot will
refer to your sitemap to ensure it gets to all
pages and crawls them.
5 Steps for Googlebot
Optimization
Googlebot optimization comes a step before
SEO when it comes to optimizing a website.
Below are five steps you should take to ensure
your site is ready for Googlebot to crawl.
1. Don’t use fancy coding languages
Googlebot doesn’t crawl JavaScript, iframes,
DHTML, Flash, and Ajax content as well as
HTML. Stick to the basics (HTML).
2. Enhance your robots.txt file
Your robots.txt file is essential because it
serves as a guide for Googlebot. Googlebot will
spend its crawl budget on any pages on your
site. You need to tell Googlebot where it
should and shouldn’t spend that budget. So if
there are any pages or sections of your site
that you do not want indexed, be sure to add
them to your robots.txt file. The less time
Googlebot spends on unnecessary pages of
your site, the more it can crawl more important
pages of your site.
“Googlebot
optimization
comes a step
before SEO when
optimizing a
website.”
Page 3
3. Create fresh content
Content that is crawled more often is likely to
gain more traffic. While PageRank is the main
factor in crawl frequency, studies show it’s likely
that PageRank becomes less important when
compared with fresh content.
Another important piece of Googlebot
optimization is to get your low ranked pages
crawled as often as possible. One way to do this
is to update these articles often as new
information or data becomes available.
4. Use internal linking
Internal linking is, in essence, a map for
Googlebot to follow as it crawls your site. The
bot will follow your internal links until it hits a
dead end, at which point it will refer to your
sitemap. The more tight-knit your internal
linking structure, the better Googlebot will
crawl your site.
5. Create an XML sitemap
Your sitemap is one of the clearest messages to
the Googlebot about how to access your site. A
sitemap does exactly what the name suggests
— serves as a map to your site for the
Googlebot to follow.
Sitemaps ensure that all the areas of your site
that you want indexed will get crawled.
Analyzing Googlebot’s
performance on your site
The best part about Googlebot optimization is
that you don’t have to guess to see how your
site is performing with the crawler. By
implementing Google Search Console (formerly
Webmaster Tools), we can see exactly how
Googlebot is indexing the site.
The above screenshot is the dashboard you’ll
see upon logging in. It provides a high-level view
of the technical pieces, including any crawl
errors, organic search impressions, as well as
indexed URLs.
“Content that is crawled
more often is likely to gain
more traffic. ”
Page 4
Brian Cox
SEO Supervisor
CMI Media LLC
Analysts:
Search Console also allows us to see potential errors and warnings that we should address. In this
screenshot, we are in the XML sitemaps section and can see when Google last processed the sitemap
and how many URLs are indexed.
Conclusion
If you want to improve your site’s performance and organic visibility, Googlebot optimization is a great
place to start.
By considering how Googlebot crawls a site during the early stages of development, you ensure that all
of the great content and design work produced for the site is able to be indexed and ranked in results.
To be indexed and returned in search engine results, a site must get crawled - so give the crawlers the
directions and map they need to efficiently crawl and index your website.

Contenu connexe

Tendances

Demystifying JavaScript & SEO
Demystifying JavaScript & SEODemystifying JavaScript & SEO
Demystifying JavaScript & SEOBotify
 
Google WebMaster Tool
Google WebMaster ToolGoogle WebMaster Tool
Google WebMaster ToolAli Ahmed
 
Top 5 Ways to Analyze Your Website: Google Search Console
Top 5 Ways to Analyze Your Website: Google Search ConsoleTop 5 Ways to Analyze Your Website: Google Search Console
Top 5 Ways to Analyze Your Website: Google Search ConsoleElementive
 
Google Search Console: An Ultimate Guide
Google Search Console: An Ultimate GuideGoogle Search Console: An Ultimate Guide
Google Search Console: An Ultimate GuideTyler Horvath
 
How Does Google Crawl the Web?
How Does Google Crawl the Web?How Does Google Crawl the Web?
How Does Google Crawl the Web?Botify
 
SEO Audit Workshop : Frameworks , Techniques and Tools
SEO Audit Workshop : Frameworks , Techniques and Tools SEO Audit Workshop : Frameworks , Techniques and Tools
SEO Audit Workshop : Frameworks , Techniques and Tools NEW MEDIA GURU
 
SEO Best Practices: Top 10 SEO Tools for 2016
SEO Best Practices: Top 10 SEO Tools for 2016SEO Best Practices: Top 10 SEO Tools for 2016
SEO Best Practices: Top 10 SEO Tools for 2016Steve Weber
 
Using Google Analytics and Google Webmaster Tools to improve your site
Using Google Analytics and Google Webmaster Tools to improve your siteUsing Google Analytics and Google Webmaster Tools to improve your site
Using Google Analytics and Google Webmaster Tools to improve your siteMickey Mellen
 
Google Webmaster Tool Guide
Google Webmaster Tool GuideGoogle Webmaster Tool Guide
Google Webmaster Tool Guideitsyousuf
 
SEO 101 - Google Search Console Explained
SEO 101 - Google Search Console Explained SEO 101 - Google Search Console Explained
SEO 101 - Google Search Console Explained Steve Weber
 
Google Search Console - Search Traffic
Google Search Console - Search TrafficGoogle Search Console - Search Traffic
Google Search Console - Search TrafficAkshay Gije
 
Google Webmaster Tools
Google Webmaster ToolsGoogle Webmaster Tools
Google Webmaster ToolsJade Webster
 
Google Analytics New Features - Webinar - 20091030
Google Analytics New Features - Webinar - 20091030Google Analytics New Features - Webinar - 20091030
Google Analytics New Features - Webinar - 20091030Vinoaj Vijeyakumaar
 
Guide to Google Webmaster Tools
Guide to Google Webmaster ToolsGuide to Google Webmaster Tools
Guide to Google Webmaster ToolsSupernova Media
 
The Technical SEO Renaissance
The Technical SEO RenaissanceThe Technical SEO Renaissance
The Technical SEO RenaissanceMichael King
 
Guide for google webmaster tools
Guide for google webmaster toolsGuide for google webmaster tools
Guide for google webmaster toolsPreetha
 
How Marketers Can Work With Code
How Marketers Can Work With CodeHow Marketers Can Work With Code
How Marketers Can Work With CodeKaizen
 
Website Pre SEO Analysis Report- Online Marketing: Search Engine Optimization
Website Pre SEO Analysis Report- Online Marketing: Search Engine OptimizationWebsite Pre SEO Analysis Report- Online Marketing: Search Engine Optimization
Website Pre SEO Analysis Report- Online Marketing: Search Engine OptimizationVikesh Sanwalodia
 

Tendances (20)

Technical SEO Audit
Technical SEO AuditTechnical SEO Audit
Technical SEO Audit
 
Demystifying JavaScript & SEO
Demystifying JavaScript & SEODemystifying JavaScript & SEO
Demystifying JavaScript & SEO
 
Google WebMaster Tool
Google WebMaster ToolGoogle WebMaster Tool
Google WebMaster Tool
 
Top 5 Ways to Analyze Your Website: Google Search Console
Top 5 Ways to Analyze Your Website: Google Search ConsoleTop 5 Ways to Analyze Your Website: Google Search Console
Top 5 Ways to Analyze Your Website: Google Search Console
 
Google Search Console: An Ultimate Guide
Google Search Console: An Ultimate GuideGoogle Search Console: An Ultimate Guide
Google Search Console: An Ultimate Guide
 
How Does Google Crawl the Web?
How Does Google Crawl the Web?How Does Google Crawl the Web?
How Does Google Crawl the Web?
 
SEO Audit Workshop : Frameworks , Techniques and Tools
SEO Audit Workshop : Frameworks , Techniques and Tools SEO Audit Workshop : Frameworks , Techniques and Tools
SEO Audit Workshop : Frameworks , Techniques and Tools
 
SEO Best Practices: Top 10 SEO Tools for 2016
SEO Best Practices: Top 10 SEO Tools for 2016SEO Best Practices: Top 10 SEO Tools for 2016
SEO Best Practices: Top 10 SEO Tools for 2016
 
Using Google Analytics and Google Webmaster Tools to improve your site
Using Google Analytics and Google Webmaster Tools to improve your siteUsing Google Analytics and Google Webmaster Tools to improve your site
Using Google Analytics and Google Webmaster Tools to improve your site
 
Google Webmaster Tool Guide
Google Webmaster Tool GuideGoogle Webmaster Tool Guide
Google Webmaster Tool Guide
 
SEO 101 - Google Search Console Explained
SEO 101 - Google Search Console Explained SEO 101 - Google Search Console Explained
SEO 101 - Google Search Console Explained
 
Google Search Console - Search Traffic
Google Search Console - Search TrafficGoogle Search Console - Search Traffic
Google Search Console - Search Traffic
 
Google Webmaster Tools
Google Webmaster ToolsGoogle Webmaster Tools
Google Webmaster Tools
 
SEO Sample Report
SEO Sample ReportSEO Sample Report
SEO Sample Report
 
Google Analytics New Features - Webinar - 20091030
Google Analytics New Features - Webinar - 20091030Google Analytics New Features - Webinar - 20091030
Google Analytics New Features - Webinar - 20091030
 
Guide to Google Webmaster Tools
Guide to Google Webmaster ToolsGuide to Google Webmaster Tools
Guide to Google Webmaster Tools
 
The Technical SEO Renaissance
The Technical SEO RenaissanceThe Technical SEO Renaissance
The Technical SEO Renaissance
 
Guide for google webmaster tools
Guide for google webmaster toolsGuide for google webmaster tools
Guide for google webmaster tools
 
How Marketers Can Work With Code
How Marketers Can Work With CodeHow Marketers Can Work With Code
How Marketers Can Work With Code
 
Website Pre SEO Analysis Report- Online Marketing: Search Engine Optimization
Website Pre SEO Analysis Report- Online Marketing: Search Engine OptimizationWebsite Pre SEO Analysis Report- Online Marketing: Search Engine Optimization
Website Pre SEO Analysis Report- Online Marketing: Search Engine Optimization
 

Similaire à The Beginner's Guide to Googlebot Optimization

Search Engine Optimization
Search Engine OptimizationSearch Engine Optimization
Search Engine Optimizationshrishail uttagi
 
The step by step guide to SEO Website Audit
The step by step guide to SEO Website Audit The step by step guide to SEO Website Audit
The step by step guide to SEO Website Audit amandacerry
 
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)Technical SEO: How to Perform an SEO Audit (Step by Step Guide)
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)Ryan Stewart
 
How to Run an SEO Audit by yourself at home.pdf
How to Run an SEO Audit by yourself at home.pdfHow to Run an SEO Audit by yourself at home.pdf
How to Run an SEO Audit by yourself at home.pdfrrd87j8bkv
 
How to perform a technical SEO audit and ramp up your content strategy in 10 ...
How to perform a technical SEO audit and ramp up your content strategy in 10 ...How to perform a technical SEO audit and ramp up your content strategy in 10 ...
How to perform a technical SEO audit and ramp up your content strategy in 10 ...Waqar Ahmad
 
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016Mark Thomas
 
Search engine optimization (seo)
Search engine optimization (seo)Search engine optimization (seo)
Search engine optimization (seo)jhon smith
 
Search Engine Optimization (Seo)
Search Engine Optimization (Seo)Search Engine Optimization (Seo)
Search Engine Optimization (Seo)ssunnysengar
 
Search Engine, SEO and Google Algorithms
Search Engine, SEO and Google AlgorithmsSearch Engine, SEO and Google Algorithms
Search Engine, SEO and Google Algorithmsjhenrey1992
 
The Best Guide to SEO
The Best Guide to SEOThe Best Guide to SEO
The Best Guide to SEOSumeet Chadha
 
Crawl optimization - ( How to optimize to increase crawl budget)
Crawl optimization - ( How to optimize to increase crawl budget)Crawl optimization - ( How to optimize to increase crawl budget)
Crawl optimization - ( How to optimize to increase crawl budget)SyedFaraz41
 
Google webmaster tools
Google webmaster toolsGoogle webmaster tools
Google webmaster toolsianolsonsb
 
SEO PPT Your Way To Success
SEO PPT Your Way To SuccessSEO PPT Your Way To Success
SEO PPT Your Way To SuccessMitulBrahmaniya
 
Search engine optimisation
Search engine optimisationSearch engine optimisation
Search engine optimisationrobclarkson
 

Similaire à The Beginner's Guide to Googlebot Optimization (20)

Search Engine Optimization
Search Engine OptimizationSearch Engine Optimization
Search Engine Optimization
 
Webmaster tools (ICMK485)
Webmaster tools (ICMK485)Webmaster tools (ICMK485)
Webmaster tools (ICMK485)
 
The step by step guide to SEO Website Audit
The step by step guide to SEO Website Audit The step by step guide to SEO Website Audit
The step by step guide to SEO Website Audit
 
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)Technical SEO: How to Perform an SEO Audit (Step by Step Guide)
Technical SEO: How to Perform an SEO Audit (Step by Step Guide)
 
How to Run an SEO Audit by yourself at home.pdf
How to Run an SEO Audit by yourself at home.pdfHow to Run an SEO Audit by yourself at home.pdf
How to Run an SEO Audit by yourself at home.pdf
 
How to perform a technical SEO audit and ramp up your content strategy in 10 ...
How to perform a technical SEO audit and ramp up your content strategy in 10 ...How to perform a technical SEO audit and ramp up your content strategy in 10 ...
How to perform a technical SEO audit and ramp up your content strategy in 10 ...
 
Google ranking related to seo
Google ranking related to seoGoogle ranking related to seo
Google ranking related to seo
 
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
 
Search engine optimization (seo)
Search engine optimization (seo)Search engine optimization (seo)
Search engine optimization (seo)
 
Search Engine Optimization (Seo)
Search Engine Optimization (Seo)Search Engine Optimization (Seo)
Search Engine Optimization (Seo)
 
Search Engine, SEO and Google Algorithms
Search Engine, SEO and Google AlgorithmsSearch Engine, SEO and Google Algorithms
Search Engine, SEO and Google Algorithms
 
The Best Guide to SEO
The Best Guide to SEOThe Best Guide to SEO
The Best Guide to SEO
 
Webmaster Tools Preview And Understandings
Webmaster Tools Preview And UnderstandingsWebmaster Tools Preview And Understandings
Webmaster Tools Preview And Understandings
 
Crawl optimization - ( How to optimize to increase crawl budget)
Crawl optimization - ( How to optimize to increase crawl budget)Crawl optimization - ( How to optimize to increase crawl budget)
Crawl optimization - ( How to optimize to increase crawl budget)
 
Introduction To SEO (2).pdf
Introduction To SEO (2).pdfIntroduction To SEO (2).pdf
Introduction To SEO (2).pdf
 
Google webmaster tools
Google webmaster toolsGoogle webmaster tools
Google webmaster tools
 
SEO PPT Your Way To Success
SEO PPT Your Way To SuccessSEO PPT Your Way To Success
SEO PPT Your Way To Success
 
Search engine optimisation
Search engine optimisationSearch engine optimisation
Search engine optimisation
 
Seo.pptx new ppt
Seo.pptx new pptSeo.pptx new ppt
Seo.pptx new ppt
 
Google Search Console
Google Search ConsoleGoogle Search Console
Google Search Console
 

Plus de CMI_Compas

New Native Advertising Guidelines and What Steps You Need to Take
New Native Advertising Guidelines and What Steps You Need to TakeNew Native Advertising Guidelines and What Steps You Need to Take
New Native Advertising Guidelines and What Steps You Need to TakeCMI_Compas
 
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and Readiness
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and ReadinessAd Blocking Goes Mobile with iOS9- Implications for Pharma and Readiness
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and ReadinessCMI_Compas
 
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...CMI_Compas
 
CMI/Compas Endocrine Today Focus on Diabetes
CMI/Compas Endocrine Today Focus on Diabetes CMI/Compas Endocrine Today Focus on Diabetes
CMI/Compas Endocrine Today Focus on Diabetes CMI_Compas
 
Pharma Hotlist- Wearables
Pharma Hotlist- Wearables Pharma Hotlist- Wearables
Pharma Hotlist- Wearables CMI_Compas
 
Connecting the Dots of Point of Care Engagement Opportunities Infographic
Connecting the Dots of Point of Care Engagement Opportunities InfographicConnecting the Dots of Point of Care Engagement Opportunities Infographic
Connecting the Dots of Point of Care Engagement Opportunities InfographicCMI_Compas
 
Digital Perspectives Research Findings of Healthcare Professionals
Digital Perspectives Research Findings of Healthcare ProfessionalsDigital Perspectives Research Findings of Healthcare Professionals
Digital Perspectives Research Findings of Healthcare ProfessionalsCMI_Compas
 
Doctors’ Views of Direct-to-Consumer Drug Advertising
Doctors’ Views of Direct-to-Consumer Drug AdvertisingDoctors’ Views of Direct-to-Consumer Drug Advertising
Doctors’ Views of Direct-to-Consumer Drug AdvertisingCMI_Compas
 

Plus de CMI_Compas (8)

New Native Advertising Guidelines and What Steps You Need to Take
New Native Advertising Guidelines and What Steps You Need to TakeNew Native Advertising Guidelines and What Steps You Need to Take
New Native Advertising Guidelines and What Steps You Need to Take
 
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and Readiness
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and ReadinessAd Blocking Goes Mobile with iOS9- Implications for Pharma and Readiness
Ad Blocking Goes Mobile with iOS9- Implications for Pharma and Readiness
 
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...
Potential of One Click Rule to Change Pharma Marketing: How a Bill in Congres...
 
CMI/Compas Endocrine Today Focus on Diabetes
CMI/Compas Endocrine Today Focus on Diabetes CMI/Compas Endocrine Today Focus on Diabetes
CMI/Compas Endocrine Today Focus on Diabetes
 
Pharma Hotlist- Wearables
Pharma Hotlist- Wearables Pharma Hotlist- Wearables
Pharma Hotlist- Wearables
 
Connecting the Dots of Point of Care Engagement Opportunities Infographic
Connecting the Dots of Point of Care Engagement Opportunities InfographicConnecting the Dots of Point of Care Engagement Opportunities Infographic
Connecting the Dots of Point of Care Engagement Opportunities Infographic
 
Digital Perspectives Research Findings of Healthcare Professionals
Digital Perspectives Research Findings of Healthcare ProfessionalsDigital Perspectives Research Findings of Healthcare Professionals
Digital Perspectives Research Findings of Healthcare Professionals
 
Doctors’ Views of Direct-to-Consumer Drug Advertising
Doctors’ Views of Direct-to-Consumer Drug AdvertisingDoctors’ Views of Direct-to-Consumer Drug Advertising
Doctors’ Views of Direct-to-Consumer Drug Advertising
 

Dernier

Introduction to ICANN and Fellowship program by Shreedeep Rayamajhi.pdf
Introduction to ICANN and Fellowship program  by Shreedeep Rayamajhi.pdfIntroduction to ICANN and Fellowship program  by Shreedeep Rayamajhi.pdf
Introduction to ICANN and Fellowship program by Shreedeep Rayamajhi.pdfShreedeep Rayamajhi
 
Computer 10 Lesson 8: Building a Website
Computer 10 Lesson 8: Building a WebsiteComputer 10 Lesson 8: Building a Website
Computer 10 Lesson 8: Building a WebsiteMavein
 
Presentation2.pptx - JoyPress Wordpress
Presentation2.pptx -  JoyPress WordpressPresentation2.pptx -  JoyPress Wordpress
Presentation2.pptx - JoyPress Wordpressssuser166378
 
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdf
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdfLESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdf
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdfmchristianalwyn
 
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced Horizons
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced HorizonsVision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced Horizons
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced HorizonsRoxana Stingu
 
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024Jan Löffler
 
Check out the Free Landing Page Hosting in 2024
Check out the Free Landing Page Hosting in 2024Check out the Free Landing Page Hosting in 2024
Check out the Free Landing Page Hosting in 2024Shubham Pant
 
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...Benefits of doing Internet peering and running an Internet Exchange (IX) pres...
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...APNIC
 
Zero-day Vulnerabilities
Zero-day VulnerabilitiesZero-day Vulnerabilities
Zero-day Vulnerabilitiesalihassaah1994
 
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDS
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDSTYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDS
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDSedrianrheine
 
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASS
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASSLESSON 10/ GROUP 10/ ST. THOMAS AQUINASS
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASSlesteraporado16
 
Bio Medical Waste Management Guideliness 2023 ppt.pptx
Bio Medical Waste Management Guideliness 2023 ppt.pptxBio Medical Waste Management Guideliness 2023 ppt.pptx
Bio Medical Waste Management Guideliness 2023 ppt.pptxnaveenithkrishnan
 

Dernier (12)

Introduction to ICANN and Fellowship program by Shreedeep Rayamajhi.pdf
Introduction to ICANN and Fellowship program  by Shreedeep Rayamajhi.pdfIntroduction to ICANN and Fellowship program  by Shreedeep Rayamajhi.pdf
Introduction to ICANN and Fellowship program by Shreedeep Rayamajhi.pdf
 
Computer 10 Lesson 8: Building a Website
Computer 10 Lesson 8: Building a WebsiteComputer 10 Lesson 8: Building a Website
Computer 10 Lesson 8: Building a Website
 
Presentation2.pptx - JoyPress Wordpress
Presentation2.pptx -  JoyPress WordpressPresentation2.pptx -  JoyPress Wordpress
Presentation2.pptx - JoyPress Wordpress
 
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdf
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdfLESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdf
LESSON 5 GROUP 10 ST. THOMAS AQUINAS.pdf
 
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced Horizons
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced HorizonsVision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced Horizons
Vision Forward: Tracing Image Search SEO From Its Roots To AI-Enhanced Horizons
 
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024
WordPress by the numbers - Jan Loeffler, CTO WebPros, CloudFest 2024
 
Check out the Free Landing Page Hosting in 2024
Check out the Free Landing Page Hosting in 2024Check out the Free Landing Page Hosting in 2024
Check out the Free Landing Page Hosting in 2024
 
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...Benefits of doing Internet peering and running an Internet Exchange (IX) pres...
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...
 
Zero-day Vulnerabilities
Zero-day VulnerabilitiesZero-day Vulnerabilities
Zero-day Vulnerabilities
 
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDS
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDSTYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDS
TYPES AND DEFINITION OF ONLINE CRIMES AND HAZARDS
 
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASS
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASSLESSON 10/ GROUP 10/ ST. THOMAS AQUINASS
LESSON 10/ GROUP 10/ ST. THOMAS AQUINASS
 
Bio Medical Waste Management Guideliness 2023 ppt.pptx
Bio Medical Waste Management Guideliness 2023 ppt.pptxBio Medical Waste Management Guideliness 2023 ppt.pptx
Bio Medical Waste Management Guideliness 2023 ppt.pptx
 

The Beginner's Guide to Googlebot Optimization

  • 1. Page 1 POINT OF VIEW Among the top tactics to improve your brand website’s organic rankings sits Googlebot optimization, a way to play well with Google’s web crawler in order to improve your drug or disease-state website’s results. This POV defines the role of Googlebot in SEO and offers a checklist of how to improve your results. (Don’t worry, Googlebot is not a bad bot and doesn’t count as non-human traffic. Googlebot is a good bot that you want crawling your site.) Many folks know about search engine optimization, which is essential for a website to rank well in search engines. But chances are, you may not have heard of Googlebot optimization, which focuses on how Google’s crawlers access your site. Technical SEO is a very important and often overlooked piece of the SEO process. In order for a site to rank well, all the technical aspects need to be working correctly so Google is receiving the best possible signals from your website. Optimizing for Googlebot is an essential step in the technical SEO process and a must if you want to rank well in today’s search landscape. To get organic traffic, a website must be in Google's index. And a site cannot get into the index if it cannot be crawled. Thus a site’s crawlability is the crucial first step to ensuring its searchability within the index. What is Googlebot? Googlebot is Google’s search bot, also known as a spider or crawler, which crawls the web and creates an index. Googlebot will crawl every page it’s allowed access to, and adds that page to the index where it can be returned by a user’s search query. Understanding how Google crawls your site is crucial to understanding Googlebot optimization. Here are the basics: 1. Googlebot spends more time crawling sites with higher PageRank The Beginner’s Guide to Googlebot Optimization Executive Summary “ Don’t worry – Googlebot is not a bad bot.” Background PageRank (PR) is a quality metric invented by Google's owners Larry Page and Sergey Brin. PageRank is a 0 to 10 scale that assigns a number to a web page based on that page's importance, reliability and authority on the web according to Google.
  • 2. Page 2 To put PageRank into perspective, Google.com is a 9, most consumer brand pages are around 3, most pharma company brand pages are 2 or 3, and health related websites like WebMD or Healthline are 7s. The breadth of content, the amount of inbound links and website history are all factors that go into PageRank. The amount of time that Googlebot gives to your site during the crawling process is called “crawl budget”. The greater a page’s authority or PageRank, the more crawl budget it receives. 2. Googlebot is always crawling your site Fresh, consistent content always gains Googlebot's attention and improves the likelihood of ranking better. New backlinks and social mentions will do the same. It’s important to note that Googlebot does not crawl every page on your site all the time. 3. Googlebot first accesses a site’s robots.txt file to find out the site’s crawling rules Your robots.txt file tells Googlebot where it cannot go. Pages with sensitive user information and checkout pages are common in a robots file. Any pages that you would not want in the index would get added to your robots file. Pages that are within the robots file will not be crawled or indexed by Googlebot. 4. Googlebot uses the sitemap.xml to discover any and all areas of the site to be crawled and indexed On the flip side, Googlebot uses your XML sitemap to find a list of pages that you do want indexed. Due to the many ways in how sites are structured, the crawler might not get to every page or section. In this case, Googlebot will refer to your sitemap to ensure it gets to all pages and crawls them. 5 Steps for Googlebot Optimization Googlebot optimization comes a step before SEO when it comes to optimizing a website. Below are five steps you should take to ensure your site is ready for Googlebot to crawl. 1. Don’t use fancy coding languages Googlebot doesn’t crawl JavaScript, iframes, DHTML, Flash, and Ajax content as well as HTML. Stick to the basics (HTML). 2. Enhance your robots.txt file Your robots.txt file is essential because it serves as a guide for Googlebot. Googlebot will spend its crawl budget on any pages on your site. You need to tell Googlebot where it should and shouldn’t spend that budget. So if there are any pages or sections of your site that you do not want indexed, be sure to add them to your robots.txt file. The less time Googlebot spends on unnecessary pages of your site, the more it can crawl more important pages of your site. “Googlebot optimization comes a step before SEO when optimizing a website.”
  • 3. Page 3 3. Create fresh content Content that is crawled more often is likely to gain more traffic. While PageRank is the main factor in crawl frequency, studies show it’s likely that PageRank becomes less important when compared with fresh content. Another important piece of Googlebot optimization is to get your low ranked pages crawled as often as possible. One way to do this is to update these articles often as new information or data becomes available. 4. Use internal linking Internal linking is, in essence, a map for Googlebot to follow as it crawls your site. The bot will follow your internal links until it hits a dead end, at which point it will refer to your sitemap. The more tight-knit your internal linking structure, the better Googlebot will crawl your site. 5. Create an XML sitemap Your sitemap is one of the clearest messages to the Googlebot about how to access your site. A sitemap does exactly what the name suggests — serves as a map to your site for the Googlebot to follow. Sitemaps ensure that all the areas of your site that you want indexed will get crawled. Analyzing Googlebot’s performance on your site The best part about Googlebot optimization is that you don’t have to guess to see how your site is performing with the crawler. By implementing Google Search Console (formerly Webmaster Tools), we can see exactly how Googlebot is indexing the site. The above screenshot is the dashboard you’ll see upon logging in. It provides a high-level view of the technical pieces, including any crawl errors, organic search impressions, as well as indexed URLs. “Content that is crawled more often is likely to gain more traffic. ”
  • 4. Page 4 Brian Cox SEO Supervisor CMI Media LLC Analysts: Search Console also allows us to see potential errors and warnings that we should address. In this screenshot, we are in the XML sitemaps section and can see when Google last processed the sitemap and how many URLs are indexed. Conclusion If you want to improve your site’s performance and organic visibility, Googlebot optimization is a great place to start. By considering how Googlebot crawls a site during the early stages of development, you ensure that all of the great content and design work produced for the site is able to be indexed and ranked in results. To be indexed and returned in search engine results, a site must get crawled - so give the crawlers the directions and map they need to efficiently crawl and index your website.