SEO Consult Blog
How The Googlebot Works In Relation To Your SEO Campaign
Filed under: Google and Search Engine Optimisation by Nick on November 5th, 2008 @ 10:57 am
Search engine optimization is about making your website as ’search engine friendly’ as possible, thus achieving a high page rank when people do searches. There are so many pages on the web that you cannot rely on your website being found with a hit and miss strategy. Even if it is indexed in a search return, there may be thousands of returns - and people are not going to wade through them all. The contest is to get into the top ten, or even the top twenty.
Googlebot
Googlebot is the web crawler used by Google. It crawls the web searching for pages, and then passes them on to the Indexer, which sorts every word and then stores those pages for future searches. It starts with a list of URLs, then investigates hyperlinks on the page, and adds them to its list of URLs to search.
Two of the main problems for search engines are the huge number of pages on the web, and the fact that fresh information is being produced all the time. For that reason Googlebot has two versions, the Deepbot for deep searches, and the Freshbot, which only looks for fresh content.
Googlebot discovers pages by investigating the links from every page that it searches. For it to find a web page, it needs to be pointed there from a link on an existing page that it visits.
Searchable content
Because of the way the crawler works, it is important to use a number of links to other sites, and to other pages on your site, to point the crawlers to your page. It is particularly useful to have links to sites that achieve a high page ranking. Reciprocal site links are understood to be less effective than One Way Links; therefore interaction with other sites is advantageous but only if they are of excellent quality to the user.
Meta tags and keywords are important too, so that the indexers can clearly distinguish the pertinent content on your page, in order to sort it for search queries. However, pointless keyword usage to maximise keyword density can have a negative effect, as it looks like spam and your site can be ‘blacklisted’ by the crawler. More important is to have good quality content, with only necessary keywords.
Fresh content on your site is crucial. Once your site has been discovered and is being listed for visits, regular Fresh Content will ensure more regular visits. The more popular the site, and the higher the page ranking, the more regularly the Freshbot will check it.
SPAM and what not to do
If your site is identified as spamming, it will be excluded from further crawls. Keyword density for the sake of it could easily result in your site’s exclusion.
One may have to protect one’s site from other people’s spamming, too. For example, there’s a known practice of people leaving comments on your site purely for the purpose of creating a link back to theirs. If one suspects this practice, one can follow a “no-follow” strategy, whereby you specifically tell the crawler not to visit those links.
Related posts:
- Using Google Webmaster Tools to Assist Search Engine Optimisation
Google Webmaster Tools is a fairly comprehensive collection of data relating to your website and its architecture. There is also some basic information regarding visitors... - SEO from a beginner’s perspective
The first thing to understand about an SEO campaign is like all types of marketing campaigns their are no guarantees & the process is timely... - Using WordPress Plugins and Optimising WordPress To Improve Search Engine Optimisation
WordPress is the most popular and most widely used of all blogging platforms. Not only is it free and relatively simple to complete a basic... - Converting the Information from a Website’s Visitor Tracker to Useful SEO Campaign Information
The goals of converting information The direction a website tracking tool can point you to is that it helps optimize your SEO Campaign by supplying... - Domain names and SEO
How do domain names affect search engine optimisation? We know that domain names can create great brand recognition. In effect, most Web based brands almost...
This entry was posted on Wednesday, November 5th, 2008 at 10:57 am. You can follow any responses to this entry through the RSS feed.
Contact SEO Consult About Search Engine Optimisation
Responses to “How The Googlebot Works In Relation To Your SEO Campaign”
Leave a Reply
Search Blogs
Highest Rated Articles




(5 out of 5)Multiple Domains for SEO?




(5 out of 5)Why One Keyword Won’t Do




(5 out of 5)Site Structure Will Affect Your Website Optimization Campaign




(5 out of 5)SEO - Copywriting Services - Getting Half The Package




(5 out of 5)Tag Cloud
WP Cumulus Flash tag cloud by Roy Tanck requires Flash Player 9 or better.
Recent Posts
Building Authority - How can it be done?
Half-Hearted DIY SEO - Is it worth it?
Which SEO company can I trust?
Search Engine Optimization and the Credit Crunch
Blog Categories
Browser Software and Search Engine Optimisation
CMS and Admin Systems and SEO
eCommerce and Search Engine Optimisation
Ethical Search Engine Optimisation
General SEO News
Geo Targeting Search Engine Optimisation
Google and Search Engine Optimisation
Google PageRank
Google PR Update
Internet Marketing
Keyword Research and Search Engine Optimisation
Latest News
Link Campaigns and Search Engine Optimisation
Pay Per Click & SEO
Press Releases
Search Engine Optimisation
Search Engine Optimisation Advice
Search Engine Optimisation Analysis
Search Engine Optimization
Search Engine Optimization Keywords
Search Engine Optimization Marketing
SEO Analysis for Results
SEO Companies
SEO Consult
SEO Copywriting
SEO Experiment
SEO Management
SEO Strategy
SEO Submissions
SEO Tips
SEO vs PPC
Site Analysis and Search Engine Optimisation
Social Networking and Search Engine Optimization
Top SEO Tips
W3C and Search Engine Optimisation
Website Optimization
Yahoo! and Search Engine Optimisation
View All Categories
Blog Archives
| December 2008 | November 2008 |
| October 2008 | September 2008 |
| August 2008 | July 2008 |
| June 2008 | May 2008 |
| April 2008 | March 2008 |
| February 2008 | January 2008 |
| December 2007 | November 2007 |


(4 votes, average: 4 out of 5)





Hi Nick, I’m running a series of IR tutorials on my blog at the moment, I kicked off with “The search engine index” : http://scienceforseo.blogspot.com/2008/11/search-engine-index-tutorial.html Would you like to stick your article in a PPT presentation with some diagrams and stick it in Slideshare? Then I’ll add it to the series and put it on the blog. Twitter: Missmcj
In the respect of search engine optimization Google bot plays important role in serving the SERP of the site. Google Bot visits the sites if it finds appropriate according to its algorithms gives them ranking.
For Google search engine Google bot is very important agent for visiting the over internet for crawling and reading, it collects those sites which are deputed relevant and appropriate keywords sites theme.