Getting into search engines' listings

6 January 2009 - 2009 Can be your year >>

Check your company information
Check your contact information
Check your auto-responders
Check the links on your website
Check if your web pages are ready for Google

More >>

Internet Marketing Services

Search Engine Optimization

Search Engine Submissions

Link Building / Link Popularity

Google Adwords

Internet Affiliate Marketing

SEO Consulting Services

Content Writing

Top 10 Ranking

Website Designing


	Request a Quote

	Articles

	SEO Tools

	SEO Industry News

	SEO Faqs

	Our Partners

Home > Articles >> Search Engine Optimization Articles

Getting into search engines' listings

New sites do not need to be "submitted" to search engines to be listed. However, Google and Yahoo offer a submission program such as Google Sitemaps that an XML type feed could be created and submitted. Generally however, a simple link from an established site will get the search engines to visit the new site and begin to spider its contents. It can take a few days or even weeks from the acquisition of a link from such an established site for all the main search engine spiders to commence visiting and indexing the new site.

Once the search engine has found the new site, it will generally visit and start to index the pages on the site, as long as all the pages are linked to with anchor tag hyperlinks. Pages which are accessible only through Flash or Javascript links may not be findable by the spiders.

Search engine crawlers may look at a number of different factors when crawling a site, and many pages from a site may not be indexed by the search engines until they gain more pagerank or links or traffic. Distance of pages from the root directory of a site may also be a factor in whether or not pages get crawled, as well as other importance metrics. Cho et al. (Cho et al., 1998) described some standards for those decisons as to which pages are visited and sent by a crawler to be included in a search engine's index.

Webmasters can instruct spiders to not index certain files or directories through the standard robots.txt file in the root directory of the domain. Standard practice requires a search engine to check this file upon visiting the domain, though a search engine crawler will keep a cached copy of this file as it visits the pages of a site, and may not update that copy as quickly as a webmaster does. The web developer can use this feature to prevent pages such as shopping carts or other dynamic, user-specific content from appearing in search engine results, as well as keeping spiders from endless loops and other spider traps.

For those search engines who have their own paid submission (like Yahoo!), it may save some time to pay a nominal fee for submission. Yahoo!'s paid submission program guarantees inclusion in their search results, but does not guarantee specific ranking within the search results.

Internet Marketing Articles

Search Engines History
Webmasters and content providers began optimizing sites for search engines in the mid-1990s More

The relationship between SEO and the search engines
The first mentions of Search Engine More

White hat methods
White hat methods of SEO involve following the. More

Black hat methods
"Black hat" SEO are methods to try to improve rankings More

SEO and Marketing
There is a considerable sized body of practitioners More

SEO Company India | SEO Company | SEO India | Web Design Company | SEO Experts | Online Marketing Services | Link Building Services | Internet Affiliate Marketing | Website Design Company
PPC Bid Management | Google Adwords Services | Content Writing Services | Google Top 10 Ranking | Search Engine Optimization Company | Search Engine Submissions | Online Marketing Firm