How to get ALL your pages indexed by search engines

Administrator · May 17th 2004, 02:13 PM

Many websites have a similar problems in the following areas,

1) Getting their websites indexed by the search engines
2) Getting all their pages indexed by the search engines

The first issue is fairly easy to resolve. In my experience it is much faster to get indexed by search engines if you have your link placed on a good quality website. Good quality websites are usually full of search engine robots and spiders and will follow any links on the site. This works well if you have your link placed no more than 2 levels down from the homepage , even better if you get your link placed on the homepage itself. Building a good link exchange with several large websites will keep your site in the search engines without fear of it being dropped.

The second issue is that most spiders or robots only index 2 - 3 levels down from the homepage. So many sites just don't get all their links indexed. By using a sitemap you can get round this problem. Even some big search engines have used a sitemap to make sure all their pages are indexed. I use a sitemap on this website ( bottom right corner ). Every page of my site is only 2 levels down from the homepage. All my pages are indexed as a result. My traffic almost doubled after adding the sitemap. It is best to keep a sitemap as html links only, this way it is easy for search engine spiders to scan. I use a program called "eXact Mapper Lite" which will scan your website folder and place all your links in the sitemap. This only works for html pages , personally i don't know of any scripts that would index php, asp, cgi pages.. but i am sure they would not be hard to write.

Ok.. well, hope you enjoyed reading this article.

indeks · February 24th 2005, 01:25 PM

Thanks a lot, very good read.

kradlin · February 26th 2005, 10:07 AM

As to point 2, I think it's not only about the depth of the crawl. I've seen sites with pages just 1 click from the index - index was crawled and the subpages not. It's not that easy, in my opinion.

taylorutah · July 11th 2005, 10:47 AM

You obviously know a great deal about getting in the Search Engines. I recently got my site spidered by Google and MSN (Yahoo), but only my home page comes up under the search results. Are they still indexing the remainder of my site or do i need to do more to get the other pages indexed? I am trying to get more links pointing to my site. Here is the site, any help would be appreciated.

Executive Angler: Fly Fishing Trips

Taylor