Web Hosting Forums - View Single Post - How to get ALL your pages indexed by search engines

Many websites have a similar problems in the following areas,

1) Getting their websites indexed by the search engines
2) Getting all their pages indexed by the search engines

The first issue is fairly easy to resolve. In my experience it is much faster to get indexed by search engines if you have your link placed on a good quality website. Good quality websites are usually full of search engine robots and spiders and will follow any links on the site. This works well if you have your link placed no more than 2 levels down from the homepage , even better if you get your link placed on the homepage itself. Building a good link exchange with several large websites will keep your site in the search engines without fear of it being dropped.

The second issue is that most spiders or robots only index 2 - 3 levels down from the homepage. So many sites just don't get all their links indexed. By using a sitemap you can get round this problem. Even some big search engines have used a sitemap to make sure all their pages are indexed. I use a sitemap on this website ( bottom right corner ). Every page of my site is only 2 levels down from the homepage. All my pages are indexed as a result. My traffic almost doubled after adding the sitemap. It is best to keep a sitemap as html links only, this way it is easy for search engine spiders to scan. I use a program called "eXact Mapper Lite" which will scan your website folder and place all your links in the sitemap. This only works for html pages , personally i don't know of any scripts that would index php, asp, cgi pages.. but i am sure they would not be hard to write.

Ok.. well, hope you enjoyed reading this article.

May 17th 2004, 03:13 PM	#1
Administrator The Boss Join Date: Jan 2003 Location: London Posts: 347	How to get ALL your pages indexed by search engines Many websites have a similar problems in the following areas, 1) Getting their websites indexed by the search engines 2) Getting all their pages indexed by the search engines The first issue is fairly easy to resolve. In my experience it is much faster to get indexed by search engines if you have your link placed on a good quality website. Good quality websites are usually full of search engine robots and spiders and will follow any links on the site. This works well if you have your link placed no more than 2 levels down from the homepage , even better if you get your link placed on the homepage itself. Building a good link exchange with several large websites will keep your site in the search engines without fear of it being dropped. The second issue is that most spiders or robots only index 2 - 3 levels down from the homepage. So many sites just don't get all their links indexed. By using a sitemap you can get round this problem. Even some big search engines have used a sitemap to make sure all their pages are indexed. I use a sitemap on this website ( bottom right corner ). Every page of my site is only 2 levels down from the homepage. All my pages are indexed as a result. My traffic almost doubled after adding the sitemap. It is best to keep a sitemap as html links only, this way it is easy for search engine spiders to scan. I use a program called "eXact Mapper Lite" which will scan your website folder and place all your links in the sitemap. This only works for html pages , personally i don't know of any scripts that would index php, asp, cgi pages.. but i am sure they would not be hard to write. Ok.. well, hope you enjoyed reading this article. __________________ Add your web design or hosting company to my Hosting Directory. Register to post on the forums.