next »

[musicvid]

I've got a 30 day list of events with links on the home page  using ssi. Now the searchbots (Google and others) are crawling every event link and day link regularly. The unwanted result is a big bandwidth hit when they crawl and dozens of unwanted listings (day and event listings) on the search engines.

What are the right tag(s) to use to keep the bots out of the calendar?

[This message has been edited by musicvid (edited November 07, 2004).]

[DanO]

Actually a robots.txt file works better but it is still no guarnetee that web robots will follow your instructions. You can read about both the robots.txt file and the specific robots meta tags at the following link:

LINK > http://www.robotstxt.org/wc/faq.html

Dan O.

------------------

[musicvid]

Thanks DanO.

I put a robots.txt file on the server and will see how it works over the coming weeks.

------------------

[DataStream Designz]

I was wondering if there was any feedback as to how this helped.

I'm thinking of doing the same

joel

------------------
DataStreamDesignz