Oh and I'm talking about from your website, we aren't quite at the point when you want to stop them from walking in to your house. No robots scripts are great if you don't want a certain robot picking up your site and indexing it incorrectly or if what I'm interested in (as I'm too lazy to be bothered by the previous) and stop robots from visiting certain pages; especially ones containing personel data. The last thing you want to essentially end up doing is allowing people to find all the info on one person via a quick google search. Anyway if you want to do this I suggest that you take a read of [robotstxt.org] which provides basically all you need to know to get this setup, its a very good page.
Krioma.net
[Who Knows, Who Cares]
Search
About
This page contains a single entry from the blog posted on January 10, 2006 9:20 AM.
The previous post in this blog was Running in the rain, good or bad?.
The next post in this blog is The Need to post....
Many more can be found on the main index page or by looking through the archives.
Powered by
Movable Type 3.33
Movable Type 3.33
