login/register

Snip!t channels - Fiona

Channels > search > robots

Order by: date | title | url | snip    Show: just this cat | subcats too

2006-07-19 10:53:54     How to block spambots, ban spybots, and tell unwanted robots to go to hell [dive into mark]

http://diveintomark.org/...ell_unwanted_robots_to_go_to_hell

How to block spambots, ban spybots, and tell unwanted ro...

view snip

/Channels/search/robots

2006-02-05 17:43:22     New Robots.txt Syntax Checker: a validator for robots.txt files

http://tool.motoricerca.info/robots-checker.phtml

This robots.txt checker is a "validator" that analyzes t... robots.txt file to see if its format is valid as establi... Exclusion Standard (please read the documentation and th... learn the basics) or if it contains errors.

view snip

/Channels/search/robots