Re: [xmca] Spam and xmca mailing list

[bjones@weber.ucsd.edu (Bruce Jones)]

>From huw.softdesigns@gmail.com  Fri Oct 28 09:58:40 2011
>
>Website pages can be marked as _not_ for 'spider bots' that accumulate 
>pages for google and the like, I believe.  So checking the relevant 
>lchc pages would be a start.

This is the "robots.txt" file that tells the search engines which of
your pages to index.

If you don't allow the search engines to index your pages then their
contents won't show up the search listings.


__________________________________________
_____
xmca mailing list
xmca@weber.ucsd.edu
http://dss.ucsd.edu/mailman/listinfo/xmca