Hey beanie............

[GZire]

When you check who's online, what the hell is with the "Yahoo! Slurp Spider" & "
Google AdSense Spider"?

Whaddup?

[uhohNumber2brb]

when people use search engines.....they help the search engines find this site

[GZire]

Damn #2, you are smart enough to be #1.

[beanie]

This is what VQ said about it when we first switched to the new forum software

Originally Posted by VQ

Just GoogleBot doing his job. Must have found and followed the link on the old board. Google, Yahoo and MSN spiders are the heaviest users of bandwidth on 6MT. They come through from time to time, suck up the content and then it'll show up in the index in a day or two. The new forum software just exposes them rather than saying they are guests.

Originally Posted by VQ

We want them to come through and suck up the posts. It allows web searches to find us. We have used the robots file in the past to limit certain areas.

[beanie]

Originally Posted by uhohNumber2brb

when people use search engines.....they help the search engines find this site

That would have been the much faster way to answer

[uhohNumber2brb]

Originally Posted by GZire

Damn #2, you are smart enough to be #1.

i try to......

[Hexxum001]

^^^