PDA

View Full Version : Yahoo! Spiders

Violet CLM
Mar 9, 2005, 01:04 PM
We have about 450 Yahoo! Spiders viewing the JCF at the moment. Are they really needed here?
Bobby aka Dizzy
Mar 9, 2005, 03:04 PM
They probably ignore our robots.txt file - we can't really do much otherwise.
Hybrid
Mar 9, 2005, 04:13 PM
this sounds stupid but, those spiders actually may promote jazz more. when people are searching stuff they may accidentally come to j2o, download the demo and love the game.
it could happen.
Link
Mar 9, 2005, 04:13 PM
I doubt they ignore the robots.txt (http://www.jazz2online.com/robots.txt) file. We just don't block everything on the JCF.

I don't think this is really a problem, and it will allow more people to find this site if JCF threads are archived. If the bandwidth use becomes more of a problem, we may need to further limit the search spiders.
Bobby aka Dizzy
Mar 9, 2005, 05:47 PM
Oh you're right Link, I guess someone changed a few settings in there.