Register FAQ Search Today's Posts Mark Forums Read
Go Back   JazzJackrabbit Community Forums » Maintenance & Feedback » Site and Forum Rules, Questions & Feedback

Google Spider Removal

Tubz

JCF Veteran

Joined: Apr 2001

Posts: 5,851

Tubz is doing well so far

Dec 23, 2004, 07:24 PM
Tubz is offline
Reply With Quote
Google Spider Removal

http://www.g4techtv.com/screensavers...e_Spiders.html

This shows you how to get rid of the spiders, I posted this for everyone to see, if anyone is interested in this. But mainlyif the admins decide on doing this to stop the spiders.
__________________

"Jewel is the Metallica of Yodelling." ~Edwin McCain
"Yes, it's a personal attack if you save my picture about internet safety" ~Labratkid
"You know what JBL? The only reason you were WWE Champion for a year was because Triple H didn't want to work Tuesdays!" ~Paul Heyman, addressing the public at the "ECW: One Night Stand" PPV on Sunday, June 12, 2005
Link

Untitled

Joined: Apr 2001

Posts: 2,099

Link is doing well so far

Dec 23, 2004, 09:08 PM
Link is offline
Reply With Quote
Thanks for the tip, but there's really no reason for us to block web spiders completely. We already have a robots.txt file that blocks some JCF pages.
__________________
With our extreme gelatinous apology,
We beg to inform your Imperial Majesty,
Unto whom be dominion and power and glory,
There still remains that strange precipitate
Which has the quality to resist
Our oldest and most trusted catalyst.
It is a substance we cannot cremate
By temperatures known to our Laboratory.

~ E.J. Pratt
 
Bobby aka Dizzy

(-)(-)(-)(-)(-)istrator

Joined: Jan 2001

Posts: 1,560

Bobby aka Dizzy is doing well so far

Dec 23, 2004, 09:08 PM
Bobby aka Dizzy is offline
Reply With Quote
Some bots follow robots.txt better than others however.

http://www.jazz2online.com/robots.txt
Tubz

JCF Veteran

Joined: Apr 2001

Posts: 5,851

Tubz is doing well so far

Dec 25, 2004, 10:40 AM
Tubz is offline
Reply With Quote
Well, they are pretty annoying. I'm just hoping that eventually we could get a nice total user amount without bots.
__________________

"Jewel is the Metallica of Yodelling." ~Edwin McCain
"Yes, it's a personal attack if you save my picture about internet safety" ~Labratkid
"You know what JBL? The only reason you were WWE Champion for a year was because Triple H didn't want to work Tuesdays!" ~Paul Heyman, addressing the public at the "ECW: One Night Stand" PPV on Sunday, June 12, 2005
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On

Forum Jump

All times are GMT -8. The time now is 11:01 AM.