Register FAQ Search Today's Posts Mark Forums Read
Go Back   JazzJackrabbit Community Forums » Maintenance & Feedback » Site and Forum Rules, Questions & Feedback

A question regarding spiders

Reply
 
Thread Tools
cooba

JCF Veteran

Joined: Jan 2004

Posts: 7,823

cooba is a glorious beacon of lightcooba is a glorious beacon of lightcooba is a glorious beacon of lightcooba is a glorious beacon of lightcooba is a glorious beacon of lightcooba is a glorious beacon of light

Sep 10, 2004, 11:37 AM
cooba is offline
Reply With Quote
A question regarding spiders
Yesterday, two spiders from MSN came and searched for JJ3 stuff. Today, there are a lot of Google spiders wandering around randomly. Weren't they disabled on JCF?
__________________
Mystic Legends
http://www.mysticlegends.org/
The Price of Admission - Hoarfrost Hollow - Sacrosanct - other - stuff
Tubz

JCF Veteran

Joined: Apr 2001

Posts: 5,851

Tubz is doing well so far

Sep 10, 2004, 12:21 PM
Tubz is offline
Reply With Quote
What the hell is the difference between a Google Spider and a normal Google search bot?
__________________

"Jewel is the Metallica of Yodelling." ~Edwin McCain
"Yes, it's a personal attack if you save my picture about internet safety" ~Labratkid
"You know what JBL? The only reason you were WWE Champion for a year was because Triple H didn't want to work Tuesdays!" ~Paul Heyman, addressing the public at the "ECW: One Night Stand" PPV on Sunday, June 12, 2005
Bobby aka Dizzy

(-)(-)(-)(-)(-)istrator

Joined: Jan 2001

Posts: 1,560

Bobby aka Dizzy is doing well so far

Sep 10, 2004, 12:29 PM
Bobby aka Dizzy is offline
Reply With Quote
I believe the MSN spider chooses to ignore the request to not cache our pages.
Link

Untitled

Joined: Apr 2001

Posts: 2,099

Link is doing well so far

Sep 10, 2004, 12:48 PM
Link is offline
Reply With Quote
Quote:
Originally Posted by Bobby aka Dizzy
I believe the MSN spider chooses to ignore the request to not cache our pages.
Actually, the robots.txt file was lost in the server crash.
__________________
With our extreme gelatinous apology,
We beg to inform your Imperial Majesty,
Unto whom be dominion and power and glory,
There still remains that strange precipitate
Which has the quality to resist
Our oldest and most trusted catalyst.
It is a substance we cannot cremate
By temperatures known to our Laboratory.
~ E.J. Pratt
 
Bobby aka Dizzy

(-)(-)(-)(-)(-)istrator

Joined: Jan 2001

Posts: 1,560

Bobby aka Dizzy is doing well so far

Sep 10, 2004, 04:12 PM
Bobby aka Dizzy is offline
Reply With Quote
Well I believe certain versions of the msnbot still choose to ignore it but that's true too.
KRSplat

JCF Member

Joined: Mar 2001

Posts: 4,942

KRSplat is a forum legendKRSplat is a forum legend

Sep 11, 2004, 06:43 AM
KRSplat is offline
Reply With Quote
Quote:
Originally Posted by JJ Tublear
What the hell is the difference between a Google Spider and a normal Google search bot?
Spiders search websites and cache every single page that there is a link to. I don't really know what I'm talking about, though.
__________________
Reply

« Previous Thread | Next Thread »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Forum Jump

All times are GMT -8. The time now is 11:09 PM.
Contact Us - Jazz2Online - Archive - Top