OSCOMMERCE SUPPORT CALL 702-453-3332

 

Help - Search - Members - Calendar
Full Version: Spiders don't like my site...not seeing metas or any page text.
osCommerce Community Support Forums > osCommerce Online Merchant v2.x > General Support
netstep
Search engine spiders are not seeing Meta tags or any site text....but it's there!
NetStepCommerce.com

I've tried the SID KILLER (1.2B&C)...but something is messed up because my SIDs are still there.

I tried UPDATED SPIDERS.TXT.

I'm using Header Tags Controller and it inserts the tags great.

My Site: 1-HIT Spider Simulator
My Site: Chemo Simulator
My Site: Poodle Simulator

This is kinda a big deal since it appears when a spider comes to my site it just gets PO'd and leaves.
SID killer makes sense to me...don't force cookies, only give SID after shopper does something and prevent spiders from doing those things that trigger SIDs. Is this a good solution for SIDs?

ms2.2
SESSION Force Cookie Use False
SESSION Check SSL Session ID False
SESSION Check User Agent False
SESSION Check IP Address False
SESSION Prevent Spider Sessions False
SESSION Recreate Session False
SESSION ID Killer true
Use Search-Engine Safe URLs false

When I set SESSION Prevent Spider Sessions True the site freaks out and keeps redirecting to logoff.php.

If I enable SE safe URLs and try to check out I get Error! Unable to determine the page link!

Have I gone down the wrong path?

Any thoughts on make a spider friendly site would be much appreciated.
Jack_mcs
First off, you don't have Header Tags set up or installed correctly. The titles are not displaying as they should. Next, there is very little information on the page for the SE's to find. How long as the site been up? Have you looked at your logs to see if the SE's are visiting your site? Has MSN listed you? If not, then there is probably something preventing the SE's from getting to your files.

Jack
boxtel
QUOTE (netstep @ Apr 13 2006, 03:35 PM) *
Search engine spiders are not seeing Meta tags or any site text....but it's there!
NetStepCommerce.com

I've tried the SID KILLER (1.2B&C)...but something is messed up because my SIDs are still there.

I tried UPDATED SPIDERS.TXT.

I'm using Header Tags Controller and it inserts the tags great.

My Site: 1-HIT Spider Simulator
My Site: Chemo Simulator
My Site: Poodle Simulator

This is kinda a big deal since it appears when a spider comes to my site it just gets PO'd and leaves.
SID killer makes sense to me...don't force cookies, only give SID after shopper does something and prevent spiders from doing those things that trigger SIDs. Is this a good solution for SIDs?

ms2.2
SESSION Force Cookie Use False
SESSION Check SSL Session ID False
SESSION Check User Agent False
SESSION Check IP Address False
SESSION Prevent Spider Sessions False
SESSION Recreate Session False
SESSION ID Killer true
Use Search-Engine Safe URLs false

When I set SESSION Prevent Spider Sessions True the site freaks out and keeps redirecting to logoff.php.

If I enable SE safe URLs and try to check out I get Error! Unable to determine the page link!

Have I gone down the wrong path?

Any thoughts on make a spider friendly site would be much appreciated.


your pages loop if cookies are refused.
netstep
QUOTE (boxtel @ Apr 13 2006, 02:46 PM) *
your pages loop if cookies are refused.
Thank you for your help. I'll look at my settings and try it from a couple computers that are set differently.
Any way to get that to redirect to a "Cookie Usage" page?
I use ZoneAlarm...but it's set to accept cookies.
My other cookies seem to come in...
boxtel
QUOTE (netstep @ Apr 13 2006, 11:12 PM) *
Thank you for your help. I'll look at my settings and try it from a couple computers that are set differently.
Any way to get that to redirect to a "Cookie Usage" page?
I use ZoneAlarm...but it's set to accept cookies.
My other cookies seem to come in...


I would first turn off autologon.

then this:

SESSION Force Cookie Use False
SESSION Check SSL Session ID False
SESSION Check User Agent true
SESSION Check IP Address False
SESSION Prevent Spider Sessions true
SESSION Recreate Session False
SESSION ID Killer false (no need)
Use Search-Engine Safe URLs false (no work)

then check your autologon installation as I think it interferes with something or is not installed correctly.
netstep
QUOTE (boxtel @ Apr 13 2006, 03:52 PM) *
I would first turn off autologon.

then this:
SESSION Force Cookie Use False
SESSION Check SSL Session ID False
SESSION Check User Agent true
SESSION Check IP Address False
SESSION Prevent Spider Sessions true
SESSION Recreate Session False
SESSION ID Killer false (no need)
Use Search-Engine Safe URLs false (no work)

then check your autologon installation as I think it interferes with something or is not installed correctly.

I turned off AutoLogon...and I'm back in business...
I installed 338 Autologin v1.08 as per instructions, but I will double check it.

Is 2087 - Autologin Secure better?
Or something else to eliminate the need to repeate customers to login every time.
gurumsd
I have autologin installed and was having problems with it getting bots sent to the logoff page as well. My solution was to edit application_top.php like the following:


if(!$spider_flag){
include('includes/modules/autologon.php');
}

Basically, search for the autologon.php include line and add the if statement around it. This will cause the autologon code to be disabled for bots.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2008 Invision Power Services, Inc.