Kryptronic Software Support Forum

You are viewing this forum as a guest. Login to an existing account, or create a new account, to reply to topics and to create new topics.

#1 12-29-2004 09:17:17

rik@rmd
Member
Registered: 10-03-2004
Posts: 31

Question For Those That Know About Seo And Robots

Hi all.

Its probably an obvious answer, but as im new to all this i thought i would ask for opinions.

Im having trouble getting any results from my CCP shop showing in the search engines. I have the SEO module from ATS installed, although its only been on a few weeks now, along with the Product Index module, again from ATS.

Being a curious soul, ive been having a look at the source code of many websites lately, to see how things have been done by others and notice that many CCP example websites have the following in their header:

Code:

<META NAME="robots" CONTENT="INDEX,FOLLOW">

I was beginning to wonder if, as this is not in the code for my CCP shop, could this be stopping the robots from searching through my site ?

Looking into this a little, i did get the impression that a robots.txt file would do away with the need to add this head tag, and although i can find text files relating to robots in CCP, it isnt strictly speaking called robots.txt.

As another element, I have a static HTML page as my homepage, that splits between the orginal static site I have running alongside the shop, that deals with installations, and the CCP shop. Both link directly from this static page, as does the link for the site index in the hope that having it here also will encourage any bots to go have a look. Would this have a major affect ?

It just seems that nothing relating to the CCP shop is being found at all, and the page count and hits of the robots i would have presumed would be much higher with the considerable product count now.

I know for many of you out there, there is a simple explaination to these queries. Its not so much the ranking that worries me at the minute, so much as I feel the whole shop is being missed from the robot search, and desperatly want to sort this quickly.

Sorry for the essay here all!! smile  hope sumone can shed some light on this for me.

website for reference is

Thanks everyone !! :-) 

Offline

 

#2 12-29-2004 11:34:49

Ed_H
Member
From: Smashachusetts
Registered: 09-12-2003
Posts: 397
Website

Re: Question For Those That Know About Seo And Robots

The INDEX,FOLLOW tag has no effect one way or the other - by default spiders will crawl a page.  Its presence is just extra code.

The link to your store from your home page needs to be changed to  or  - currently it's got the dynamic URL link which most spiders won't follow and that's preventing them from getting to the category and product links.

Offline

 

#3 12-29-2004 11:40:54

rik@rmd
Member
Registered: 10-03-2004
Posts: 31

Re: Question For Those That Know About Seo And Robots

Hi Ed

Thanks for that. I feel like a tit now cause I was soo sure I had already done that , but grateful for you noticing it smile

I will leave it a while now and see how things go, though i am still little dissapointed that while the new homepage has been updated, our links static html page is still awaiting re finding.

Cheers mate ! smile 

Offline

 

#4 12-29-2004 13:46:42

drp
Member
Registered: 06-10-2004
Posts: 103

Re: Question For Those That Know About Seo And Robots

To expound on what Ed said...  you only need a robots metatag or robots.txt file if you want to EXCLUDE areas of your site from the bots (or to exclude certain bots - though that is of dubious value since the really bad bots won't look for a robots.txt file anyway smile).  If you don't have a robots.txt file, you might notice some error messages in your log files from the search engines trying to find the robots.txt file.  You can ignore them (they are harmless) or you can create a simple robots.txt file with the following:

User-agent: *
Disallow:

That allows ALL robots access EVERYWHERE on your site.... 

You might also want to double check your other links on your home page as well... I noticed your contact and feedback links had a user id in them. 

Once you get spidered, google *might* penalize you for duplicate content.... both wwwrmdaudio.co.uk and rmdaudio.co.uk come up separately.  You probably should do a permanent redirect of one of them to the other.  Depends on which one you have most of the links to your site pointing.  IE, my site has all the links pointing to the www version of the domain, so I redirected the non www version to the www version.  Typing either mydomain.com or wwwmydomain.com takes you to wwwmydomain.com

HTH,
.Don.


Don

Offline

 

#5 12-29-2004 14:02:25

rik@rmd
Member
Registered: 10-03-2004
Posts: 31

Re: Question For Those That Know About Seo And Robots

Hi Don

Thanks for your reply! smile

I havent modified any of the Seach Engine items such as robots.txt in the standard CCP package, so I can only assume that the text files i found were what is required, though i hadnt found a specific "robots.txt" file. Anyone know if this is right ? smile

Checking web stats shows that the google.bot is finding the main page okay, and having a few thousand hits, but certainly nothing like what it should be. My error in not updating the links to SEO optimised ones would presumably explain the exclusion of the shop so far from being googled, i just hope it helps  smile

You have made an interesting point regarding having both wwwrmdaudio.co.uk and rmdaudio.co.uk . Could you elaborate a little more on this as I havent done anything to specifically do this, and a quick scan showed no links that are direct to the non "www" version , tbh hadnt noticed a non www version before.

Its been quite a struggle over the past little while getting to grips with designing the original site, then rudimentary learning of CGI for the shop, and now trying to figure out the best way to get my site exposed to everyone, which is just as confusing to start with.

Happily you guyz here are very helpful for beginners like me, so it helps me pick this up much better !! smile

Any advice on how to make the site show better in search engines is much appreciated smile 

Offline

 

#6 12-29-2004 14:22:25

Ed_H
Member
From: Smashachusetts
Registered: 09-12-2003
Posts: 397
Website

Re: Question For Those That Know About Seo And Robots

I've redirected requests for the non-www version to the www version of a site by adding the following lines to the .htaccess.  In this example the first two lines and the last line are existing lines in the seo mod .htaccess:

Code:

Options +FollowSymLinks
RewriteEngine On

RewriteCond %{HTTP_HOST} !^www\.mysite\.com
RewriteRule ^(.*)$ http://www.mysite.com/$1 [R=301,L]

RewriteRule ^shop /ccp51/cgi-bin/cp-app.cgi?pg=shop

This may NOT work with your configuration, but there is probably an alternate solution if it doesn't.

Offline

 

#7 12-29-2004 15:09:25

rik@rmd
Member
Registered: 10-03-2004
Posts: 31

Re: Question For Those That Know About Seo And Robots

Hi Ed

Thanks for that, will look into testing that in a bit, and see what happens.

As a matter of curiousity, do you know how this would have happened in the first place? smile 

Offline

 

#8 12-29-2004 15:48:31

drp
Member
Registered: 06-10-2004
Posts: 103

Re: Question For Those That Know About Seo And Robots

"As a matter of curiousity, do you know how this would have happened in the first place?"

Do you mean having a www and non www version?  That's normal.  Some web hosts will automatically do the redirect for you.  Sometimes you can do the redirect from where you purchased your domain name.  Most of the time, you just do the mod rewrite as above and you are set. 

.Don.


Don

Offline

 

#9 12-29-2004 16:12:03

rik@rmd
Member
Registered: 10-03-2004
Posts: 31

Re: Question For Those That Know About Seo And Robots

Cheers Don smile

Im sure i must sound like a right pillock with some of my questions sometimes, as they must be pretty obvious ! But trust me I am learning all the time, is good to know theres people out there that can answer my ( sometimes obvious) questions and keep me on the track of learning this programming malarkey quicker smile

Will sort that mod rewrite out tonite or first thing tomorrow if i can, and get that sorted.

Its become a mission now to try and get this site as high as possible in the Search Engines.. any advice to help me on my mission would be great! smile 

Offline

 

#10 12-29-2004 21:56:50

Iceit88
Member
From: Fairview, PA
Registered: 11-19-2003
Posts: 549
Website

Re: Question For Those That Know About Seo And Robots

where can the .htaccess file be found, I know I have seen it before


Bryan

Hat Trick Sports, LLC

Offline

 

#11 12-29-2004 22:57:30

Steven
Member
Registered: 04-21-2004
Posts: 84

Re: Question For Those That Know About Seo And Robots

Ed_H,12/29/2004 02:22:25 PM wrote:

I've redirected requests for the non-www version to the www version of a site by adding the following lines to the .htaccess.  In this example the first two lines and the last line are existing lines in the seo mod .htaccess:

Code:

Options +FollowSymLinks
RewriteEngine On

RewriteCond %{HTTP_HOST} !^www\.mysite\.com
RewriteRule ^(.*)$ http://www.mysite.com/$1 [R=301,L]

RewriteRule ^shop /ccp51/cgi-bin/cp-app.cgi?pg=shop

This may NOT work with your configuration, but there is probably an alternate solution if it doesn't.

Careful Guys, This code that Ed has posted is fine for those people who have the same domain name for https (secure) transactions.  However, if you have a different URL for secure transactions (read shared SSL server certificate) then this will not work for you.  All your secure transactions for checkout will be re-directed to non-secure!

I thought I'd speak up and say this so nobody else starts pulling hair.

Offline

 

#12 12-29-2004 22:58:22

Steven
Member
Registered: 04-21-2004
Posts: 84

Re: Question For Those That Know About Seo And Robots

Iceit88,12/29/2004 09:56:50 PM wrote:

where can the .htaccess file be found, I know I have seen it before

In your root/home directory mate.  ".htaccess"

Offline

 

Board footer