Zen Cart Logo
Forums / Search Engines / Just to Clarify- robots.txt file

Just to Clarify- robots.txt file

Locked

Views: 642

Results 1 to 3 of 3
This thread is locked. New replies are disabled.
26 Jan 2009, 21:29
#1
mw4kids avatar

mw4kids

Zen Follower

Join Date:
Oct 2008
Posts:
403
Plugin Contributions:
0

Just to Clarify- robots.txt file

Hi,

Just a quick question, since I can't seem to find an answer to this specific situation.

I read on another thread:

**The 'robots.txt' file is also best used for declaring what directories not to index, rather than individual pages.

User-agent: *
Disallow: /images/

The above states to not index or include anything within your images dir.**

Question: I just want to prevent popup images from being indexed. I have pages indexed that include text and pictures of my products. I don't want these images blocked.
Will this command block these images as well? :huh:

27 Jan 2009, 02:00
#2
mprough avatar

mprough

Totally Zenned

Join Date:
Nov 2007
Location:
Woodbine, Georgia, United States
Posts:
4,278
Plugin Contributions:
37

Re: Just to Clarify- robots.txt file

A robots.txt does not prevent indexing, but rather crawling. http://sebastians-pamphlets.com/crawling-vs-indexing/

If you would like your pop pages not indexed then add them to your spider's skip in includes/languages/your_template/meta_tags.php

This is the line you add it to define('ROBOTS_PAGES_TO_SKIP',

just add popup_image and the popup images pages will then contain a noindex, nofollow meta tag.

~Melanie

27 Jan 2009, 03:51
#3
mw4kids avatar

mw4kids

Zen Follower

Join Date:
Oct 2008
Posts:
403
Plugin Contributions:
0

Re: Just to Clarify- robots.txt file

cool...thanks!