I think I am looking for the same thing Boatman is. So instead of starting another thread, I would like to tag on to this one.
For me the main purpose of
Primary.com is to host
AddOn.comSo I have
Primary.com/addon_1
Primary.com/addon_2
Primary.com/addon_3... etc.
Each
addon.com has it own robot.txt file. I have very good search engine placement and I don't want to mess anything up. As with posters above, I never use
Primary.com/addon to link any sites to each other. I always use
addon.com. Even in the index.html of
Primary.com uses a redirect to
addon_1.com to move visitors away from my
Primary.com space.
This is what I want to do: I want to change my robot.txt file in
Primary.com to this:
# go away
User-agent: *
Disallow: /
Disallow: *.*
I understand this will send all robots away from
Primary.com without indexing anything. And from what I read above this will not affect any
Addons.comSam
;