Web Hosting Forum | Lunarpages
News: July 14, 2008 - New Contest! - Submit Your WordPress Theme Designs, Win BIG!
August 5, 2008 - Time to Submit Your Links for the August 08 Site of the Month Award!
 
*
Welcome, Guest. Please login or register.
Did you miss your activation email?
August 21, 2008, 05:44:52 AM


Login with username, password and session length


Pages: [1]   Go Down
  Print  
Author Topic: My root, is it / or /public_html in FTP? (for robot.txt)  (Read 536 times)
Toadmund
Spaceship Navigator
*****
Offline Offline

Posts: 93



WWW
« on: November 19, 2006, 11:33:12 PM »

Kind of a dumb question, but I wouldn't want to make a dumb mistake.

Dumb Q #2 - Do I even need a robot.txt? I suppose I could have it not waste time on images or cgi scripts?

Any other helpful hints welcome.
Thanks Thumbs Up
Logged

TranzNDance
Princess of Naboo
Berserker Poster
*****
Offline Offline

Posts: 11965



WWW
« Reply #1 on: November 19, 2006, 11:36:31 PM »

In FTP, your root is public_html.

If you don't want to block any robots from any part of your site, you don't need robots.txt. One benefit of having it regardless is not having 404 errors when bots look for the file.
Logged

Grr..!! Luff Ya Grr..!! Luff Ya Grr..!! Luff Ya
Toadmund
Spaceship Navigator
*****
Offline Offline

Posts: 93



WWW
« Reply #2 on: November 19, 2006, 11:55:46 PM »

From what I've read, I believe you are right.
It's not as if I got a lot that I want disallowed!

Some come one, come all, spiders, bots and crawly things, my door is wide open.  Woot
Logged

SteveW
Master Jedi
*****
Offline Offline

Posts: 1394


WWW
« Reply #3 on: November 20, 2006, 06:39:03 AM »

If you want a robots.txt, you can create a robots.txt file in your public_html folder. Its contents can be this:
Code:
User-agent: *
Disallow:

Having that for your robots.txt, or having an empty robots.txt, or having no robots.txt at all, are equivalent.
Logged





Mt. Shasta
photo gallery.


Don't forget Lunarpages 24/7/365 support documentation:
Flash Tutorials, Knowledge Base FAQ Articles, cPanel Manual, Glossary/Dictionary, Support Tickets,
and
Forum Search.

Pages: [1]   Go Up
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.3 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks


Valid XHTML 1.0! Valid CSS! Dilber MC Theme by HarzeM