A few people have claimed that Lycos would'nt index a page unless a robot.txt file is present. A robots.txt file is used to prevent spiders from indexing a page, but it can be present and still allow spiders in for indexing.

Here's the configuration:

User-agent: *
Disallow:

With this configuration, you're telling the spiders that nothing in the site is disallowed, and for them to index anything they find.

So, if you can't get your site indexed with Lycos, try adding a robots.txt file.

Hmm, just been wondering..

Do robot.txt files help for sites hosted on providers like lunarpages? Haven't read about it anywhere. Or does it only work for sites with their own domain names?

Thanks in advance!