Welcome to the Tiki Central 2.0 Beta. Read the announcement
Celebrating classic and modern Polynesian Pop

Beyond Tiki, Bilge, and Test / Beyond Tiki / Domainers at Tiki Central?

Post #128583 by Tangaroa on Thu, Dec 2, 2004 5:06 PM

You are viewing a single post. Click here to view the post in context.
T

On 2004-12-02 15:03, Futura Girl wrote:

*On 2004-12-02 11:50, Tangaroa wrote:*You can place a robots.txt file in your code that instructs them not to archive your old pages. See more info here: http://www.archive.org/about/exclude.php

the only problem with that is once you tell 'em not to crawl, it removes ALL the pages from your website for now and forever. They will not selectively remove page(s).

Yikes!