Apache robots.txt 2007-07-10 - By debu
Back
Hi Group,
I was just trying to find all the tags that can be used inside apache robots .txt, any link, or any addition to the following?
i have these,
User-agent: Disallow: Crawl-delay: Request-rate: Visit-time:
Thanks Debajit kataki -- redhat-list mailing list unsubscribe mailto:redhat-list-request@(protected)?subject=unsubscribe https://www.redhat.com/mailman/listinfo/redhat-list
|
|