When you move a site via a 301 redirect should you setup a robots.txt disallowing robots to crawl the old address? – webmasters.stackexchange.com

When you move a site via a 301 redirect should you setup a robots.txt disallowing robots to crawl the old address? – webmasters.stackexchange.com

08:13 No Comments
A site I am working on moved a subdomain to another subdomain via a 301 redirect. However when checking robots.txt of the old subdomain, it has a robots.txt which disallows search engine web crawlers ...

from Hot Questions - Stack Exchange OnStackOverflow
via Blogspot

Share this

Unknown

Artikel Terkait

0 Comment to "When you move a site via a 301 redirect should you setup a robots.txt disallowing robots to crawl the old address? – webmasters.stackexchange.com"

Post a Comment

Subscribe to: Post Comments (Atom)