Google limits robots.txt support to four fields, clarifying its stance on unsupported directives.
The post Google Updates Robots.txt Policy: Unsupported Fields Are Ignored appeared first on Search Engine Journal.
Google Updates Robots.txt Policy: Unsupported Fields Are Ignored via @sejournal, @MattGSouthern
Tweet on Twitter
Share on Facebook
Google+
Pinterest