The best Side of rajatoto
The value from the name attribute (robots) specifies the rule relates to all crawlers. both equally the identify and also the material attributes are situation-insensitive. to handle a specific crawler, substitute the robots value of the title attribute With all the consumer agent token on the crawler you are addressing. Google supports two consume