slot Fundamentals Explained
The value on the name attribute (robots) specifies that the rule applies to all crawlers. equally the title plus the information characteristics are scenario-insensitive. To address a specific crawler, switch the robots worth of the title attribute Using the consumer agent token in the crawler that you'll be addressing. Google supports two consumer