Translations:Help:Robots.txt/20/en

[At least one or more  or   entries per rule] A directory or page, relative to the root domain, that may be crawled by the user agent just mentioned. This is used to override a  directive to allow crawling of a subdirectory or page in a disallowed directory. For a single page, the full page name as shown in the browser should be specified. In case of a directory, the rule should end in a  mark.