You are here: : Homepage > Best practices > Sheet No84
Best Practice N°84- LevelLevel 3- Section statisics and referencing
Description
The site root directory or the pages contain instructions for indexation robots.
Objectives
Makes for a better targeted referencing and improved guidance for search tools.
Possible technical solutions:
In order to define directories, files or file-types that are not intended for indexation use the instructions User-agent and Disallow in a unique simple text file called robots.txt placed in the root directory of the site. On this subject read A Standard for Robot Exclusion
Alternatively in order to act at the level of a specific page use the <meta name="robots" content="attribut1,attribut2"> tag in it where:
- attribut1attribute 1 can have the values
index(index this page) ornoindex(don’t index this page) ; - attribut2 can have the values
follow(follow the links in this page) ornofollow(don’t follow the links);
Control methods:
Validator of robots.txt: http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Put these Best Practices to use.
Opquast is a service provided by Temesis. The Opquast Best Practices are elaborated in the Opquast Workshop(FR).