How to use meta robots tags ?

Meta robots tag provides a utility of how a web page or post crawling and indexing in search engine and served to users. Add meta robots tag insection. We can use more than one meta tag but it may be cause a conflict issue.

The syntax of the meta robots tag:

<meta name="robots" content="<value>">

Default meta robots tags:
If we not specify any meta tag in a web page or post then spider will crawl and index the webpage by default and the meta tag should be consider as below:

<meta name="robots" content="index, follow"" />

The different robots meta tag values:
A brief description of all the different values we can use in the robots meta tags.

INDEX:
Allow search engines robots to index the page, don’t need to add this because it is added by default in the pages.

<meta name="robots" content="index" />

NOINDEX:
Disallow search engines from showing the page in their results. It prevents the specific page from being indexing.

<meta name="robots" content="noindex" />

FOLLOW:
Tells the search engines robots to follow the links on the page, whether it can index it or not.

<meta name="robots" content="follow" />

NOFOLLOW:
Tells the search engines robots to not follow any links on the page.

<meta name="robots" content="nofollow" />

NOARCHIVE:
Prevents the search engines from showing a cached copy of this page.

<meta name="robots" content="noarchive" />

NOODP:
Prevents Search engine to display its own description taken from its directory, instead of you meta description.

<meta name="robots" content="noodp " />

NOYDIR:
It is same as NOODP tag, but it only blocks Yahoo! from using the description for this page.

<meta name="robots" content="noydir" />