About this plugin
txt
txt file and creates relevant tags.
Currently script supports following commands:
-
Disallow:
name=”robots” content=”noindex, nofollow”
Blocks content from crawling for the search engine.
-
Index:
name=”robots” content=”index, nofollow”
Allows crawling, forbids follow the links.
-
Follow:
name=”robots” content=”noindex, follow”
Forbids crawling, allows forbids follow the links.
-
Noarchiv:
name=”robots” content=”noarchive”
Do not show a link to the cached copy.
-
Nosnippet:
name=”robots” content=”nosnippet”
Do not create a snippet.
-
Noodp:
name=”robots” content=”noodp”
Do not use the description from DMOZ for snippet.
-
Notranslate:
name=”robots” content=”notranslate”
Do not offer page translation.
-
Noimageindex:
name=”robots” content=”noimageindex”
Do not crawl the image on the page.