See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.
Alternatives to Robots.txt Extender
Plugins below are selected for functional relevance and current directory signals. Active-install counts do not affect this ranking.
Relevant replacements
WordPress plugins with similar use cases
Compatibility and update metadata provide context, not a quality guarantee. Review each plugin’s details for your site.
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
GoBookMart Robots Editorv1.0.2
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
Blocks the archive.org bots through the WordPress virtual robots.txt file.
Choose which AI bots can read your content, and publish an llms.txt file for AI search tools.
See which AI crawlers read your site — GPTBot, ClaudeBot, PerplexityBot and more — verify they are who they claim, and block the ones you choose.
Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.
Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.
See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).