WordPress plugin intelligence profile

Grubbomatic Crawl Readiness – AI Crawler Check and Fixes

Check whether AI crawlers can read your site, then fix what they need in one click: llms.txt, AI crawler rules, meta and Open Graph tags, JSON-LD.

WP PlugIndex snapshot

Current directory snapshot

Tested up to WordPress 7.1
Current version1.0.3
WordPress coverageTested up to WordPress 7.1
Minimum stackWP 6.0 · PHP 7.4
Directory statusactive
Last directory update29 Oct 20263d ago
Active installationsNewAdoption metric — not a quality score
WordPress.org ratingNo WordPress.org ratings yet
Official packageDirect from WordPress.org

Repository metrics are context, not quality scores. Active installations measure adoption and can strongly reflect a plugin’s age and historical popularity. Ratings, recent updates and “Tested up to” metadata also do not guarantee modern code, error-free operation, security, feature completeness or suitability for a particular site. Why active installs don’t tell the whole story →

WP PlugIndex currently records Grubbomatic Crawl Readiness – AI Crawler Check and Fixes version 1.0.3 as active, updated 3d ago and tested up to WordPress 7.1.

Overview

About this plugin

AI search engines, AI assistants and the crawlers that gather training data all read websites. This plugin checks how yours looks to them, from the outside, and sets it up the way you intend: readable where you want it read, closed to AI training if you choose, with the files AI systems look for.

com against your site and shows the result in wp-admin: a score out of 100, a plain-English verdict, and the list of things AI crawlers need that your site does not have yet. Then it fixes most of them for you, from inside WordPress:

  • llms.txt — a Markdown summary of your site, built from your own pages and posts and served at /llms.txt. Nothing is written to disk and nothing goes stale.
  • AI crawlers in robots.txt — a Content-Signal line that states your AI preferences, and, if you choose “allow AI search and assistants, block AI training”, a block for each crawler that only collects training data (GPTBot, ClaudeBot, Common Crawl and a few more). It never un-blocks a crawler: any rule you or another plugin already wrote stays in force.
  • Meta description and Open Graph tags — a description, title, image and canonical address for every page, when you do not already run an SEO plugin.
  • Structured data (JSON-LD) — Organization and WebSite for the site, Article for posts, again only when no SEO plugin owns it.
  • agents.json — an optional card at /.well-known/agents.json pointing AI systems at your llms.txt, sitemap and feed.

The check itself takes about ten seconds and can be run again any time. The dashboard shows your latest score.

Check first, then fix

Most AI plugins write a file and hope it helps. This one looks first, from the outside, the way an AI crawler does. It tests 60 AI crawlers and scores them by what each one is for, so blocking the ones that only collect training data doesn’t cost you points.

Every finding is matched to the switch that fixes it, and checking again shows whether it worked. txt is one of five fixes, not the point of the plugin.

Works with your SEO plugin

If Yoast SEO, Rank Math, All in One SEO, SEOPress, The SEO Framework or Slim SEO is active, the meta tag and structured data switches stay off so nothing is written twice. txt and the robots rules still apply.

Going further

Being readable is step one. Monitor re-checks your site weekly or daily and tells you the day its verdict or its access policy changes, with the signal that moved. The Machine Readiness Audit measures every page, writes the five files for WordPress and runs an Answer Analysis of the questions your customers ask on live AI search.

The check and this plugin are free.

External services

com, a service operated by the plugin author, for one purpose: running the readiness check.

  • What is sent: your site address (the home URL), when you press “Check this site” or “Check again”. If you enter an API key in the settings, it is sent with the request. Nothing is sent automatically or in the background.
  • What comes back: the score, verdict and list of findings, which the plugin stores in one option so the page and the dashboard widget can show them.
  • What the service does with it: fetches your site’s robots.txt, llms.txt, home page and agents.json from the outside, scores them, and keeps the result so the “Full report” link works.

Privacy policy · Terms

WordPress.org metadata

Plugin tags

Topics listed for this plugin in the WordPress.org directory.

  • ai crawler
  • llms txt
  • robots txt
  • llms.txt
  • robots.txt
  • schema
Compatibility & maintenance

Compatibility & maintenance

Tested with WP 7.1

Marked as tested with the current WordPress 7.1 release.

Current WordPress releaseWordPress 7.1
WordPress.org Tested up to7.1
Minimum requirementsWordPress 6.0 · PHP 7.4
Update activity29 Oct 20263d ago

“Tested up to” is directory metadata supplied by the plugin author. WP PlugIndex does not turn an older declaration into a claim that the plugin is incompatible.

Changes recorded by WP PlugIndex

Recent tracked changes

Version1.0.01.0.3
WordPress compatibility7.1.37.1.4
WordPress compatibility7.1.27.1.3
Tracking & source

WP PlugIndex tracks public WordPress.org directory metadata and records selected version, compatibility and availability changes as they are detected.

Plugin watchlist

Watch this plugin

Sign in to your WP PlugIndex account or create a free account. Free accounts can watch up to 5 plugins and see what changed.

Watch limit

Watchlist limit reached

You have reached your current active watch limit.