Plugin Tag: crawlers
-
-
Robots.txt rewrite
(2 total ratings)Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
AI Content Signals
(3 total ratings)Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
-
CodingBunny LLMs.txt Generator
(1 total ratings)Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
-
Robots Meta Whiz
(0 total ratings)Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
Serve Markdown
(0 total ratings)Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
-
ParseLess
(0 total ratings)Serve AI the good version of your content, see which bots really read it, and cap what they cost you. Markdown for crawlers and agents — 95%+ less ban …
-
Log-Hero.com Plugin
(2 total ratings)See which search engines, AI crawlers and other bots visit your site, and what they find. The official plugin for log-hero.com.
-
CeeWP Robots.txt Manager
(0 total ratings)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AMDT AI Traffic Analytics
(0 total ratings)See which AI bots crawl your site, whether they are who they claim to be, and who arrives from ChatGPT, Claude or Perplexity. Publishes llms.txt.
-
Temso AI
(0 total ratings)Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
-
OtterlyAI Agent Analytics
(0 total ratings)Reports every AI crawler and bot request on your site to OtterlyAI Agent Analytics. Runs server-side, in the background.
-
MSG LLMs TXT Manager
(0 total ratings)Serve your content as clean Markdown to AI agents, publish llms.txt and llms-full.txt, and see which agents actually fetch what.
-
Seo Crawlytics Data Export & Delete
(0 total ratings)Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
LJPL Armored robots.txt
(0 total ratings)Add some directives to your robots.txt file to keep your site safer
-
PufferSights – AI Crawler Insights
(0 total ratings)Monitor 135+ known AI crawlers and agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
-
Rawi MD — Markdown for AI Crawlers
(0 total ratings)Give ChatGPT, Claude and other AI crawlers a clean Markdown copy of your posts, pages and products. Nothing changes for your visitors.
-
Supertab Connect
(2 total ratings)Connect your WordPress site to the Supertab Connect platform for RSL license serving and enabling crawler authentication protocol.
-
Vinvin AI Visibility Tools
(0 total ratings)See what AI assistants can read on your site, and decide which AI crawlers may use it: a readiness checklist and purpose-based crawler controls.