Tilläggstagg: crawler
-
WEO LLMS & AI Crawler Guide
The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
-
Bottoll – AI Crawler Control
Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.
-
OpenBotAuth – AI Crawler Access Control
Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.
-
Aiso AI Crawler Analytics
See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.
-
OtterFixer AI Bot Tracker
A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.
-
Crawl Hunt – Advanced SEO Optimization Tool
A powerful website crawler and monitoring tool for WordPress.
-
FacetFence Product Filters
Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
LLMAffiliate AI Traffic Monetizer
Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.