Tilläggstagg: crawlers
-
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
Block AI Crawlers
Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.
-
Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral Tracker
Get realtime visibility into crawlers, scrapers, LLM assistants, and AI agents browsing your website. Generate a robots.txt to opt out of AI training.
-
Robots Meta Whiz
Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
CeeWP Robots.txt Manager
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Seo Crawlytics Data Export & Delete
Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
Log-Hero.com Plugin
Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.
-
CodingBunny LLMs.txt Generator
Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
-
-
AI Rights Protection by SimpleFeed
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
