Plugin Tag: robots.txt
-
Admin Robots.txt Editor
(2 total ratings)Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.
-
Check Search Engine Visibility on Migration
(1 total ratings)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 total ratings)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 total ratings)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Common Crawl via robots.txt
(0 total ratings)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Block Feed and Comments via robots.txt
(0 total ratings)Blocks some Feed and Comment resources in order to avoid spam bots
-
AI Deny
(1 total ratings)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
LJPL Armored robots.txt
(0 total ratings)Add some directives to your robots.txt file to keep your site safer
-
ChatBot Blocker by CellarWeb
(0 total ratings)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 total ratings)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Thin Content Manager
(1 total ratings)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 total ratings)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
Check System Details
(0 total ratings)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 total ratings)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
LLMs.txt – AI Website Content Crawling
(0 total ratings)Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.
-
HumanGate
(0 total ratings)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Flavio
(0 total ratings)Make your life easy and grow with us. AI-powered SEO assistant for WordPress.
-
Zulkaif Seo File Manager
(1 total ratings)Generate and control sitemaps, robots.txt, ads.txt, and other essential SEO files with full transparency and no silent automation.
-
Valvai – AI Traffic Control Center
(0 total ratings)Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
A3 Robots Warning
(0 total ratings)Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.