Plugin tag: robots.txt
-
-
Check Search Engine Visibility on Migration
(1 totaal waarderingen)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 totaal waarderingen)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 totaal waarderingen)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AI Deny
(1 totaal waarderingen)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Common Crawl via robots.txt
(0 totaal waarderingen)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 totaal waarderingen)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 totaal waarderingen)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 totaal waarderingen)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ProAI TXT Manager for LLMS and Robots
(1 totaal waarderingen)Genereert en beheert automatisch llms.txt en robots.txt bestanden voor je WordPress site met AI-geoptimaliseerde inhoud.
-
LJPL Armored robots.txt
(0 totaal waarderingen)Add some directives to your robots.txt file to keep your site safer
-
ChatBot Blocker by CellarWeb
(0 totaal waarderingen)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
HumanGate
(0 totaal waarderingen)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Thin Content Manager
(1 totaal waarderingen)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 totaal waarderingen)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
Advanced SEO Toolkit
(0 totaal waarderingen)Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
(0 totaal waarderingen)With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
Check System Details
(0 totaal waarderingen)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
AITooler Bot Analytics – AI Crawler Tracking & Visibility
(0 totaal waarderingen)See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
-
AI Crawlers Visibility, Analytics & Control
(0 totaal waarderingen)AI crawlers monitoring for WordPress — track GPTBot, ClaudeBot, and 68+ bots with analytics, robots.txt rules, PHP blocking, and visibility scoring.