
內容簡介
外掛介紹:這個外掛會在 WordPress 自動建立虛擬 robots.txt 檔案時,新增阻止 Common Crawl bot (CCBot) 爬取網站的指令。若啟用此外掛,它會將禁止 CCBot 爬取和索引網站的指令新增至 robots.txt 檔案,請謹慎操作。此外,本外掛需要 PHP 7.4 或以上的版本運行。
問題與答案:
- 這個外掛可以執行什麼功能?
- 此外掛會新增阻止 CCBot 訓練 AI 算法(如 ChatGPT)爬取網站的指令至 WordPress 自動建立的虛擬 robots.txt 檔案中。
- 這個外掛的設計基於什麼想法?
- 此外掛是在 OpenAI ChatGPT 插件之後開發出來阻止其爬取網站的。
- 什麼是 robots.txt 檔案?
- robots.txt 檔案是一個純文字檔案,位於網域(或子域)的根目錄下,告訴網路爬蟲(如 Googlebot)可以檢索和索引的網站部分。
- 這個外掛的系統需求是什麼?
- 需要 PHP 7.4 或以上版本來執行。
- 如何將這個外掛翻譯成其他語言?
- 可使用 WordPress 內建的翻譯功能將此外掛翻譯成其他語言。首先,閱讀翻譯人員手冊和選擇您所在的語言。然後,前往此外掛的翻譯頁面將其翻譯為您所需的語言。
- 如何取得更多相關資訊?
- 請透過電子郵件聯繫外掛開發者。
外掛標籤
開發者團隊
② 後台搜尋「Block Common Crawl via robots.txt」→ 直接安裝(推薦)
原文外掛簡介
This plugin adds lines to the virtual robots.txt file that WordPress creates automagically if the file is not present physically on the server to block the Common Crawl bot (CCBot) that is used to train AI algorithms like ChatGPT (in version 3.5 it makes up 60% of the training data mix) to crawl websites. Here is the information about the Common Crawl bot (CCBot).
Please be aware of what this plugin does exactly: If you activate the plugin it will add some lines to the robots.txt file to tell Common Crawl bots to not to crawl and index parts of this website.
Please only activate this plugin if you know what you’re doing.
What can I do with this plugin?
This plugin adds the necessary lines to the virtual robots.txt file that WordPress creates automagically to block the Common Crawl bot (CCBot) is used to train AI algorithms like ChatGPT to crawl websites.
What ideas is this plugin based on?
Our plugin to block the OpenAI ChatGTP bot after the launch of the OpenAI ChatGPT plugins that crawl websites.
What is the robots.txt file?
The robots.txt file is a plain text file located at the root folder of a domain (or subdomain) which tells web crawlers (like Googlebot) what parts of the website they should access and index.
The first thing a search engine crawler looks at when it is visiting a page is the robots.txt file and it controls how search engine spiders see and interact with the web pages.
System requirements
PHP version 7.4 or greater.
We require 7.4 or higher because we believe that everybody should be running a modern PHP version. When releasing this plugin WordPress recommends PHP 7.4 or higher. We would recommend 8.0 or higher as 7.4 has no security updates since 28 Nov 2022.
How to get this plugin in your Language!
The first release is avaliable in English and Spanish. In the “languages” folder we have included the necessary files to translate this plugin.
If you would like the plugin in your language and you’re good at translating, please use the native WordPress Translation functionality.
New to Translating a plugin? First read through the Translator Handbook, then select your locale at Translating WordPress and finally go to the translation page for this plugin to translate it.
Further Reading
You can access the description of the plugin in Spanish at: Block Common Crawl bot (CCBot) via robots.txt en español.
Contact
For further information please send us an email.
