內容簡介
CrawlBoost 是一款診斷工具，專注於提升搜尋引擎爬蟲訪問網站的效率。它提供多項檢測功能，幫助使用者識別並修正網站的問題，而不會修改 XML 網站地圖、robots.txt 或其他 SEO 設定。
【主要功能】
• 爬蟲健康監控：記錄每個 URL 的狀態碼及反應時間
• HTTP 驗證審核：檢查頁面是否正確返回 304 Not Modified
• 軟 404 和狀態完整性掃描：找出錯誤的 HTTP 200 頁面
• URL 浪費雷達：標記浪費爬蟲預算的 URL
• IndexNow 變更通知：即時通知搜尋引擎頁面變更
外掛標籤
開發者團隊
原文外掛簡介
CrawlBoost is a diagnostics layer, not another SEO plugin. It measures how efficiently search-engine crawlers can reach your site and tells you what to fix — but it never modifies your XML sitemap, robots.txt, canonical tags, or meta robots. That means it works alongside Yoast, Rank Math, SEOPress, or All in One SEO instead of fighting them.
Free features
Crawl Health Monitor — a low-volume, resource-safe sample crawl recording each URL’s status code, response time, redirects, and size, rolled into a green/amber/red health status.
HTTP Validator Audit — checks whether unchanged pages return 304 Not Modified to conditional requests (ETag / Last-Modified). This is the crawl-efficiency lever Google highlighted in its July 2026 guidance. Audit only — it never forces 304 responses.
Soft-404 & Status Integrity Scan — finds pages that return HTTP 200 but read like missing pages, and audits your existing sitemap for URLs that resolve to 3xx/4xx/5xx.
URL Waste Radar — flags tracking, filter, session, and feed URLs in your content that can waste crawl budget. Detection only; it names which system owns each fix.
IndexNow Change Notifications — instantly tells Bing, Yandex, Seznam, Naver, and Yep when you publish, update, or delete a page. Automatically stays off when your SEO plugin already provides IndexNow, to avoid duplicate submissions.
Every finding shows the tested URL, the response, why it may matter, and which system owns the fix — because CrawlBoost reports, it doesn’t change your site.
Pro features (sold separately)
Full-site crawl and URL graph
Server access-log ingestion and crawler analysis
Historical trends and anomaly alerts
Deep parameter-cluster analysis
Multi-site and agency dashboards
WooCommerce change notifications
AI-assisted diagnosis (summarises measured evidence via the Claude API)
External services
This plugin connects to one external service, and only when the site owner explicitly enables it.
IndexNow (api.indexnow.org)
The plugin sends URL-change notifications to the IndexNow API so that participating search engines (Bing, Yandex, Seznam, Naver, Yep) are told immediately when a public page on your site is published, updated, or deleted. This service is only used when the site owner enables IndexNow on the CrawlBoost settings screen. When enabled, on each qualifying post transition or deletion the plugin sends a POST request to https://api.indexnow.org/indexnow containing: the site’s host, a plain-text key generated by the plugin, the public URL of the key verification file hosted on the same site, and the list of URLs that have changed. No visitor data, no personal data, and no post content is transmitted — only public URLs of the site’s own content. If IndexNow is not enabled, no requests are made.
IndexNow is a shared protocol operated by Microsoft and other participating search engines. See the IndexNow documentation and terms at https://www.indexnow.org/documentation and the Bing Webmaster / IndexNow terms of use at https://www.bing.com/webmasters/help/indexnow-8752a615 and privacy statement at https://privacy.microsoft.com/privacystatement .
