內容簡介
ADG Markdown for AI Crawlers 外掛專為處理 AI 爬蟲而設計，當爬蟲請求您的文章或頁面時，將返回乾淨的 Markdown 格式內容，保持網站的正常顯示，並生成內容索引以供 AI 工具使用。
【主要功能】
• 檢測 AI 爬蟲並返回 Markdown 格式內容
• 生成 llms.txt 和 llms-full.txt 內容索引
• 支援 WooCommerce 產品及自訂分類
• 可配置 YAML 前置資料
• 自動快取轉換後的 Markdown
• 提供「隱藏於 AI 爬蟲」選項
外掛標籤
開發者團隊
② 後台搜尋「ADG Markdown for AI Crawlers」→ 直接安裝（推薦）
原文外掛簡介
When a known AI crawler (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and others) requests one of your posts or pages, this plugin returns clean Markdown of the main content on the same URL instead of the full theme HTML — no header, footer, sidebar or scripts. Regular visitors keep seeing your normal site.
It also generates llms.txt and llms-full.txt — a sitemap-style index of your content for AI tools — served at /llms.txt and /llms-full.txt. These are kept in sync as real files at your site root as a fallback for hosts that block the virtual route before WordPress runs, so the files stay available even there.
What it does
Detects AI crawlers by User-Agent (the list is editable in the settings).
Serves clean Markdown on the same URL with Content-Type: text/markdown, Vary: User-Agent and X-Robots-Tag: noindex.
Works with any public post type — including WooCommerce products — plus a Markdown index for category, tag and custom-taxonomy archives.
Configurable YAML front matter (title, url, date, author, tags, canonical) with per-field toggles.
Include your own custom fields / ACF values in the front matter.
Adds machine-readable Schema.org JSON-LD (title, dates, author, cover image, publisher).
Generates /llms.txt and /llms-full.txt, with an on-disk fallback file for hosts that block the virtual route.
Caches the converted Markdown in post meta for fast responses; the cache is cleared automatically when a post is edited.
Plays nice with page caches: sets DONOTCACHEPAGE (WP Rocket, W3 Total Cache, WP Super Cache, LiteSpeed) so bots are never served a stale HTML cache.
Exclude content with a per-post “Hide from AI bots” checkbox or by category/tag slug.
“View Markdown” link in the editor and post list — preview exactly what crawlers receive.
Privacy and external services
The Markdown/llms.txt generation itself does not connect to any external service, send any data off your site, or load any remote scripts — all content processing happens on your own server.
This plugin uses the Freemius SDK for licensing. If you choose to enable premium features with a license key, the plugin connects to the Freemius API (freemius.com) to validate your license and enable the paid functionality. This connection is opt-in: it is only made if you enter a license key, and no license or plan data is required to use the free feature set described above. See the Freemius privacy policy for details on what limited data is shared with Freemius during opt-in and licensing.
Good to know
No required .htaccess edits and no Composer — a built-in, zero-dependency HTML→Markdown converter is included. An optional, one-click .htaccess fix is available if your host blocks /llms.txt (see Settings → AI Bots & Markdown).
Does not interfere with SEO plugins, caches, or WooCommerce shop/cart/checkout pages.
Private, password-protected and unpublished content is never served to bots — access rights are not bypassed.
Pro version
A Pro version is available with bot IP verification (anti-spoofing), bot-visit analytics with CSV export, a one-click self-test, and priority support. See the plugin’s settings page for details. The free version is fully functional on its own and is not time-limited.
