🤖 Pro Feature

Which AI systems read
your llms.txt?

Prove your AI optimization is working: see live which AI crawlers – GPTBot, ClaudeBot, PerplexityBot – are already fetching your llms.txt. With date, frequency and history back to the very first hit – by day, week or month. Set up once, monitor continuously. Guide: set up AI bot tracking in 3 steps →

✓ One-time setup
✓ 21 AI crawlers tracked
✓ History: day · week · month
Step 9 / 9 · AI Tracking← Submit·✓ Flow complete
⚡ Generate llms.txt first → 📡 Submit to AI Indexers 🔑 Get Pro License – Unlock Tracking
✦ PRO FEATURE PREVIEW

The dashboard has three analysis tabs: History, Bot Comparison and Export. The preview shows all three with the real requests for the llms.txt and llms-full.txt of llmstxtgenerator.de – tracked since March 12, 2026, as of Oct 8, 2026.

Tab 1: History – period selectable (7 days, 30 days, 90 days, 12 months or everything since tracking began), shown by day, week or month. Stacked bars show the six most active crawlers in the period; the rest appears as “Other”.

Since March 12, 2026 there were 114 requests from 10 crawlers – 54 for llms.txt, 59 for llms-full.txt. March is the busiest month: on the first day of tracking, GPTBot, ClaudeBot and PerplexityBot fetched the files 12 times combined. Bingbot (Bing/Copilot) is the most frequent visitor with 49 requests (43%), but last came by on June 18, 2026.

📈 History
🤖 Bot Comparison
📥 Export
7 d30 d90 d12 mAll
DayWeekMonth
Requests per month – March to October 2026 llmstxtgenerator.de
0 12.5 25 37.5 50 47 Mar 26 13 Apr 26 14 May 26 8 Jun 26 15 Jul 26 5 Aug 26 11 Sep 26 1 Oct 26 bingbot (49) GPTBot (15) Bytespider (11) ClaudeBot (11) PerplexityBot (10) Amazonbot (7) Other (11)
Tab 1: History · “All” view by month · llmstxtgenerator.de · 114 requests · 10 crawlers · Mar 12 – Oct 8, 2026

History: switch period and view

The same data for the last 90 days (Jul 11 – Oct 8, 2026), by calendar week. The picture has shifted: of the 27 requests, 10 came from Bytespider (ByteDance), 5 from ClaudeBot, 4 from Amazonbot, 3 each from GPTBot and Applebot, and 2 from CCBot. Bingbot and PerplexityBot do not appear in this period – PerplexityBot was last seen on March 16, 2026. Most recent request: Applebot on October 2, 2026.

📈 History
🤖 Bot Comparison
📥 Export
7 d30 d90 d12 mAll
DayWeekMonth
0 1.2 2.5 3.8 5 1 Wk 28 5 Wk 29 1 Wk 30 3 Wk 31 Wk 32 3 Wk 33 2 Wk 34 Wk 35 4 Wk 36 4 Wk 37 1 Wk 38 2 Wk 39 1 Wk 40 Wk 41 Bytespider (10) ClaudeBot (5) Amazonbot (4) Applebot (3) GPTBot (3) CCBot (2)
History · 90 days by calendar week · Jul 11, 2026 – Oct 8, 2026 · 27 requests

Tab 2: Bot Comparison

Horizontal bars for every detected crawler, sorted by requests. Below: the 13 known systems that have not shown up yet:

📈 History
🤖 Bot Comparison
📥 Export
🪟 Bing / Copilot
49
🤖 ChatGPT / GPTBot
15
🎵 TikTok / Bytedance AI
11
🧠 Claude (Crawler)
11
🔮 Perplexity AI
10
📦 Amazon Alexa AI
7
🍎 Apple Search
4
✨ Google AI Other
4
🌐 Common Crawl
2
✨ Google Gemini / Bard
1
Not seen yet
🤖 ChatGPT Browsing🔍 OpenAI SearchBot🧠 Claude.ai Browsing🧠 Anthropic AI🔍 Googlebot🦙 Meta AI🦙 Meta AI (Facebook)🍎 Apple Intelligence🪟 MSN / Copilot🔍 You.com AI🤖 Cohere AI🕷️ Diffbot🤖 Timpi AI
Tab 2: Bot Comparison · since Mar 12, 2026 · bingbot 49, GPTBot 15, ClaudeBot and Bytespider 11 each of 114 requests

Tab 3: CSV Export

One click exports daily raw data as CSV – for the period selected in History, or for 30 days, 90 days or 12 months. Here is the 30-day export, days without requests hidden:

📈 History
🤖 Bot Comparison
📥 Export
📥 CSV: selected period30 days90 days12 months
bot-stats-2026-09-09_2026-10-08.csv
Datum,Gesamt,Applebot,Bytespider,GPTBot
2026-09-10,1,0,1,0
2026-09-20,1,1,0,0
2026-09-22,1,0,0,1
2026-09-24,1,0,0,1
2026-10-02,1,1,0,0
… 25 days without requests hidden
— Total: 5 requests in 30 days —

UTF-8, comma-separated · one row per day · columns: total + one per crawler

Tab 3: CSV Export · 30 days up to Oct 8, 2026 · 5 requests
🔑 Pro feature: Selectable periods (back to the first recorded hit), Bot Comparison and CSV Export are available for Pro and Agency licenses. The history view is available for all registered domains after login.
📊 Open Bot Analytics → 🔑 View Pro Plans

Real data from llmstxtgenerator.de · as of Oct 8, 2026 · your domain appears the same way after license activation

No Pro yet? View Pro plan →

🌐 Domain (once, for registration)
The domain where the snippet is installed. Links it to your license – only needed once.
📋 Set up Tracking – .htaccess Snippet One-time setup for new users

Add once at the top of your .htaccess – before the rules of your shop or CMS. AI bots will be logged and receive your llms.txt unchanged.

# AI-Bot Tracking – llmstxtgenerator.de
<IfModule mod_rewrite.c>
  RewriteEngine On
  RewriteCond %{HTTP_USER_AGENT} "(GPTBot|ChatGPT-User|OAI-SearchBot|ClaudeBot|Claude-User|anthropic-ai|PerplexityBot|Google-Extended|GoogleOther|Meta-ExternalAgent|FacebookBot|Applebot|YouBot|cohere-ai|Diffbot|Amazonbot|Bytespider|CCBot|bingbot|msnbot|Timpibot)" [NC]
  RewriteRule ^llms(-full)?\.txt$ https://llmstxtgenerator.de/api/bot-tracker.php?action=site&site=%{HTTP_HOST}&path=%{REQUEST_URI} [R=302,L]
</IfModule>
📁 Where to add? At the top of your .htaccess in the root directory (where index.php is), before the rules of your shop or CMS. Gambio, Shopware, WooCommerce already have one. FTP: enable “Show hidden files”. On WordPress/WooCommerce, place it before the line # BEGIN WordPress – not inside the block, WordPress overwrites it, and not after it, where the snippet no longer reaches the llms.txt. After shop or CMS updates, check that the snippet is still there.
⚙️ What happens next? Known AI bots are briefly redirected to our server, the visit is logged, then the llms.txt is delivered unchanged. Nothing changes for regular visitors or Google.

Requires: Apache with mod_rewrite (standard at IONOS, Hetzner, Strato, All-Inkl). New visits appear with up to 1 hour delay.

What this tool does not show: Only direct llms.txt requests by known AI crawlers are logged – no general traffic, no proof that AI systems use your content.

Loading statistics…

📭

License active – no domain registered yet

Enter your domain above and click "Load stats". Once the snippet is active and an AI crawler visits, data will appear here.

Open Generator