🤖 Pro Feature

Which AI systems read
your llms.txt?

Prove your AI optimization is working: see live which AI crawlers – GPTBot, ClaudeBot, PerplexityBot – are already fetching your llms.txt. With date, frequency and history back to the very first hit – by day, week or month. Set up once, monitor continuously. Guide: set up AI bot tracking in 3 steps →

✓ One-time setup
✓ 13 AI crawlers tracked
✓ History: day · week · month
Step 9 / 9 · AI Tracking← Submit·✓ Flow complete
⚡ Generate llms.txt first → 📡 Submit to AI Indexers 🔑 Get Pro License – Unlock Tracking
✦ PRO FEATURE PREVIEW

Since April 2026, the bot tracking dashboard offers four analysis tabs. Here are all four – with real data from solar-autark.com:

Tab 1: History – period freely selectable (7 days back to the first hit), shown by day, week or month

Stacked bars show daily which AI systems accessed the llms.txt. The tracked domain appears as a badge in the chart title:

📈 History
🤖 Bot Comparison
📥 Export
Requests per day – March 28 to April 9, 2026 solar-autark.com
10 7 4 1 28.03. 01.04. 04.04. 06.04. 09.04. PerplexityBot (12) ChatGPT-User (2) Applebot (1) Meta-ExternalAgent (1) Bytespider (1)
Tab 1: History · solar-autark.com · 17 recorded requests · 5 AI systems · Mar 28 – Apr 9, 2026

History: switching period and view

Line charts show crawl patterns over time. PerplexityBot was active 10 times in a single run (March 28) – then only sporadically. ChatGPT-User first appears in April:

📈 History
🤖 Bot Comparison
📥 Export
7 Tage 14 Tage 30 Tage 90 Tage
10 7 4 1 26.03. 01.04. 04.04. 07.04. 10.04. PerplexityBot (peak: Mar 28) ChatGPT-User (from April) Applebot (one-time)
History · 14-day view · PerplexityBot peak Mar 28 (10 requests), ChatGPT-User first on Apr 4

Tab 2: Bot Comparison

Horizontal bars for all detected AI crawlers, sorted by activity. Grey: known systems not yet detected:

📈 History
🤖 Bot Comparison
📥 Export
🟣 PerplexityBot
12
🟢 ChatGPT-User
2
🍎 Applebot
1
🔵 Meta-ExternalAgent
1
🟡 Bytespider
1
Not yet detected
🔵 GPTBot 🤖 ClaudeBot 🔎 Google-Extended 🦊 Amazonbot 🧲 Diffbot
Tab 2: Bot Comparison · PerplexityBot leads with 12 of 17 requests · GPTBot and ClaudeBot not seen yet

Tab 3: CSV Export

One click exports daily raw data as CSV – here is an excerpt of documented requests on solar-autark.com:

📈 History
🤖 Bot Comparison
📥 Export
bot-stats-solar-autark-2026-04-13.csv
Date,Total,PerplexityBot,ChatGPT-User,Applebot,Meta-ExternalAgent,Bytespider
2026-03-28,10,10,0,0,0,0
2026-03-29,0,0,0,0,0,0
...
2026-04-01,1,0,0,1,0,0
2026-04-04,2,0,2,0,0,0
2026-04-05,1,0,0,0,1,0
2026-04-06,1,1,0,0,0,0
2026-04-07,1,1,0,0,0,0
2026-04-09,1,0,0,0,0,1
— Total: 17 requests in 14 days —

UTF-8, comma-separated · One row per day · Columns: Total + per bot

Tab 3: CSV Export · real raw data solar-autark.com · 14-day export · 17 requests recorded
🔑 Pro feature: Selectable periods (back to the first recorded hit), Bot Comparison and CSV Export are available for Pro and Agency licenses. The history view is available for all registered domains after login.
📊 Open Bot Analytics → 🔑 View Pro Plans

Real data from solar-autark.com · Example for your website after license activation

✦ PRO FEATURE PREVIEW
llmstxtgenerator.de/tools/bot-stats/
✓ Pro active
–
llms.txt Requests
Visible after login
–
AI Systems
With min. 1 request
1
Domain
In this license
📈 History
🤖 Bot Comparison
📥 Export
Requests – selectable period, by day / week / month your-domain.com
12 9 6 3 03-14 03-19 03-25 04-01 04-07 04-13 GPTBot / ChatGPT ClaudeBot PerplexityBot
🔒 Access for Pro and Agency licenses only Get Pro License →

Preview with sample data · Real data after license activation

No Pro yet? View Pro plan →

🌐 Domain (once, for registration)
The domain where the snippet is installed. Links it to your license – only needed once.
📋 Set up Tracking – .htaccess Snippet One-time setup for new users

Add once at the end of your .htaccess file. AI bots will be logged and receive your llms.txt unchanged.

# AI-Bot Tracking – llmstxtgenerator.de
<IfModule mod_rewrite.c>
  RewriteEngine On
  RewriteCond %{HTTP_USER_AGENT} "(GPTBot|ChatGPT|ClaudeBot|anthropic|PerplexityBot|Google-Extended|Meta-ExternalAgent|Applebot|YouBot|cohere|Diffbot|Amazonbot|bingbot)" [NC]
  RewriteRule ^llms(-full)?\.txt$ https://llmstxtgenerator.de/api/bot-tracker.php?action=site&site=%{HTTP_HOST}&path=%{REQUEST_URI} [R=302,L]
</IfModule>
📁 Where to add? At the end of your .htaccess in the root directory (where index.php is). Gambio, Shopware, WooCommerce already have one. FTP: enable “Show hidden files”.
⚙️ What happens next? Known AI bots are briefly redirected to our server, the visit is logged, then the llms.txt is delivered unchanged. Nothing changes for regular visitors or Google.

Requires: Apache with mod_rewrite (standard at IONOS, Hetzner, Strato, All-Inkl). New visits appear with up to 1 hour delay.

What this tool does not show: Only direct llms.txt requests by known AI crawlers are logged – no general traffic, no proof that AI systems use your content.

Loading statistics…

📭

License active – no domain registered yet

Enter your domain above and click "Load stats". Once the snippet is active and an AI crawler visits, data will appear here.

Open Generator