Publishers
Steer AI systems toward your best evergreen explainers.
← Back to features
Feature
Robots, bots & llms.txt
Tune robots.txt, block AI trainers, and publish llms.txt.
Seofyme enhances robots.txt, can discourage AI training crawlers via Bot Blocker, and publishes /llms.txt from cornerstone and recent pages so AI systems can understand your preferred content.
Highlights
- robots.txt enhancements
- AI trainer crawler disallows
- Public /llms.txt endpoint
- Cornerstone-aware llms content
Crawl control and AI clarity
Classic robots rules still matter. llms.txt adds a modern signal for which pages you want language models to prioritize.
Protect training preferences
Bot Blocker helps express disallow rules for known AI training user-agents in robots.txt.
How it works
- 1
Review robots settings
Confirm Seofyme’s robots enhancements match your crawl strategy.
- 2
Configure Bot Blocker
Disallow AI trainers you do not want.
- 3
Check /llms.txt
Visit the endpoint and refine cornerstone selections.
Where it shines
SaaS docs
Publish a clean machine-readable content map.
Privacy-conscious brands
Reduce unwanted training crawler access via robots rules.
Frequently asked questions
- What is llms.txt?
- A public text file that highlights preferred pages for AI systems; Seofyme generates it for you.
- Will this block Googlebot?
- No. Bot Blocker targets AI training crawlers you configure — not normal search indexing.
Related features
All featuresReady to use this on your WordPress site?
Download Seofyme SEO free for local SEO. Add Seofyme Cloud only if you want hosted title & meta generation or hosted audits — billed through CacheRocket.