The HuskyScout blog
Field notes on SEO and AI searchability: how answer engines pick sources, what the machine-readability files actually do, and how to measure any of it. Every post follows the same rules our content engine enforces.
AI crawlers and robots.txt: which bots to allow
Allow the search and live-fetch crawlers (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User) if you want to.
2026-08-16
llms.txt: what it is and what it actually does
llms.txt is a markdown file at the root of your domain that tells AI agents what your site is and which pages matter. It was [proposed by Jeremy Howard of.
2026-08-16
How to check whether AI answers mention your brand
Ask the questions your buyers ask, in the AI products they use, and record three things per answer: whether your brand is named, whether your domain is.
2026-08-16