# Allow all crawlers User-agent: * Allow: / # Sitemap location (auto-generated by Astro) Sitemap: https://taxomate.com/sitemap-index.xml # Disallow private/app areas (not part of marketing site) Disallow: /admin/ Disallow: /api/ Disallow: /private/ Disallow: /account/ Disallow: /dashboard/ # AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: Anthropic-AI Allow: /