# Allow all search engines User-agent: * Allow: / # Explicitly allow AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / # Point to sitemap Sitemap: https://mindspo.com/sitemap.xml # Internal analytics dashboard, not for indexing User-agent: * Disallow: /quiz-metrics Disallow: /ade-data Disallow: /beforewespeak Disallow: /quiz/ Disallow: /ceiling-backup Disallow: /qualified-backup Disallow: /teachertraining-gpt Disallow: /mrtc-curriculum-backup Disallow: /tt-future Disallow: /free-data Disallow: /enrollment-offer