# robots.txt for https://cheapcannabiscard.com # Affordable medical marijuana card evaluations, renewals, and doctors. # # Policy: OPEN. Every legitimate crawler is welcome - traditional search # engines, SEO tools, AI search/retrieval crawlers, AND AI training crawlers. # We want to be indexed for classic Search AND cited by AI answer engines. # # Note: robots.txt groups do NOT inherit. Each named group below is allowed # explicitly so there is zero ambiguity for any operator that reads its own # user-agent group first. # =========================================== # DEFAULT - all crawlers, full access # =========================================== User-agent: * Allow: / # =========================================== # AI SEARCH / RETRIEVAL CRAWLERS (drive citations + referral traffic) # =========================================== User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # =========================================== # AI TRAINING CRAWLERS (allowed - we want broad model coverage) # =========================================== User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: CCBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Bytespider Allow: / # =========================================== # SITEMAP # =========================================== Sitemap: https://cheapcannabiscard.com/sitemap.xml