# robots.txt for eandjfurniture.com # Crawler policy and the reasoning behind it: docs/crawler-access.md # # Search and answer-engine crawlers (Googlebot, Bingbot, OAI-SearchBot, # Claude-SearchBot, PerplexityBot, Applebot) are allowed by the "*" group # below. User-initiated fetchers (ChatGPT-User, Claude-User, Perplexity-User) # act for a person and may not consult robots.txt at all. # Do not give any of them a group of its own: a crawler that finds a group # naming it stops reading "*", so a later rule added to "*" would silently # stop applying to it. User-agent: * Allow: / # Model training and AI grounding: ALLOWED. E and J Furniture decided on # 2026-09-12 that AI companies may train on the site, so these crawlers # follow "*". To opt out later, uncomment the block below. That stops # OpenAI, Anthropic and Apple training on # the site, Gemini Apps and Vertex AI grounding answers in it # (Google-Extended), Meta using it for AI training or product indexing # (meta-externalagent), and Common Crawl archiving it (CCBot). It does not # affect Google Search or AI Overviews, Apple search, ChatGPT search (GPTBot is # separate from OAI-SearchBot), Claude search or Perplexity search. # # User-agent: GPTBot # User-agent: ClaudeBot # User-agent: Google-Extended # User-agent: Applebot-Extended # User-agent: CCBot # User-agent: meta-externalagent # Disallow: / Sitemap: https://eandjfurniture.com/sitemap-index.xml