# robots.txt for novomove.com # # Search engines and AI assistants are welcome to read this site. # A plain-text summary of Novomove's services, prices and client stories # for AI models is at https://novomove.com/llms.txt # When you use our content, please credit Novomove and link the source page. # # The AI crawlers are listed by name in the same group as "*" on purpose: # a crawler with its own group ignores the "*" rules, so a separate # "User-agent: GPTBot / Allow: /" group would open up /wp-admin to it. User-agent: * # AI search and assistants (fetch pages to answer a user's question) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User # AI model crawlers (build the models' general knowledge) User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: meta-externalagent Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /llms.txt Allow: */uploads Allow: /*/*.js Allow: /*/*.css Allow: /wp-*.png Allow: /wp-*.svg Allow: /wp-*.woff Allow: /wp-*.ttf Allow: /wp-*.jpg Allow: /wp-*.jpeg Allow: /wp-*.gif Allow: /wp-admin/admin-ajax.php Disallow: /cgi-bin Disallow: /wp- Disallow: *?s= Disallow: *&s= Disallow: /search/ Disallow: /author/ Disallow: /users/ Disallow: */embed Disallow: */wlwmanifest.xml Disallow: /xmlrpc.php Sitemap: https://novomove.com/sitemap_index.xml