# Search engines and AI crawlers User-agent: * User-agent: OAI-SearchBot User-agent: GPTBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User Allow: / # Public content endpoints required for rendering Allow: /api/blogs Allow: /api/db/blogs/ Allow: /api/db/pf-properties/ Allow: /api/pf/ # Administration, private and utility routes Disallow: /api/ Disallow: /cms/ Disallow: /admin/ Disallow: /private/ Disallow: /thank-you Disallow: /sw.js Disallow: /manifest.json Disallow: /browserconfig.xml # Main sitemap index Sitemap: https://www.ushre.com/sitemap.xml # Individual XML sitemaps Sitemap: https://www.ushre.com/sitemap-core.xml Sitemap: https://www.ushre.com/sitemap-listings.xml Sitemap: https://www.ushre.com/sitemap-communities.xml Sitemap: https://www.ushre.com/sitemap-developers.xml Sitemap: https://www.ushre.com/sitemap-blog.xml