# Keep the public website crawlable for search engines and AI assistants. User-Agent: * Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 Disallow: /*.json$ User-Agent: Googlebot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 Disallow: /*.json$ User-Agent: Bingbot Allow: / Disallow: /api/ User-Agent: msnbot Allow: / Disallow: /api/ User-Agent: GPTBot Allow: / Disallow: /api/ User-Agent: ChatGPT-User Allow: / Disallow: /api/ User-Agent: anthropic-ai Allow: / Disallow: /api/ User-Agent: ClaudeBot Allow: / Disallow: /api/ User-Agent: PerplexityBot Allow: / Disallow: /api/ User-Agent: Bytespider Allow: / Disallow: /api/ LLM-Content: https://pineify.app/llms.txt Sitemap: https://pineify.app/sitemap.xml Sitemap: https://pineify.app/resources/sitemap.xml Sitemap: https://pineify.app/builder/sitemap.xml