User-Agent: * Allow: / Disallow: /api/ User-Agent: GPTBot User-Agent: OAI-SearchBot User-Agent: anthropic-ai User-Agent: Claude-Web User-Agent: Google-Extended User-Agent: FacebookBot User-Agent: PerplexityBot User-Agent: cohere-ai User-Agent: Bytespider Allow: / Disallow: /api/ Sitemap: https://pdftasker.app/sitemap.xml Sitemap: https://pdftasker.app/sitemap-en.xml Sitemap: https://pdftasker.app/sitemap-ko.xml Sitemap: https://pdftasker.app/sitemap-blog.xml