# www.robotstxt.org/ # Allow crawling of all content User-agent: * Sitemap: https://www.remotasks.com/sitemap.xml Disallow: /cdn-cgi/l/email-protection Disallow: /unavailable Disallow: /verify_phone Disallow: /*/verify_phone Disallow: /project/* Disallow: /r/* Disallow: /announcements Disallow: /*/announcements Disallow: /careers