# BLEXBot (http://webmeup-crawler.com) User-Agent: BLEXBot Disallow: / # Common Crawl (https://commoncrawl.org) User-agent: CCBot Disallow: / # Facebook (https://developers.facebook.com/docs/sharing/bot) User-agent: FacebookBot Disallow: / # Google (https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers) User-agent: Google-Extended Disallow: / # Omgilibot (https://webz.io/blog/web-data/what-is-the-omgili-bot-and-why-is-it-crawling-your-website/) User-agent: Omgilibot Disallow: / # OpenAI (https://platform.openai.com/docs/gptbot) User-agent: GPTBot Disallow: / # OpenAI (https://platform.openai.com/docs/plugins/bot/chatgpt-user) User-agent: ChatGPT-User Disallow: / # NameProtect (http://www.nameprotect.com/botinfo.html) User-Agent: NPBot Disallow: / # Turnitin (http://www.turnitin.com/robot/crawlerinfo.html) User-Agent: TurnitinBot Disallow: / # iThenticate (https://www.ithenticate.com) User-Agent: SlySearch Disallow: /