AIBOT Acunetix AfD-Verbotsverfahren BDFetch BatchFTP BlackWidow Boardreader BuiltBotTough CazoodleBot Chlooe Cocolyzebot CopyRightCheck Crawling at Home Project Crescent CyotekWebCopy DSearch Disco DomCopBot DomainCrawler EMail Siphon Evil FacebookBot GetWeb Gotit GrabNet Grafula GrapeFX GrapeshotCrawler Harvest HonoluluBot IDBot Iblog InfoTekies Internet Ninja JustView LinksManager Lipperhey Spider MQQBrowser MSIECrawler Magnet Majestic12 MegaIndex.ru MicroMessenger Mister PiX NICErsPRO NetLyzer Nimbostratus Openfind Openvas OutfoxBot PHPCrawl PageGrabber Pavuk Petalbot Picscout PictureFinder PxBroker PyCurl RSSingBot RankingBot ReGet RedesScrapy SEOstats SISTRIX SalesIntelligent Scanbot ScoutJet ScreenerBot Seomoz Sitebeam Sosospider TightTwatBot Typhoeus Vacuum VelenPublicWebCrawler VeriCiteCrawler Voil WWWOFFLE WallpapersHD Web Sauger WebPix WebSucker Website Quester Webster Xaldon WebSpider YoudaoBot Zermelo ZmEu anthropic-ai arquivo.pt clark-crawler demandbase-bot facebookscraper linkfluence scalaj-http scan.lol seoscanners sexsearcher ubermetrics-technologies.com zauba.io