404enemy ADmantX Abonti AfD-Verbotsverfahren Anthill AwarioBot BackStreet Badass Bandit Bitacle Bolt Brandprotect Bullseye CazoodleBot ChinaClaw Cliqzbot Copier Crawling at Home Project Dotbot Dragonfly Ecxi FHscan Fimap Freeuploader FrontPage IndeedBot Iria JOC Web Spider LNSpiderguy LeechFTP LeechGet Lipperhey Spider MFC_Tear_Sample MIIxpc Majestic12 Microsoft Data Access Minefield Moblie Safari Nameprotect NetMechanic Nettrack Nimbostratus OpenVAS OutclicksBot POE-Component-Client-HTTP PeoplePal Picscout Piepmatz Pixray Probethenet Pu_iN QueryN Metasearch Rainbot RankingBot ReGet Recorder Rogerbot SEOkicks SalesIntelligent Searchestate SemrushBot-OCOB SentiBot SeoCherryBot SiteAuditBot SiteExplorer SiteSucker Sottopop SpankBot Sqlworm Stripper SurveyBot TeleportPro Telesphoreo Toata TurnitinBot VB Project Voltron WWW-Mechanize Web Fuck Web Pix Web Sucker WebAuto WebFetch WebImageCollector WebReaper WebSauger WebsiteExtractor Webster Woobot ZumBot ZyBorg backlink-check com.plumanalytics crawler.feedback crawler4j isitwp.com omgili webgains-bot x22Mozilla zauba.io