404checker
404enemy
ADmantX
AIBOT
ASPSeek
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchie
Anarchy99
Ankit
Aspiegel
Asterias
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BackStreet
BackWeb
Badass
Barkrowler
Bitacle
Black Hole
Blackboard
Blow
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
CazoodleBot
CensysInspect
CherryPicker
Chlooe
Craftbot
Custo
CyotekWebCopy
DataCha0s
Demon
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
EMail Wolf
EasyDL
Evil
ExtractorPro
FHscan
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GermCrawler
Gigabot
Gotit
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
HaosouSpider
Havij
IDBTE4M
IRLbot
Id-search
Image Sucker
Intelliseek
Internet Ninja
InternetSeer
Iria
IstellaBot
JennyBot
JetCar
Joomla
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LNSpiderguy
LexiBot
LieBaoFast
Likse
Litemage_walker
Ltx71
MIDown tool
MTRobot
Magnet
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Mata Hari
MauiBot
MegaIndex.ru
Metauri
MicroMessenger
Minefield
Mojeek
Morfeus Fucking Scanner
NPbot
Nessus
NetLyzer
NetMechanic
NetZIP
Nettrack
Nibbler
Niki-bot
Nimbostratus
Nmap
Nutch
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PageGrabber
PageScorer
PageThing.com
Panscient
Papa Foto
PeoplePal
Petalbot
Picsearch
PictureFinder
Pimonster
PleaseCrawl
ProWebWalker
Probethenet
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
Rankivabot
ReGet
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
ScanAlert
Scanbot
Scrapy
ScreenerBot
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Snapbot
Sociscraper
SpankBot
Spinn3r
Sqlworm
Steeler
Stripper
SuperBot
SuperHTTP
Suzuran
Swiftbot
Teleport
Telesoft
Trendiction
Trendictionbot
Turingos
TwengaBot
Twice
URLy.Warning
Vacuum
VelenPublicWebCrawler
VidibleScraper
WBSearchBot
WISENutbot
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Fuck
Web Sucker
WebEnhancer
WebFuck
WebLeacher
WebReaper
WebWhacker
Webalta
WebsiteQuester
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Zade
Zauba
Zeus
Zitebot
ZmEu
ZoominfoBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-request
muhstik-scan
oBot
polaris version
seobility
seoscanners
seostar
serpstatbot
sexsearcher
sp_auditbot
sysscan
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab