360Spider
404enemy
80legs
AIBOT
ALittle Client
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchy
Aspiegel
Asterias
Atomseobot
BBBike
BDCbot
BDFetch
Badass
Bandit
BatchFTP
BetaBot
Bigfoot
Bitacle
Black Hole
Blow
Bolt
BotALot
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
CCBot
Calculon
ChinaClaw
Citoid
Cliqzbot
Cogentbot
Copier
Cosmos
Crawling at Home Project
Crescent
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Deusu
Devil
DigitalPebble
Disco
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Evil
ExtractorPro
FDM
FemtosearchBot
Fimap
FlashGet
G-i-g-a-b-o-t
Genieo
Grafula
HTMLparser
HTTrack
Harvest
Havij
IDBTE4M
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Jetty
Jorgee
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LexiBot
Lightspeedsystems
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey
Lipperhey Spider
Litemage_walker
MIDown tool
MSFrontPage
MTRobot
Majestic-SEO
Masscan
Mb2345Browser
Metauri
Microsoft Data Access
Microsoft URL Control
Minefield
Msrabot
Name Intelligence
Nameprotect
Navroad
Needle
NetAnts
NetLyzer
NetMechanic
NetZIP
Ninja
Nmap
Not
Offline Navigator
OnCrawl
OpenVAS
Openfind
OrangeBot
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
Petalbot
Picscout
Picsearch
Pixray
Pockey
ProWebWalker
Pu_iN
QueryN Metasearch
RankFlex
Re-re
Reaper
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
ScanAlert
Scanbot
ScoutJet
ScreenerBot
SemanticJuice
SemrushBot
SeobilityBot
Seomoz
Shodan
SiteExplorer
SiteSucker
Siteimprove
Sitevigil
SlySearch
Snoopy
Sogou web spider
SpaceBison
Spammen
Spinn3r
Sqlworm
Sqworm
Steeler
Stripper
SuperHTTP
T8Abot
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
Typhoeus
URLy.Warning
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
WWW-Collector-E
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Pix
Web Sauger
WebCopier
WebFuck
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
WebZIP
Webalta
Whacker
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wprecon
YoudaoBot
Zauba
Zeus
ZmEu
ZoominfoBot
ZyBorg
crawler.feedback
crawler4j
domainsproject.org
evc-batch
heritrix
instabid
lwp-request
lwp-trivial
magpie-crawler
page scorer
polaris version
satoristudio.net
scalaj-http
seobility
seocompany.store
serpstatbot
sitechecker.pro
spyfu
tAkeOut
trendiction.com
webgains-bot
webprosbot
zauba.io
zgrab