404enemy
ADmantX
AIBOT
ALittle Client
AhrefsBot
Anarchy
Anarchy99
Anthill
Asterias
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Bandit
Battleztar Bazinga
Black Hole
BlackWidow
Blow
BlowFish
Boardreader
Brandprotect
Buck
BuiltWith
BunnySlippers
BuzzSumo
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Citoid
Claritybot
Cloud mapping
Copier
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
DTS Agent
DataCha0s
Deusu
Devil
Dirbuster
Discobot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Dragonfly
Drip
ECCP/1.0
Ecxi
Evil
Fimap
Foobot
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Grabber
Grafula
Haansoft
Heritrix
Hloader
Humanlinks
IDBot
Iblog
Image Fetch
Image Sucker
InfoNaviRobot
Internet Ninja
Iria
JennyBot
JetCar
Joomla
Jorgee
Jyxobot
Kozmosbot
LNSpiderguy
LexiBot
Lftp
Libwhisker
Lightspeedsystems
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
MegaIndex.ru
Minefield
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
Navroad
Net Vampire
NetAnts
Netcraft
Nettrack
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Nutch
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Pandalytics
Panscient
PeoplePal
Petalbot
Picsearch
PictureFinder
Pimonster
Pixray
Pockey
ProPowerBot
Probethenet
Psbot
PyCurl
Quick-Crawler
RankFlex
ReGet
RebelMouse
Ripper
RocketCrawler
SBIder
SEOprofiler
SISTRIX
SalesIntelligent
ScrepyBot
Semrush
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
SlySearch
SmartDownload
Snapbot
Sociscraper
Sosospider
Sottopop
SpankBot
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
T8Abot
Telesoft
Toata
Toweyabot
True_Robot
Turnitin
TwengaBot
Twice
URLy Warning
URLy.Warning
VB Project
VCI
Vagabondo
Virusdie
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Fuck
Web Pix
Web Sauger
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whack
WinHTTrack
WiseGuys Robot
Wonderbot
Zade
Zitebot
ZmEu
ZoomBot
ZoominfoBot
arquivo-web-crawler
backlink-check
clark-crawler
cognitiveseo
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
gopher
heritrix
internetVista monitor
lwp-trivial
oBot
page scorer
ripz
s1z.ru
scalaj-http
seobility
seocompany.store
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
xpymep1.exe
zauba.io
zgrab