404enemy
ASPSeek
Abonti
Aipbot
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Atomseobot
BDCbot
BDFetch
BLEXBot
BackStreet
BacklinkCrawler
Bandit
BatchFTP
Bigfoot
Bitacle
Blow
Bolt
Buck
Buddy
CODE87
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cliqzbot
Collector
Craftbot
Crescent
CrunchBot
Custo
DSearch
DatabaseDriverMysqli
Deusu
DigitalPebble
Dirbuster
Disco
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
Evil
ExtLinksBot
Extractor
EyeNetIE
FemtosearchBot
FlashGet
Flunky
FrontPage
Fuzz
Fyrebot
Genieo
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrapeshotCrawler
GridBot
HEADMasterSEO
Haansoft
Heritrix
Hloader
IDBot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Keyword Density
Kozmosbot
LNSpiderguy
LeechGet
LexiBot
LibWeb
Libwhisker
Likse
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MJ12bot
MTRobot
Mail.RU_Bot
Majestic SEO
MarkWatch
Mass Downloader
Masscan
Mata Hari
MauiBot
Minefield
Mister PiX
Moblie Safari
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
Nettrack
Niki-bot
Nikto
Nutch
Octopus
Offline Explorer
Offline Navigator
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Pi-Monster
Picscout
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Pu_iN
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankurBot
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SISTRIX
ScanAlert
Scanbot
Scrapy
Seekport
Semrush
Seomoz
Shodan
Site Sucker
SiteSnagger
SmartDownload
Snoopy
SocialRankIOBot
Sosospider
Sottopop
SpankBot
Spanner
Spbot
SputnikBot
Sucker
SurveyBot
T0PHackTeam
Teleport
TeleportPro
The Intraformant
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendictionbot
Turnitin
URLy Warning
URLy.Warning
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
WBSearchBot
WEBDAV
WISENutbot
WPScan
Web Auto
Web Fuck
Web Sucker
WebCopier
WebEnhancer
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteQuester
Who.is Bot
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
ZoominfoBot
ZyBorg
arquivo-web-crawler
clark-crawler
crawler4j
evc-batch
gopher
heritrix
internetVista monitor
isitwp.com
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
oBot
s1z.ru
scalaj-http
scan.lol
seobility
seostar
sp_auditbot
spyfu
sysscan
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot