80legs
Aboundexbot
AhrefsBot
AIBOT
AiHitBot
Alexibot
Anarchie
Attach
backlink-check
BacklinkCrawler
Badass
Bandit
BatchFTP
BBBike
BDFetch
Bigfoot
Bitacle
Black Hole
BLEXBot
Blow
BlowFish
Bolt
Buddy
Bullseye
BunnySlippers
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
ChinaClaw
Claritybot
Copier
Copyscape
Craftbot
crawler4j
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
Curious
Custo
DBLBot
demandbase-bot
Demon
Devil
DIIbot
Dirbuster
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Drip
eCatch
ECCP/1.0
evc-batch
Exabot
ExtLinksBot
Extractor
EyeNetIE
FemtosearchBot
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
Genieo
Gigablast
Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
GridBot
HaosouSpider
Harvest
Heritrix
HTTP::Lite
HybridBot
Iblog
instabid
Intelliseek
Internet Ninja
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
JOC Web Spider
Jorgee
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
Lipperhey Spider
Litemage_walker
Lmspider
lwp-request
LWP::Simple
Magnet
magpie-crawler
Majestic12
Majestic SEO
MarkWatch
Masscan
MauiBot
meanpathbot
MeanPath Bot
MegaIndex.ru
Microsoft Data Access
MIDown tool
Mister PiX
MJ12bot
Morfeus Fucking Scanner
MSIECrawler
Msrabot
Nameprotect
Navroad
Netcraft
NetMechanic
Net Vampire
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Ninja
Nutch
oBot
Octopus
OnCrawl
Openfind
OpenVAS
OrangeSpider
OutfoxBot
Page Analyzer
PageGrabber
page scorer
PageScorer
Panscient
Pavuk
PHPCrawl
Picsearch
Pi-Monster
PleaseCrawl
plumanalytics
ProPowerBot
Pump
QueryN Metasearch
RankActive
RankFlex
RankingBot
Rankivabot
RankurBot
RebelMouse
RedesScrapy
ReGet
RocketCrawler
SalesIntelligent
SBIder
ScanAlert
ScoutJet
Screaming
Searchestate
SearchmetricsBot
Semrush
Seomoz
SeoSiteCheckup
serpstatbot
Shodan
SISTRIX
Siteimprove
SiteSucker
SMTBot
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpaceBison
SpankBot
sp_auditbot
SputnikBot
spyfu
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
SurveyBot
Szukacz
T8Abot
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Trendiction
trendiction.com
trendiction.de
TwengaBot
URLy Warning
WallpapersHD
WBSearchBot
Webalta
WebAuto
Web Auto
WebCopier
WebEnhancer
Web Enhancer
WebFuck
WebImageCollector
WebLeacher
webmeup-crawler
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebStripper
WebZIP
WeSEE
Whacker
Widow
Wonderbot
Woobot
Wotbox
WWW-Mechanize
x09Mozilla
Xaldon WebSpider
xpymep1.exe
YoudaoBot
Zade
Zauba
zauba.io
Zermelo
Zeus
ZmEu
ZumBot
ZyBorg