360Spider
80legs
ADmantX
ASPSeek
Acunetix
AiHitBot
AllSubmitter
Alligator
Ankit
Apexoo
AwarioRssBot
AwarioSmartBot
BacklinkCrawler
Badass
Bandit
Bitacle
BlowFish
Boardreader
Bolt
Buck
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
ChinaClaw
Cloud mapping
Collector
Copier
Cosmos
Craftbot
CrazyWebCrawler
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
Devil
DigitalPebble
Dirbuster
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
EMail Wolf
Ebingbong
Ecxi
Evil
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FlashGet
Foobot
Freeuploader
FrontPage
Fyrebot
GT::WWW
Genieo
GermCrawler
GetWeb
Getintent
Gigabot
Go!Zilla
GrabNet
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Hloader
HonoluluBot
Iblog
Image Sucker
Intelliseek
JOC Web Spider
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
JustView
Keyword Density
LNSpiderguy
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MicroMessenger
Microsoft Data Access
Minefield
Mojeek
Morfeus Fucking Scanner
Mozlila
Musobot
NICErsPRO
Needle
Net Vampire
NetMechanic
Netvibes
NextGenSearchBot
NimbleCrawler
Nutch
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Papa Foto
PeoplePal
Pi-Monster
Picscout
PictureFinder
Pimonster
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankingBot2
Rankivabot
RealDownload
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
Screaming
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SiteCheckerBotCrawler
Siteimprove
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
Spammen
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Stripper
SurveyBot
Swiftbot
Teleport
TeleportPro
Telesoft
Telesphorep
Thumbor
Toata
Toweyabot
Tracemyfile
Trendiction
URLy Warning
Upflow
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WBSearchBot
WPScan
WWW::Mechanize
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebSucker
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Wonderbot
Wotbox
Xaldon WebSpider
YoudaoBot
Zauba
ZmEu
ZyBorg
arquivo.pt
autoemailspider
clark-crawler
coccocbot-web
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
evc-batch
gopher
instabid
ips-agent
iubenda-radar
magpie-crawler
meanpathbot
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru
scan.lol
seobility
serpstatbot
sexsearcher
sp_auditbot
sysscan
voyagerx.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab