360Spider
404enemy
80legs
ADmantX
Acunetix
AhrefsBot
AllSubmitter
Alligator
Anarchy
Apexoo
Aspiegel
Asterias
Attach
AwarioSmartBot
BBBike
BacklinkCrawler
Badass
Bandit
BatchFTP
Bigfoot
Black Hole
BlackWidow
Blow
Boardreader
Brandprotect
Brandwatch
Bullseye
BunnySlippers
CODE87
CensysInspect
CherryPicker
ChinaClaw
Claritybot
Cocolyzebot
Collector
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DataCha0s
Disco
Discobot
Dispatch
Domains Project
Download Wonder
EasyDL
EroCrawler
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Firefox/7.0
Foobot
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Go-Ahead-Got-It
GrapeshotCrawler
HMView
HTTP::Lite
Haansoft
HaosouSpider
Havij
Hloader
HybridBot
Id-search
IlseBot
Image Sucker
Intelliseek
InterGET
Internet Ninja
JikeSpider
Joomla
JustView
Larbin
LeechFTP
Lftp
Lightspeedsystems
LinkWalker
Linkdexbot
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
Magnet
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Mister PiX
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Nameprotect
Needle
Nessus
NetZIP
NimbleCrawler
Nuclei
Octopus
OpenLinkProfiler
Openfind
Openvas
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Panscient
Petalbot
Picscout
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
Probethenet
Psbot
Pump
PxBroker
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SBIder
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
Scrapy
Screaming
Searchestate
Semrush
SemrushBot
Shodan
Sitevigil
Snake
Snoopy
Sogou web spider
Sosospider
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlworm
Sucker
SuperBot
SuperHTTP
SurveyBot
T8Abot
TeleportPro
Telesoft
The Intraformant
TheNomad
TightTwatBot
Titan
Trendiction
Turingos
Turnitin
Twice
URLy Warning
Upflow
VelenPublicWebCrawler
VidibleScraper
Voil
WASALive-Bot
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Enhancer
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebGo IS
WebReaper
WebSucker
Website Quester
WebsiteQuester
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zermelo
Zeus
ZmEu
arquivo-web-crawler
backlink-check
cah.io.community
coccocbot-web
com.plumanalytics
crawler4j
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
gopher
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
siteripz
spyfu
sysscan
tAkeOut
trendiction.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zauba.io
zgrab