360Spider
404checker
AhrefsBot
AIBOT
Aipbot
Alexibot
Anarchie
Anarchy
Anthill
arquivo-web-crawler
Aspiegel
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
BackWeb
BatchFTP
BBBike
BDFetch
Bitacle
Black Hole
BLEXBot
Boardreader
Bolt
Brandprotect
Brandwatch
Buck
Buddy
BunnySlippers
Calculon
CCBot
CensysInspect
check1.exe
ChinaClaw
Chlooe
Cloud mapping
Copier
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CrunchBot
Curious
Custo
CyotekWebCopy
DataCha0s
demandbase-bot
Devil
Digincore
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
domainsproject.org
DomainStatsBot
DomCopBot
Download Wonder
Dragonfly
DTS Agent
EasyDL
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
evc-batch
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
FyberSpider
GermCrawler
Gigablast
G-i-g-a-b-o-t
gopher
Go!Zilla
GrabNet
GrapeshotCrawler
GT::WWW
HaosouSpider
Hloader
IDBTE4M
Image Sucker
InfoNaviRobot
InfoTekies
Internet Ninja
IstellaBot
JetCar
JustView
Jyxobot
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
Libwhisker
Likse
LinkextractorPro
LinkWalker
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
lwp-request
lwp-trivial
magpie-crawler
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
mediawords
MegaIndex.ru
MFC_Tear_Sample
MIIxpc
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
MQQBrowser
MTRobot
muhstik-scan
Nameprotect
NetAnts
NetSpider
Nettrack
Nibbler
NPbot
Offline Explorer
OnCrawl
OpenLinkProfiler
Openvas
OPPO A33
OutfoxBot
Page Analyzer
page scorer
Pandalytics
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Picsearch
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Psbot
Pu_iN
Pump
PyCurl
QueryN Metasearch
RankActive
RankingBot
Rankivabot
RealDownload
Recorder
ripz
scalaj-http
scan.lol
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOkicks-Robot
SEOprofiler
seoscanners
SEOstats
serpstatbot
Sitebeam
sitechecker.pro
SiteExplorer
Siteimprove
Site Sucker
Sogou web spider
Sosospider
SpaceBison
Sqlmap
Sqlworm
Sqworm
Steeler
Sucker
SuperHTTP
Suzuran
sysscan
Szukacz
T8Abot
tAkeOut
Teleport
TheNomad
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
Turingos
TwengaBot
Twice
URLy Warning
URLy.Warning
VCI
VelenPublicWebCrawler
VoidEYE
Wallpapers/3.0
WallpapersHD
Webalta
WebAuto
WebCollage
Web Collage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
Web Pix
WebReaper
Webshag
WebsiteExtractor
WebStripper
WebZIP
Whacker
Who.is Bot
WISENutbot
Woobot
Wprecon
WPScan
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
YoudaoBot
Zade
Zauba
zauba.io
Zermelo
zgrab