360Spider
AIBOT
ALittle Client
ASPSeek
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Apexoo
Asterias
AwarioRssBot
BBBike
BDCbot
BLEXBot
BackStreet
Bigfoot
Bitacle
Black Hole
Brandwatch
CATExplorador
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Collector
CopyRightCheck
Crawling at Home Project
Crescent
Curious
Custo
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Dirbuster
Disco
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
EMail Wolf
Ecxi
EirGrabber
Exabot
ExtLinksBot
EyeNetIE
FemtosearchBot
Fimap
Firefox/7.0
Foobot
GT::WWW
GalaxyBot
GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
GrapeFX
HMView
HTTP::Lite
HTTrack
Haansoft
Hloader
HonoluluBot
IDBot
IndeedBot
Indy Library
InfoTekies
Intelliseek
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
LWP::Simple
Lanshanbot
Larbin
Leap
LexiBot
LibWeb
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Ltx71
MIIxpc
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Msrabot
NPbot
Name Intelligence
Nameprotect
NetAnts
Netcraft
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Octopus
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageScorer
Panscient
Papa Foto
Pimonster
PleaseCrawl
Pockey
Probethenet
Psbot
Pump
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOstats
SalesIntelligent
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Sitevigil
Snake
Snoopy
SpaceBison
Spanner
Spbot
Sqworm
Sucker
Surfbot
Suzuran
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
Titan
Toata
Trendictionbot
True_Robot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WASALive-Bot
WBSearchBot
WPScan
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Fetch
Web Pix
Web Sauger
WebAuto
WebCollage
WebCopier
WebGo IS
WebLeacher
WebReaper
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Woobot
Xaldon WebSpider
Xenu
Zeus
Zitebot
ZmEu
ZyBorg
archive.org_bot
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
evc-batch
facebookscraper
heritrix
internetVista monitor
ips-agent
linkdexbot
magpie-crawler
mediawords
muhstik-scan
pcBrowser
plumanalytics
ripz
satoristudio.net
seobility
sexsearcher
sogouspider
sp_auditbot
sysscan
voyagerx.com
webprosbot
x22Mozilla
xpymep1.exe
zgrab