360Spider
404enemy
Abonti
Aboundex
Acunetix
AhrefsBot
Aipbot
AlphaBot
archive.org_bot
ASPSeek
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BackWeb
Badass
Barkrowler
BBBike
BDFetch
BetaBot
Bitacle
Blackboard
Black Hole
BlackWidow
Blow
Brandwatch
Buddy
BuiltBotTough
Calculon
CCBot
coccocbot-web
Cogentbot
Cosmos
Craftbot
crawler4j
CrunchBot
Custo
Digincore
DIIbot
Disco
DomainCrawler
domainsproject.org
DomainStatsBot
Download Wonder
Drip
DSearch
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EroCrawler
Exabot
Extractor
FDM
FemtosearchBot
Firefox/7.0
Flunky
Fyrebot
GalaxyBot
Genieo
GetRight
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GrabNet
GrapeshotCrawler
GT::WWW
Heritrix
Hloader
HTMLparser
HTTP::Lite
HTTrack
Iblog
Id-search
Indy Library
InternetSeer
ips-agent
Iria
IRLbot
isitwp.com
Jbrofuzz
JennyBot
JikeSpider
JOC Web Spider
Jorgee
JustView
Jyxobot
Kenjin Spider
Kozmosbot
Larbin
LeechGet
Likse
LinkextractorPro
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
LWP::Simple
lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
MSFrontPage
Msrabot
muhstik-scan
Musobot
Name Intelligence
Nameprotect
Navroad
Nessus
NetSpider
NetZIP
Nikto
Nimbostratus
NPbot
Nutch
Octopus
OnCrawl
OpenLinkProfiler
Openvas
OpenVAS
OPPO A33
OutclicksBot
PageGrabber
page scorer
pcBrowser
PECL::HTTP
Pimonster
plumanalytics
POE-Component-Client-HTTP
Pump
PxBroker
Quick-Crawler
RankActive
RankingBot
Rankivabot
RealDownload
Recorder
ReGet
RocketCrawler
satoristudio.net
ScoutJet
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
serpstatbot
sexsearcher
Siphon
SISTRIX
Sitebeam
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
Snoopy
SocialRankIOBot
Sosospider
Sottopop
Spbot
spyfu
Sqlmap
Sqworm
Stripper
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
sysscan
Szukacz
T8Abot
tAkeOut
Telesphoreo
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
Turnitin
TwengaBot
UnisterBot
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Wallpapers/3.0
WallpapersHD
Webalta
WebBandit
WebCollage
WebCopier
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Webshag
Website Quester
Webster
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
WinHTTrack
WiseGuys Robot
Wonderbot
WWW-Collector-E
WWW::Mechanize
x09Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
Zauba
Zeus
ZumBot