Aboundex
AhrefsBot
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Apexoo
Aspiegel
Attach
backlink-check
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BDCbot
Bitacle
BLEXBot
BotALot
BuiltBotTough
Calculon
CCBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
CheTeam
Claritybot
coccocbot-web
CODE87
com.plumanalytics
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
Curious
Custo
DatabaseDriverMysqli
DBLBot
Dirbuster
Disco
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
domainsproject.org
DomainStatsBot
Dotbot
Drip
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
Evil
Exabot
ExtLinksBot
EyeNetIE
FDM
FemtosearchBot
FlashGet
Flunky
FyberSpider
Fyrebot
Genieo
Getintent
Gigabot
gopher
Gotit
GoZilla
Grabber
GridBot
HaosouSpider
HEADMasterSEO
heritrix
Heritrix
HTMLparser
HTTrack
IDBTE4M
Image Sucker
IndeedBot
Indy Library
InfoTekies
internetVista monitor
Iria
IRLbot
JamesBOT
JetCar
Jetty
JOC Web Spider
Joomla
Jorgee
Kenjin Spider
Kinza
Kozmosbot
LeechGet
Lftp
Libwhisker
LieBaoFast
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
Lmspider
LWP::Simple
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
meanpathbot
mediawords
MicroMessenger
Microsoft URL Control
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
Msrabot
MTRobot
muhstik-scan
Netcraft
NetLyzer
NetMechanic
Netvibes
Niki-bot
NimbleCrawler
NPbot
Nutch
Octopus
Offline Explorer
OnCrawl
Openvas
OrangeBot
PageGrabber
page scorer
PageScorer
Panscient
Papa Foto
Pavuk
PeoplePal
PHPCrawl
Piepmatz
Pixray
polaris version
ProPowerBot
Psbot
Pu_iN
PxBroker
PyCurl
RankActiveLinkBot
Rankivabot
RankurBot
Recorder
ReGet
Ripper
Rogerbot
RSSingBot
s1z.ru
satoristudio.net
SBIder
ScanAlert
Scanbot
Scrapy
SearchmetricsBot
SemrushBot
SeobilityBot
SEOkicks
SEOkicks-Robot
seoscanners
seostar
sexsearcher
Sitebeam
SiteExplorer
Siteimprove
Sitevigil
SlySearch
SmartDownload
SMTBot
Sociscraper
Sottopop
Spammen
sp_auditbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Stripper
SuperBot
sysscan
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft
Thumbor
Toata
Trendictionbot
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
Upflow
Vagabondo
Voil
Voltron
Wallpapers/3.0
WBSearchBot
WebAuto
WebCollage
WebCopier
WEBDAV
WebEnhancer
Web Fetch
WebGo IS
WebImageCollector
Web Pix
Web Sauger
WebsiteQuester
Website Quester
Webster
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
Whacker
Whatweb
Woobot
WWW-Collector-E
WWWOFFLE
Xaldon WebSpider
Xenu
Zade
Zauba
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg