404checker
404enemy
Abonti
Aboundex
Acunetix
ADmantX
AhrefsBot
AiHitBot
Alligator
AlphaBot
Apexoo
arquivo.pt
Attach
AwarioSmartBot
backlink-check
BackStreet
Badass
Barkrowler
BetaBot
Bitacle
BLEXBot
Blow
BlowFish
Boardreader
Brandprotect
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Claritybot
Cloud mapping
cognitiveseo
Collector
com.plumanalytics
Cosmos
crawler.feedback
Custo
DatabaseDriverMysqli
DBLBot
demandbase-bot
Devil
Digincore
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Drip
DTS Agent
EasyDL
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Wolf
EroCrawler
evc-batch
Evil
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
Freeuploader
Getintent
Gigabot
Go-Ahead-Got-It
Grafula
GrapeFX
Havij
heritrix
Heritrix
HybridBot
Iblog
InfoNaviRobot
InfoTekies
instabid
InterGET
InternetSeer
internetVista monitor
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
Jetty
Jorgee
JustView
Kenjin Spider
Keyword Density
Larbin
LeechFTP
LeechGet
Libwhisker
LinkpadBot
LinksManager
Ltx71
LWP::Simple
Magnet
magpie-crawler
Majestic12
Masscan
MauiBot
meanpathbot
Meanpathbot
mediawords
MegaIndex.ru
Metauri
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
Nameprotect
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
Net Vampire
Netvibes
Nimbostratus
Nmap
Nutch
oBot
Offline Navigator
OnCrawl
Openvas
OpenVAS
OrangeSpider
PageAnalyzer
Pandalytics
Panscient
Pavuk
Picsearch
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Pockey
Probethenet
ProPowerBot
Psbot
PyCurl
Quick-Crawler
RankFlex
RankingBot
RankingBot2
Rankivabot
Reaper
RepoMonkey
ScanAlert
Scanbot
scan.lol
Screaming
SearchmetricsBot
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SEOstats
Siphon
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
Snake
Snoopy
Sogou web spider
Spammen
SpankBot
SputnikBot
spyfu
Sqworm
Steeler
Sucuri
SuperBot
SuperHTTP
SurveyBot
sysscan
Szukacz
T8Abot
tAkeOut
Teleport
Telesoft
Telesphoreo
Titan
Toata
Trendictionbot
trendiction.com
TwengaBot
UnisterBot
Upflow
URLy Warning
URLy.Warning
VB Project
VoidEYE
Voltron
WallpapersHD
WebAuto
WEBDAV
WebEnhancer
Web Fuck
WebGo IS
WebmasterWorldForumBot
WebPix
Web Pix
WebSauger
Web Sauger
Webshag
WebsiteQuester
WebStripper
WebSucker
WebWhacker
WeSEE
Whack
Whatweb
Wonderbot
Woobot
Wprecon
WPScan
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Xenu
Zade
Zauba
zauba.io
Zermelo
zgrab
Zitebot
ZumBot