Abonti
ADmantX
AhrefsBot
AiHitBot
Alexibot
Alligator
AlphaBot
ASPSeek
Asterias
BackDoorBot
BackStreet
BackWeb
Bandit
Barkrowler
BDCbot
BetaBot
Black Hole
Brandwatch
BuiltBotTough
BuiltWith
BuzzSumo
CCBot
Cegbfeieh
CheTeam
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Collector
com.plumanalytics
CopyRightCheck
Craftbot
CrazyWebCrawler
CrunchBot
DatabaseDriverMysqli
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Drip
DSearch
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EroCrawler
Exabot
Extractor
Ezooms
FDM
Flunky
Fyrebot
Genieo
GetRight
Gigablast
Gigabot
Go-Ahead-Got-It
Gotit
Go!Zilla
Grabber
Grafula
Haansoft
HaosouSpider
HEADMasterSEO
Hloader
HTMLparser
HTTP::Lite
HTTrack
Iblog
IDBot
IlseBot
Indy Library
InfoTekies
InterGET
InternetSeer
Iria
IRLbot
JennyBot
JetCar
JustView
Keyword Density
Lanshanbot
LeechFTP
LibWeb
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
LinqiaScrapeBot
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
magpie-crawler
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mister PiX
Mojeek
Mr.4x3
Msrabot
muhstik-scan
Musobot
Nameprotect
NearSite
Nessus
NetAnts
Netcraft
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Nikto
Offline Explorer
OrangeSpider
PageGrabber
PageScorer
Pavuk
PHPCrawl
Picsearch
Pi-Monster
Pixray
Pockey
POE-Component-Client-HTTP
Probethenet
ProPowerBot
Psbot
PxBroker
PyCurl
Quick-Crawler
RankActive
Rankivabot
RealDownload
RebelMouse
Recorder
RedesScrapy
s1z.ru
ScanAlert
Scanbot
scan.lol
ScoutJet
SearchmetricsBot
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
SmartDownload
Snoopy
Sociscraper
Sosospider
Sottopop
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
Surfbot
Swiftbot
tAkeOut
Telesoft
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Tracemyfile
Trendiction
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Upflow
URLy Warning
URLy.Warning
VCI
VeriCiteCrawler
VidibleScraper
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WebAuto
Web Auto
WebCopier
WebGo IS
WebImageCollector
WebPix
WebSauger
Webshag
WebsiteExtractor
Webster
WebStripper
WebSucker
Web Sucker
WebWhacker
Widow
WinHTTrack
WISENutbot
Wonderbot
Woobot
Wprecon
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Zade
zgrab
Zitebot
ZmEu
ZumBot