404enemy
80legs
ADmantX
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter
AlphaBot
Anarchy
Atomseobot
Attach
AwarioSmartBot
BBBike
BDFetch
Backlink-Ceck
Bandit
Blackboard
Boardreader
BuiltBotTough
BunnySlippers
CATExplorador
CCBot
CODE87
Calculon
CheeseBot
Citoid
Cliqzbot
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
Custo
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
DigitalPebble
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
Dragonfly
EasyDL
EirGrabber
Evil
Express WebPictures
ExtractorPro
Extreme Picture Finder
Firefox/7.0
Freeuploader
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
HMView
HTTrack
Harvest
Havij
Heritrix
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
IndeedBot
InfoNaviRobot
Intelliseek
Iria
JOC Web Spider
JamesBOT
JikeSpider
Joomla
JustView
LeechFTP
LeechGet
LinkScan
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
Litemage_walker
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Musobot
NPbot
NearSite
NetAnts
NetLyzer
NetSpider
Netcraft
Nettrack
Niki-bot
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Panscient
Pavuk
Petalbot
Picsearch
PictureFinder
Pixray
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pump
RSSingBot
RankActiveLinkBot
Rankivabot
Re-re
ReGet
RealDownload
Recorder
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
ScanAlert
Scanbot
Screaming
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
SeoSiteCheckup
Seomoz
Siphon
SiteExplorer
Sitebeam
Siteimprove
Sitevigil
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
Spammen
Spbot
Spinn3r
Sqlmap
Sqworm
Stripper
Suzuran
Swiftbot
T8Abot
TeleportPro
Telesphorep
Turingos
TurnitinBot
URLy Warning
URLy.Warning
V-BOT
VB Project
VelenPublicWebCrawler
Virusdie
Voil
Voltron
WASALive-Bot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WeSEE
Web Fetch
WebBandit
WebEnhancer
WebFetch
WebLeacher
WebSucker
Website Quester
Whacker
WinHTTrack
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
cah.io.community
check1.exe
com.plumanalytics
crawler.feedback
crawler4j
domainsproject.org
heritrix
internetVista monitor
ips-agent
isitwp.com
linkdexbot
lwp-trivial
meanpathbot
page scorer
pcBrowser
polaris version
ripz
satoristudio.net
scan.lol
seobility
seostar
serpstatbot
spyfu
ubermetrics-technologies.com
webprosbot
zauba.io
zgrab