360Spider
404enemy
AIBOT
Abonti
Aipbot
AllSubmitter
Anarchy99
Ankit
Anthill
Asterias
Atomseobot
AwarioRssBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
Battleztar Bazinga
BetaBot
Bitacle
BlackWidow
Blackboard
Blow
BlowFish
Brandprotect
BuiltBotTough
Bullseye
BunnySlippers
CCBot
CODE87
Cegbfeieh
CensysInspect
CheTeam
Citoid
Claritybot
Cliqzbot
Cogentbot
Copier
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DataCha0s
DatabaseDriverMysqli
DigitalPebble
Dirbuster
Disco
Dispatch
DomainAppender
Domains Project
Dragonfly
EasyDL
Evil
ExtLinksBot
ExtractorPro
Flunky
Foobot
Freeuploader
GalaxyBot
GermCrawler
Gigabot
GoZilla
GrabNet
HMView
HTTrack
Haansoft
HaosouSpider
Harvest
Hloader
Humanlinks
IDBTE4M
Indy Library
Internet Ninja
Iskanie
JamesBOT
JennyBot
Jetty
JikeSpider
Joomla
Jyxobot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechGet
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinqiaRSSBot
Lipperhey
Litemage_walker
MJ12bot
MSIECrawler
Mail.RU_Bot
Majestic SEO
MarkMonitor
Masscan
MauiBot
MeanPath Bot
Metauri
Microsoft URL Control
Mojolicious
Mozlila
NICErsPRO
Navroad
Net Vampire
NetAnts
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Ninja
Octopus
OnCrawl
Openvas
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
QueryN Metasearch
RSSingBot
RankActive
RankFlex
Rankivabot
Re-re
Reaper
RebelMouse
Recorder
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScoutJet
Screaming
ScreenerBot
Seekport
SemanticJuice
SemrushBot
Seomoz
Site Sucker
SiteSucker
SlySearch
SmartDownload
Snoopy
Sosospider
SpaceBison
Spanner
Spbot
Spinn3r
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Szukacz
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toweyabot
Turingos
TwengaBot
Typhoeus
V-BOT
Vacuum
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
WPScan
WeSEE
Web Fuck
Web Pix
Web Sucker
WebFetch
WebSauger
WebSucker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Wotbox
Xaldon WebSpider
Zauba
Zeus
Zitebot
ZoomBot
arquivo.pt
autoemailspider
check1.exe
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
heritrix
ips-agent
isitwp.com
magpie-crawler
oBot
plumanalytics
ripz
s1z.ru
seoscanners
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.de
ubermetrics-technologies.com
webgains-bot
webpros.com
webprosbot
x09Mozilla
zauba.io