360Spider
ADmantX
ALittle Client
ASPSeek
Abonti
Acunetix
AhrefsBot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Anthill
Apexoo
Asterias
AwarioSmartBot
BLEXBot
BackDoorBot
BackWeb
Badass
Bandit
Barkrowler
BetaBot
Bigfoot
Bitacle
Black Hole
Blackboard
Blow
BlowFish
Bolt
Brandprotect
Brandwatch
Bullseye
CCBot
CODE87
CazoodleBot
Cegbfeieh
Chlooe
Cogentbot
Copyscape
CrazyWebCrawler
DSearch
DataCha0s
DatabaseDriverMysqli
DigitalPebble
Discobot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Drip
EasyDL
Ecxi
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
FDM
Fimap
Firefox/7.0
Flunky
Foobot
Freeuploader
FrontPage
Fuzz
GalaxyBot
Gigabot
Go!Zilla
GoZilla
Gotit
Grafula
GrapeshotCrawler
HEADMasterSEO
HTTrack
HaosouSpider
Heritrix
Hloader
IDBot
Iblog
Id-search
IlseBot
InfoTekies
Intelliseek
InternetSeer
JamesBOT
JennyBot
JetCar
Joomla
Jorgee
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LeechGet
LexiBot
Lftp
Lightspeedsystems
Likse
LinkWalker
Linkdexbot
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
Mag-Net
Majestic SEO
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Morfeus Fucking Scanner
Msrabot
Musobot
Nameprotect
Net Vampire
NetLyzer
NetZIP
Netvibes
Nibbler
Nikto
Nutch
Openfind
OrangeBot
PageScorer
PageThing.com
Pavuk
Petalbot
Pu_iN
Pump
RankActive
RankingBot
Rankivabot
Re-re
ReGet
RealDownload
Reaper
RepoMonkey
Ripper
Rogerbot
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
Semrush
SentiBot
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SlySearch
SmartDownload
Snake
Snoopy
Sociscraper
SpaceBison
SpankBot
Sqlmap
Steeler
SuperBot
SurveyBot
TeleportPro
The Intraformant
Thumbor
Tracemyfile
Trendiction
True_Robot
Turingos
TurnitinBot
TwengaBot
Twice
UnisterBot
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Enhancer
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebReaper
WebSauger
WebWhacker
Website Quester
Whack
WinHTTrack
Wotbox
Wprecon
Xaldon WebSpider
Zermelo
Zitebot
ZmEu
archive.org_bot
arquivo.pt
coccocbot-web
demandbase-bot
eCatch
evc-batch
facebookscraper
heritrix
instabid
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
oBot
page scorer
pcBrowser
scan.lol
seobility
seostar
serpstatbot
sexsearcher
sogouspider
sysscan
trendiction.de
x22Mozilla
zgrab