360Spider
404checker
404enemy
80legs
Abonti
AhrefsBot
AiHitBot
Aipbot
Alligator
Ankit
Apexoo
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BatchFTP
Bigfoot
Blackboard
Brandprotect
Buddy
BuiltBotTough
BunnySlippers
CATExplorador
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Citoid
Claritybot
Cliqzbot
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
CyotekWebCopy
DSearch
DTS Agent
Devil
Discobot
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
Drip
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
GridBot
HEADMasterSEO
HMView
HTTrack
Havij
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
IRLbot
Iblog
Image Fetch
InterGET
JamesBOT
JetCar
JikeSpider
Joomla
Jorgee
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LexiBot
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Ltx71
MIDown tool
MJ12bot
Majestic SEO
Majestic12
MauiBot
MeanPath Bot
Mediatoolkitbot
Microsoft Data Access
Minefield
Mojolicious
MolokaiBot
Mozlila
Msrabot
Nameprotect
NearSite
Net Vampire
NetLyzer
NetMechanic
Netvibes
NextGenSearchBot
Nimbostratus
Ninja
Nmap
Not
Nuclei
Offline Explorer
Offline Navigator
OrangeBot
OutclicksBot
PECL::HTTP
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Picsearch
PictureFinder
Pixray
ProWebWalker
Probethenet
Psbot
Pu_iN
Quick-Crawler
Re-re
ReGet
RealDownload
Reaper
Recorder
RocketCrawler
SBIder
SEOstats
SISTRIX
ScanAlert
Scanbot
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
SlySearch
Snake
Snapbot
SocialRankIOBot
Sosospider
SpaceBison
Spammen
Spanner
Spinn3r
SputnikBot
Sqlworm
Sucuri
Surfbot
T0PHackTeam
TeleportPro
The Intraformant
TheNomad
TightTwatBot
Titan
Toata
Trendiction
Trendictionbot
Turingos
Turnitin
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
VoidEYE
Voil
WASALive-Bot
WPScan
Wallpapers/3.0
Web Fuck
Web Pix
Web Sauger
WebBandit
WebCollage
WebFetch
WebGo IS
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
Wprecon
Xaldon WebSpider
Xenu
Zauba
ZoominfoBot
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
crawl.sogou.com
demandbase-bot
evc-batch
facebookscraper
heritrix
instabid
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
plumanalytics
scan.lol
seobility
seocompany.store
seoscanners
seostar
serpstatbot
siteripz
spyfu
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla
zauba.io