404checker
404enemy
AIBOT
ALittle Client
Aboundex
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchie
Apexoo
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
Bitacle
BotALot
Brandwatch
Buck
Buddy
BuiltWith
BuzzSumo
CATExplorador
CCBot
CensysInspect
CheTeam
CheeseBot
Citoid
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Craftbot
Crawling at Home Project
Crescent
CrunchBot
Curious
CyotekWebCopy
DSearch
DataCha0s
Devil
DigitalPebble
Dirbuster
Discoverybot
DnBCrawler-Analytics
DomainCrawler
Download Wonder
Dragonfly
EMail Wolf
Ebingbong
Ecxi
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
FDM
FemtosearchBot
Fimap
Foobot
FyberSpider
Genieo
GermCrawler
Getintent
Go!Zilla
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Havij
Hloader
IDBTE4M
IDBot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer
JOC Web Spider
Jbrofuzz
Jorgee
Jyxobot
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
LexiBot
Lftp
LibWeb
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Ltx71
MIDown tool
MSFrontPage
MTRobot
Majestic12
MarkMonitor
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Mister PiX
Moblie Safari
Mozlila
Mr.4x3
Msrabot
Name Intelligence
Net Vampire
NetAnts
NetMechanic
NetZIP
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nutch
OnCrawl
OpenVAS
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageThing.com
Papa Foto
Picscout
Picsearch
Piepmatz
Pimonster
Pixray
Pu_iN
QueryN Metasearch
Quick-Crawler
RSSingBot
Rankivabot
RankurBot
RealDownload
Reaper
Rogerbot
SBIder
SEOkicks-Robot
Scanbot
ScrepyBot
SemanticJuice
Semrush
SeoSiteCheckup
Siphon
SiteExplorer
SiteSucker
Snake
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spammen
Spanner
Spbot
Spinn3r
SputnikBot
Stripper
SuperBot
Surfbot
T8Abot
Teleport
Telesphoreo
The Intraformant
TheNomad
Tracemyfile
True_Robot
TwengaBot
Twice
V-BOT
VB Project
Virusdie
Voil
Voltron
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Fuck
Web Sauger
WebCopier
WebFetch
WebLeacher
WebSauger
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
Webster
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
ZmEu
ZyBorg
adscanner
arquivo.pt
autoemailspider
backlink-check
clark-crawler
coccocbot-web
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
evc-batch
heritrix
lwp-request
magpie-crawler
meanpathbot
mediawords
oBot
pcBrowser
plumanalytics
ripz
s1z.ru
scalaj-http
seobility
siteripz
sogouspider
spyfu
sysscan
tAkeOut
ubermetrics-technologies.com
webgains-bot
xpymep1.exe