360Spider
404checker
404enemy
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy
Ankit
Asterias
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackWeb
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Blow
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BunnySlippers
CCBot
Cegbfeieh
CheTeam
Chlooe
Claritybot
Cloud mapping
Collector
Copier
Cosmos
Crawling at Home Project
Curious
DBLBot
DIIbot
DatabaseDriverMysqli
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Drip
EasyDL
EroCrawler
Evil
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FHscan
FlashGet
Freeuploader
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
GridBot
HEADMasterSEO
Haansoft
HaosouSpider
Harvest
Hloader
IDBTE4M
Iblog
Image Sucker
IndeedBot
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
LeechGet
Lftp
LibWeb
Likse
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic12
MarkMonitor
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Name Intelligence
Nessus
NetLyzer
NetSpider
Netcraft
NextGenSearchBot
Niki-bot
Nikto
Ninja
Nutch
OnCrawl
Openvas
PHPCrawl
Pandalytics
Panscient
Papa Foto
Pavuk
Petalbot
Piepmatz
ProPowerBot
ProWebWalker
Pu_iN
QueryN Metasearch
Rankivabot
ReGet
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Scrapy
ScreenerBot
ScrepyBot
Semrush
SeoSiteCheckup
SeobilityBot
Seomoz
SiteSnagger
Sitebeam
Siteimprove
Sogou web spider
Spinn3r
SputnikBot
Sqlmap
Steeler
Stripper
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Trendictionbot
True_Robot
Twice
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VB Project
VCI
WASALive-Bot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Enhancer
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
WinHTTrack
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
cah.io.community
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
gopher
internetVista monitor
muhstik-scan
page scorer
pcBrowser
ripz
satoristudio.net
scan.lol
seobility
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
spyfu
sysscan
trendiction.de
webpros.com
webprosbot
x09Mozilla