360Spider
404checker
80legs
Acunetix
ADmantX
AhrefsBot
Alligator
Ankit
ASPSeek
Backlink-Ceck
backlink-check
BackStreet
BackWeb
Bandit
Bitacle
Boardreader
Bolt
BotALot
Buddy
BuiltBotTough
BuzzSumo
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
CheTeam
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Collector
CopyRightCheck
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Deusu
Devil
DigitalPebble
DIIbot
Discoverybot
DomainAppender
DomainCrawler
Domains Project
domainsproject.org
DSearch
EasyDL
Ecxi
EMail Siphon
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Extractor
FDM
FHscan
Flunky
Foobot
Freeuploader
FyberSpider
GalaxyBot
Genieo
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
GoZilla
Go!Zilla
Grabber
GrabNet
Harvest
HEADMasterSEO
Heritrix
HTMLparser
HTTrack
Humanlinks
HybridBot
Id-search
IlseBot
Image Fetch
Intelliseek
internetVista monitor
Iria
IRLbot
JamesBOT
JetCar
Jetty
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Kinza
Lanshanbot
LeechFTP
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Linkdexbot
LinksManager
LinkWalker
LinqiaScrapeBot
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot
Masscan
MauiBot
meanpathbot
MeanPath Bot
MFC_Tear_Sample
MicroMessenger
Microsoft Data Access
MIDown tool
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
MQQBrowser
Mr.4x3
MSFrontPage
muhstik-scan
Musobot
NetMechanic
NetSpider
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Octopus
Offline Explorer
Offline Navigator
OpenVAS
OutfoxBot
page scorer
Pandalytics
Papa Foto
PHPCrawl
Picscout
Pimonster
Pixray
PleaseCrawl
polaris version
ProWebWalker
Pump
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
RealDownload
RebelMouse
ReGet
RocketCrawler
satoristudio.net
SBIder
ScanAlert
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SEOlyticsCrawler
SeoSiteCheckup
Sitebeam
sitechecker.pro
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Sociscraper
sogouspider
SpaceBison
SpankBot
sp_auditbot
Spinn3r
SputnikBot
Sqlworm
Suzuran
sysscan
Szukacz
T0PHackTeam
T8Abot
tAkeOut
TeleportPro
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Toweyabot
trendiction.de
TwengaBot
Upflow
VB Project
VCI
Voil
WallpapersHD
Webalta
WebAuto
Web Auto
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebImageCollector
webmeup-crawler
WebPix
Web Pix
WebSauger
WebsiteExtractor
Website Quester
Whack
Whacker
Who.is Bot
Widow
WiseGuys Robot
WISENutbot
Woobot
WWW-Collector-E
Xaldon WebSpider
xpymep1.exe
YoudaoBot
Zade
Zauba
zgrab
ZmEu
ZumBot