360Spider
80legs
ASPSeek
Abonti
AhrefsBot
Alexibot
AllSubmitter
Aspiegel
Attach
AwarioSmartBot
Barkrowler
Bigfoot
BlackWidow
Blackboard
Bolt
Brandprotect
Buddy
BuiltWith
BuzzSumo
CATExplorador
CCBot
Calculon
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Copyscape
Craftbot
CrazyWebCrawler
Curious
Custo
DSearch
DataCha0s
Deusu
DigitalPebble
Dirbuster
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Download Wonder
EasyDL
EirGrabber
Exabot
Express WebPictures
Ezooms
FemtosearchBot
Firefox/7.0
Freeuploader
Fuzz
FyberSpider
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeFX
HMView
Haansoft
HaosouSpider
Harvest
Havij
Hloader
Humanlinks
Iblog
Id-search
Image Fetch
IndeedBot
Indy Library
InterGET
InternetSeer
Iria
IstellaBot
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
JustView
Kenjin Spider
LNSpiderguy
Lanshanbot
LexiBot
Lftp
Libwhisker
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinksManager
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
Mag-Net
Majestic SEO
MarkMonitor
Mass Downloader
Meanpathbot
Microsoft URL Control
Minefield
Mister PiX
Mojeek
Musobot
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Nessus
NetLyzer
NetSpider
NetZIP
NextGenSearchBot
Niki-bot
NimbleCrawler
Offline Explorer
OnCrawl
Openfind
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
Pavuk
Picscout
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot
ReGet
RealDownload
Reaper
RebelMouse
ScanAlert
SearchmetricsBot
SentiBot
SeoSiteCheckup
Seomoz
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spanner
Spbot
SputnikBot
Stripper
SuperBot
SuperHTTP
Surfbot
Szukacz
Teleport
Telesoft
Telesphoreo
The Intraformant
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendiction
TurnitinBot
URLy Warning
V-BOT
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
Voltron
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
WebCollage
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebZIP
Website Quester
WebsiteExtractor
Whack
Widow
WinHTTrack
Wotbox
Xaldon WebSpider
Xenu
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
arquivo-web-crawler
arquivo.pt
autoemailspider
coccocbot-web
demandbase-bot
internetVista monitor
isitwp.com
lwp-request
meanpathbot
oBot
page scorer
pcBrowser
probe-image-size
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
seostar
serpstatbot
sp_auditbot
spyfu
sysscan
voyagerx.com
webgains-bot
x09Mozilla
xpymep1.exe
zgrab