360Spider
404enemy
AIBOT
Aboundexbot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
BDCbot
BackWeb
Badass
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
Bolt
BotALot
Brandprotect
Brandwatch
Buck
Buddy
CATExplorador
CCBot
Calculon
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
Copier
CopyRightCheck
CrunchBot
Curious
Custo
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
Discobot
DomCopBot
DomainAppender
DomainStatsBot
Download Wonder
Dragonfly
EasyDL
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
Firefox/7.0
Flunky
Fyrebot
GalaxyBot
GetWeb
Gigablast
Go!Zilla
Go-Ahead-Got-It
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Heritrix
Id-search
Image Sucker
InfoTekies
Internet Ninja
Iria
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
Jorgee
Kenjin Spider
LNSpiderguy
Lanshanbot
LeechFTP
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MTRobot
Magnet
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
MicroMessenger
Microsoft URL Control
Mister PiX
Mojeek
NICErsPRO
NearSite
Needle
Nessus
Net Vampire
NetMechanic
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Octopus
Offline Navigator
Openvas
OrangeBot
OutfoxBot
PHPCrawl
PeoplePal
Piepmatz
Pockey
Probethenet
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
Rankivabot
RealDownload
RebelMouse
RedesScrapy
Ripper
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
ScoutJet
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
Seomoz
Shodan
Siphon
SiteExplorer
SiteSucker
Siteimprove
SlySearch
SocialRankIOBot
Sociscraper
Sottopop
Spinn3r
Sqworm
Steeler
SuperBot
SurveyBot
T0PHackTeam
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Toata
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
UnisterBot
VB Project
VCI
Vacuum
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WISENutbot
Wallpapers
Web Collage
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
Webalta
WebsiteExtractor
WebsiteQuester
Whack
Widow
WinHTTrack
Wotbox
Xaldon_WebSpider
Xenu
ZoomBot
ZumBot
ZyBorg
arquivo.pt
backlink-check
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher
internetVista monitor
meanpathbot
netEstate NE Crawler
page scorer
plumanalytics
polaris version
scan.lol
tAkeOut
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe
zgrab