360Spider
404checker
404enemy
80legs
ALittle Client
Aboundex
Aboundexbot
Acunetix
Aipbot
Alexibot
Anarchie
Anthill
Aspiegel
Asterias
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackDoorBot
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle
Black Hole
BlowFish
Buck
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
CensysInspect
CheeseBot
Cocolyzebot
Cogentbot
Cosmos
CrazyWebCrawler
Curious
Custo
DIIbot
DTS Agent
DatabaseDriverMysqli
Digincore
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Download Wonder
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
Exabot
Express WebPictures
ExtractorPro
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GermCrawler
GetRight
GrabNet
Grafula
HEADMasterSEO
HTTrack
HaosouSpider
Harvest
Heritrix
Hloader
IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Sucker
Intelliseek
InterGET
InternetSeer
Iria
Iskanie
JennyBot
Jetty
Jorgee
Kinza
LNSpiderguy
Leap
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MIDown tool
Majestic SEO
MarkWatch
Mata Hari
MauiBot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NearSite
Net Vampire
NetLyzer
NetZIP
Netvibes
Niki-bot
Offline Explorer
OpenVAS
OrangeBot
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Papa Foto
Pavuk
PeoplePal
Pi-Monster
PictureFinder
Pixray
Pockey
Probethenet
Psbot
Pump
Quick-Crawler
RankActiveLinkBot
RankingBot
RankurBot
ReGet
RealDownload
Recorder
RocketCrawler
SBIder
SEOkicks
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
ScrepyBot
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
Snake
Sociscraper
Sosospider
Spammen
Sqlworm
Sqworm
Sucuri
SuperBot
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Titan
Toata
Toweyabot
Trendiction
Trendictionbot
URLy Warning
V-BOT
Vagabondo
VelenPublicWebCrawler
Virusdie
Voltron
WBSearchBot
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebCollage
WebCopier
WebFetch
WebLeacher
WebSauger
WebSucker
WebZIP
WebsiteQuester
Whacker
WinHTTrack
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
Zeus
ZoominfoBot
ZumBot
arquivo-web-crawler
cah.io.community
check1.exe
dataforseo.com
demandbase-bot
facebookscraper
gopher
heritrix
instabid
ips-agent
lwp-trivial
meanpathbot
page scorer
pcBrowser
plumanalytics
polaris version
seobility
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
sysscan
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
x22Mozilla
zgrab