404enemy
80legs
AIBOT
ALittle Client
ASPSeek
Abonti
Aipbot
Alexibot
Alligator
Ankit
Apexoo
Aspiegel
Asterias
BDCbot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Badass
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
BlowFish
Brandprotect
Brandwatch
Buck
BuiltBotTough
CATExplorador
CCBot
CSHttp
CensysInspect
CheTeam
CheeseBot
Chlooe
Citoid
Cliqzbot
Cogentbot
Collector
Cosmos
Crescent
CrunchBot
DBLBot
DTS Agent
Dispatch
DomCopBot
DomainSigmaCrawler
Download Wonder
Drip
EasyDL
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
Fimap
Firefox/7.0
FlashGet
Foobot
Go-Ahead-Got-It
Gotit
GrabNet
HTMLparser
HTTP::Lite
Heritrix
IDBTE4M
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
InternetSeer
JetCar
Jetty
Jorgee
Kenjin Spider
Kozmosbot
LNSpiderguy
Larbin
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MauiBot
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
Mozlila
NICErsPRO
NPbot
Nameprotect
Navroad
Needle
Net Vampire
NetSpider
NetZIP
Netcraft
Nikto
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Picscout
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
Pockey
Psbot
PyCurl
QueryN Metasearch
RankActive
RankFlex
Re-re
RealDownload
Reaper
RebelMouse
RedesScrapy
Rogerbot
SEOstats
SMTBot
SalesIntelligent
ScoutJet
Scrapy
Screaming
Seekport
SemrushBot
SeoSiteCheckup
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SlySearch
Snake
Snoopy
Sottopop
SpaceBison
Spammen
Spanner
Spbot
Spinn3r
Sqlworm
Sqworm
Steeler
Stripper
Suzuran
Swiftbot
Szukacz
Teleport
TeleportPro
Telesphoreo
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
True_Robot
TwengaBot
Twice
Typhoeus
URLy.Warning
Upflow
VB Project
Vagabondo
VidibleScraper
VoidEYE
WASALive-Bot
WEBDAV
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Collage
WebBandit
WebCollage
WebEnhancer
WebFetch
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whatweb
WinHTTrack
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zeus
ZmEu
ZoominfoBot
adscanner
arquivo-web-crawler
autoemailspider
clark-crawler
dataforseo.com
facebookscraper
gopher
ips-agent
iubenda-radar
lwp-request
meanpathbot
oBot
pcBrowser
plumanalytics
probe-image-size
scalaj-http
seoscanners
seostar
sogouspider
trendiction.com
trendiction.de
ubermetrics-technologies.com
webprosbot
x22Mozilla
zgrab