360Spider
404checker
80legs
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy
Anarchy99
Anthill
Apexoo
Attach
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BacklinkCrawler
BatchFTP
Bigfoot
Boardreader
Bolt
Buck
BuiltWith
CCBot
CSHttp
CazoodleBot
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Collector
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Disco
Discoverybot
DnBCrawler-Analytics
DomainCrawler
Dragonfly
ECCP/1.0
EasyDL
Exabot
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
Go!Zilla
GoZilla
GrabNet
HEADMasterSEO
HMView
HTTrack
HaosouSpider
Havij
Heritrix
Hloader
Humanlinks
IDBTE4M
IDBot
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
Internet Ninja
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
JustView
Kenjin Spider
Larbin
Leap
LeechGet
Libwhisker
Lightspeedsystems
LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MQQBrowser
MSIECrawler
Magnet
Mail.RU_Bot
Masscan
Mb2345Browser
Microsoft URL Control
Minefield
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Name Intelligence
Nameprotect
Nessus
NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Not
OpenVAS
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
Pandalytics
Panscient
Petalbot
PleaseCrawl
Pockey
PyCurl
QueryN Metasearch
RSSingBot
RankActive
Rankivabot
RankurBot
ReGet
Reaper
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
ScanAlert
Screaming
SentiBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SmartDownload
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
SpankBot
Spanner
SputnikBot
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
Szukacz
T8Abot
The Intraformant
Titan
Trendiction
Trendictionbot
True_Robot
TurnitinBot
Twice
Typhoeus
UnisterBot
Upflow
V-BOT
VCI
VelenPublicWebCrawler
Virusdie
Voltron
WISENutbot
WPScan
Wallpapers
Web Fetch
Web Fuck
WebCollage
WebCopier
WebEnhancer
WebFetch
WebImageCollector
Webster
Whack
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
Zade
Zeus
Zitebot
ZmEu
ZyBorg
adscanner
autoemailspider
cah.io.community
clark-crawler
coccocbot-web
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
evc-batch
facebookscraper
gopher
instabid
lwp-request
magpie-crawler
mediawords
netEstate NE Crawler
oBot
page scorer
probe-image-size
ripz
seoscanners
serpstatbot
sp_auditbot
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
x09Mozilla