80legs
ADmantX
AIBOT
Abonti
Aipbot
Anarchie
Anarchy
Anarchy99
Ankit
Apexoo
Asterias
Attach
AwarioSmartBot
BDCbot
BLEXBot
Bandit
BatchFTP
Bigfoot
Bitacle
Blackboard
Boardreader
Bolt
BotALot
Brandprotect
Brandwatch
CATExplorador
CazoodleBot
Cegbfeieh
CensysInspect
Chlooe
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crescent
CrunchBot
Curious
DBLBot
DIIbot
DTS Agent
Devil
Dirbuster
Discobot
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Ecxi
EroCrawler
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
Ezooms
FHscan
Fimap
Flunky
FyberSpider
Fyrebot
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla
GoZilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
IDBot
IRLbot
Iblog
InfoNaviRobot
Internet Ninja
Iria
JOC Web Spider
Jbrofuzz
JetCar
Jetty
JikeSpider
Joomla
Kozmosbot
LNSpiderguy
LWP::Simple
Leap
LeechFTP
Lftp
Libwhisker
Linkbot
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MJ12bot
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
MicroMessenger
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
Needle
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Nutch
Octopus
Offline Navigator
OnCrawl
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Papa Foto
Petalbot
Pi-Monster
Piepmatz
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
RankurBot
ReGet
RedesScrapy
SBIder
SEOkicks
ScanAlert
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeoSiteCheckup
Siphon
SiteExplorer
Snapbot
Snoopy
SputnikBot
Sqlmap
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
Szukacz
Telesoft
Thumbor
True_Robot
Twice
Upflow
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WISENutbot
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebImageCollector
WebReaper
WebStripper
WebSucker
WebWhacker
WebZIP
Webshag
WebsiteExtractor
Whatweb
Who.is Bot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zeus
Zitebot
ZoomBot
ZyBorg
cah.io.community
crawl.sogou.com
crawler.feedback
crawler4j
eCatch
gopher
heritrix
internetVista monitor
ips-agent
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
probe-image-size
ripz
satoristudio.net
seobility
seostar
siteripz
sogouspider
trendiction.com
trendiction.de
voyagerx.com
webpros.com
x09Mozilla
x22Mozilla
zgrab