80legs
ALittle Client
Abonti
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy99
AwarioRssBot
BBBike
BackWeb
Backlink-Ceck
BacklinkCrawler
BetaBot
Bigfoot
Blackboard
BlowFish
BotALot
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CSHttp
CensysInspect
CheeseBot
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
Copyscape
Crawling at Home Project
DataCha0s
Deusu
Devil
DigitalPebble
Dirbuster
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FemtosearchBot
Fimap
Freeuploader
FyberSpider
GalaxyBot
GetRight
Go-Ahead-Got-It
GrabNet
GridBot
HTTP::Lite
Harvest
Havij
HonoluluBot
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
InterGET
Iria
JOC Web Spider
Jetty
JikeSpider
Joomla
Keyword Density
LWP::Simple
Larbin
Leap
LeechFTP
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkbot
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MSFrontPage
Magnet
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Nameprotect
Needle
Nessus
Net Vampire
NetMechanic
NetZIP
Netcraft
Nettrack
Niki-bot
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Petalbot
Pimonster
ProWebWalker
Probethenet
Psbot
RankFlex
Re-re
RedesScrapy
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SalesIntelligent
SemanticJuice
SeobilityBot
Shodan
SiteSucker
SlySearch
Snake
Sociscraper
Sottopop
Sqlmap
Sqlworm
Sucuri
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Titan
Toweyabot
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow
VB Project
VCI
Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
WISENutbot
WPScan
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Fetch
Web Sauger
WebBandit
WebCopier
WebFetch
WebGo IS
WebLeacher
WebPix
WebSauger
WebSucker
WebZIP
WebmasterWorldForumBot
Whacker
Whatweb
Xaldon WebSpider
YoudaoBot
Zermelo
Zeus
ZoominfoBot
archive.org_bot
autoemailspider
backlink-check
clark-crawler
coccocbot-web
cognitiveseo
crawler4j
dataforseo.com
heritrix
instabid
ips-agent
isitwp.com
lwp-request
netEstate NE Crawler
pcBrowser
probe-image-size
s1z.ru
satoristudio.net
scan.lol
seostar
serpstatbot
sitechecker.pro
siteripz
sp_auditbot
sysscan
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
zgrab