404enemy
80legs
ADmantX
ALittle Client
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchy99
Attach
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackWeb
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
BlackWidow
BlowFish
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
Calculon
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Chlooe
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DSearch
Deusu
Devil
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dragonfly
Drip
EasyDL
Ecxi
EirGrabber
EroCrawler
Exabot
Extractor
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GoZilla
HEADMasterSEO
HMView
HTTrack
Haansoft
HaosouSpider
Harvest
Hloader
Humanlinks
HybridBot
IDBTE4M
IRLbot
IlseBot
Image Fetch
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
Iria
JikeSpider
Jorgee
Jyxobot
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
Larbin
Leap
LibWeb
Libwhisker
Likse
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Mail.RU_Bot
Mass Downloader
Meanpathbot
MegaIndex.ru
Minefield
Mister PiX
Moblie Safari
Mozlila
Musobot
NearSite
Net Vampire
NetZIP
Nibbler
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OutfoxBot
POE-Component-Client-HTTP
PageScorer
PageThing.com
Panscient
Petalbot
Pi-Monster
Piepmatz
Pimonster
Pixray
PleaseCrawl
Probethenet
Pu_iN
Quick-Crawler
RankActiveLinkBot
Rankivabot
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
SpankBot
Spanner
Steeler
Stripper
SuperBot
SuperHTTP
SurveyBot
Szukacz
T0PHackTeam
T8Abot
Teleport
The Intraformant
Titan
Trendiction
True_Robot
Turingos
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
V-BOT
Vagabondo
Voil
Voltron
WASALive-Bot
WEBDAV
WPScan
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Pix
WebEnhancer
WebFetch
WebImageCollector
WebSucker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whacker
WinHTTrack
Wonderbot
Woobot
Wotbox
Xenu
YoudaoBot
Zade
Zeus
ZoomBot
archive.org_bot
arquivo-web-crawler
cah.io.community
clark-crawler
cognitiveseo
crawler.feedback
demandbase-bot
evc-batch
instabid
lwp-request
lwp-trivial
meanpathbot
polaris version
scalaj-http
sexsearcher
sitechecker.pro
sp_auditbot
tAkeOut
webprosbot
x09Mozilla
zgrab