360Spider
80legs
AIBOT
ALittle Client
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Anarchy
Anarchy99
Ankit
Atomseobot
BDCbot
BacklinkCrawler
Battleztar Bazinga
Bitacle
Black Hole
Blow
BlowFish
Boardreader
BotALot
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Citoid
Cliqzbot
Cocolyzebot
CopyRightCheck
Crawling at Home Project
Crescent
DIIbot
DSearch
DTS Agent
Demon
Devil
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DomCopBot
DomainStatsBot
Domains Project
Dragonfly
EasyDL
Ebingbong
EirGrabber
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Foobot
Fuzz
GalaxyBot
Getintent
Go-Ahead-Got-It
GoZilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
Haansoft
Heritrix
Humanlinks
HybridBot
IDBTE4M
IlseBot
Image Fetch
Image Sucker
Indy Library
Intelliseek
InterGET
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
JustView
Jyxobot
Keybot Translation-Search-Machine
Kozmosbot
Larbin
LeechFTP
Libwhisker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MJ12bot
MTRobot
Magnet
Majestic SEO
Masscan
MauiBot
MeanPath Bot
Metauri
MicroMessenger
Minefield
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot
Navroad
Needle
Nessus
NetLyzer
NetSpider
NetZIP
Not
Nuclei
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
PECL::HTTP
PHPCrawl
PageThing.com
Pixray
PleaseCrawl
Pockey
Probethenet
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Re-re
Reaper
Ripper
SBIder
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Seekport
SemanticJuice
Semrush
SemrushBot
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
SlySearch
Sociscraper
Sogou web spider
Sottopop
Spammen
SpankBot
Spanner
Stripper
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesphorep
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
VCI
Vagabondo
Voltron
WBSearchBot
WWW-Mechanize
WallpapersHD
Web Enhancer
WebBandit
WebReaper
WebSauger
Webster
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
ZmEu
ZoomBot
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
com.plumanalytics
eCatch
gopher
internetVista monitor
lwp-request
lwp-trivial
magpie-crawler
page scorer
pcBrowser
plumanalytics
scan.lol
seostar
sitechecker.pro
sogouspider
spyfu
tAkeOut
webgains-bot
webmeup-crawler
x09Mozilla
xpymep1.exe