360Spider
AIBOT
AfD-Verbotsverfahren
Anarchy99
Asterias
BDCbot
Barkrowler
Brandwatch
BuiltBotTough
Cegbfeieh
Crescent
Discoverybot
DittoSpyder
DnyzBot
DomainStatsBot
Flunky
Fuzz
GalaxyBot
Go!Zilla
Google-Extended
Gotit
HMView
HTTP::Lite
IDBot
IRLbot
Image Fetch
Image Sucker
Iria
Jbrofuzz
Keyword Density
Kinza
Lftp
LinkextractorPro
LinqiaRSSBot
Ltx71
MFC_Tear_Sample
MIDown tool
MegaIndex.ru
Mr.4x3
Msrabot
Musobot
Navroad
Needle
Nessus
Net Vampire
NetSpider
NextGenSearchBot
NimbleCrawler
Octopus
OpenLinkProfiler
OutclicksBot
PageScorer
PageThing.com
Panscient
Pixray
PleaseCrawl
ProWebWalker
Proximic
RankActive
SEOlyticsCrawler
SISTRIX
Scanbot
Semrush
SemrushBot
Sitebeam
Siteimprove
Sogou web spider
Sottopop
Spammen
SpankBot
SurveyBot
Trendictionbot
Turingos
WEBDAV
Wallpapers/3.0
Web Sauger
WebBandit
WebCollage
WebZIP
WebsiteExtractor
Whack
Whacker
Woobot
Xaldon WebSpider
Xaldon_WebSpider
arquivo.pt
autoemailspider
cohere-ai
linkfluence
magpie-crawler
muhstik-scan
omgili
scalaj-http
seobility
siteripz
sysscan
trendiction.de
x09Mozilla
xpymep1.exe
zgrab