nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-09 22:05:02 +00:00

100 lines
1.1 KiB
Text

AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
Anarchy
Aspiegel
BLEXBot
Backlink-Ceck
Bandit
BuiltBotTough
Bullseye
CensysInspect
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
Curious
Custo
DSearch
Discobot
Discoverybot
DnBCrawler-Analytics
DomainStatsBot
Express WebPictures
Extreme Picture Finder
FHscan
Fyrebot
Gotit
Grabber
HMView
HTMLparser
InterGET
Jbrofuzz
JetCar
Jyxobot
Kozmosbot
LNSpiderguy
LinkWalker
MauiBot
MicroMessenger
Mozlila
Musobot
Name Intelligence
Nameprotect
Navroad
NetLyzer
NetSpider
Openvas
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
Picscout
Piepmatz
Pimonster
PxBroker
RankActiveLinkBot
Rankivabot
RedesScrapy
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
Scrapy
SeoSiteCheckup
Seomoz
Shodan
Siphon
Site Sucker
SiteLockSpider
Sociscraper
Sqworm
Sucuri
Szukacz
T0PHackTeam
TheNomad
True_Robot
Turingos
V-BOT
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WBSearchBot
WWWOFFLE
Web Fetch
WebAuto
WebFetch
Webalta
Whatweb
autoemailspider
check1.exe
cognitiveseo
crawl.sogou.com
page scorer
probe-image-size
siteripz
webprosbot