nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-01 22:13:44 +00:00

100 lines
1.2 KiB
Text

01h4x.com
80legs
ASPSeek
AfD-Verbotsverfahren
AllSubmitter
Alligator
Anthill
Badass
Barkrowler
Bigfoot
Bytespider
CSHttp
CazoodleBot
Cocolyzebot
DomainSigmaCrawler
Foobot
FrontPage
Gigabot
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HTTrack
Information Security Team InfraSec Scanner
Jyxobot
Keybot Translation-Search-Machine
LeechFTP
Linkbot
LinqiaMetadataDownloaderBot
MIIxpc
Masscan
Microsoft Data Access
Moblie Safari
Mozlila
Needle
Ninja
OpenVAS
PECL::HTTP
Page Analyzer
PictureFinder
ProWebWalker
RSSingBot
ReGet
SEOlyt
SEOprofiler
SMTBot
SalesIntelligent
ScrepyBot
SeekportBot
SemanticJuice
SemrushBot
SemrushBot-BA
SenutoBot
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
Sogou web spider
SpaceBison
Spammen
SpankBot
Sqlworm
The Intraformant
Titan
Toweyabot
VelenPublicWebCrawler
VidibleScraper
Voil
WEBDAV
WWW-Mechanize
Wallpapers
Wallpapers/3.0
Web Sucker
WebEnhancer
WebSucker
WebsiteQuester
Whack
Wprecon
ZoominfoBot
ZumBot
archive.org_bot
awario.com
crawler4j
demandbase-bot
evc-batch
heritrix
linkfluence
openai
plumanalytics
polaris version
probe-image-size
scan.lol
seobility
seocompany.store
sogouspider
sysscan
ubermetrics-technologies.com
x09Mozilla
x22Mozilla
zgrab