nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-29 10:12:04 +00:00

100 lines
1.1 KiB
Text

AfD-Verbotsverfahren
AhrefsBot
Asterias
Atomseobot
AwarioBot
AwarioRssBot
BDFetch
BetaBot
Blow
BlowFish
Bolt
Bytespider
ChatGPT-User
CheeseBot
Copyscape
Crescent
DBLBot
DnBCrawler-Analytics
DomainStatsBot
EasyDL
EroCrawler
ExtLinksBot
Freeuploader
HonoluluBot
HybridBot
Iblog
ImagesiftBot
Indy Library
InfoTekies
Information Security Team InfraSec Scanner
Internet Ninja
InternetMeasurement
Jorgee
LNSpiderguy
LexiBot
Libwhisker
Likse
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
Ltx71
MTRobot
Metauri
NPbot
Nibbler
NimbleCrawler
Nmap
OpenVAS
OrangeSpider
POE-Component-Client-HTTP
PageThing.com
Piepmatz
Proximic
QueryN Metasearch
RSSingBot
Rainbot
RankActiveLinkBot
RankingBot
Rankivabot
RepoMonkey
RocketCrawler
ScanAlert
SemrushBot
SiteSnagger
Sitebeam
Sitevigil
Sogou web spider
Spinn3r
SputnikBot
Steeler
SurveyBot
Swiftbot
T0PHackTeam
TightTwatBot
Toata
Trendiction
Turnitin
URLy Warning
Vacuum
Web Collage
WebCopier
WebPix
WebStripper
WebmasterWorldForumBot
WebsiteExtractor
Whatweb
Who.is Bot
Xenu
awario.com
cah.io.community
crawl.sogou.com
heritrix
internetVista monitor
iubenda-radar
lwp-request
lwp-trivial
sp_auditbot
tAkeOut
x09Mozilla
zgrab