nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-09-11 10:12:19 +00:00

100 lines
1.1 KiB
Text

AhrefsBot
AiHitBot
Ankit
Atomseobot
BacklinksExtendedBot
BlackWidow
CATExplorador
CODE87
CensysInspect
CheeseBot
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Copyscape
DBLBot
DSearch
DatabaseDriverMysqli
Devil
Dirbuster
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
EMail Wolf
ExtLinksBot
Ezooms
FHscan
GPTBot
GT::WWW
GeedoProductSearch
Getintent
HMView
HaosouSpider
Id-search
ImagesiftBot
InfoTekies
InfraSec Scanner
Kozmosbot
Lanshanbot
Litemage_walker
Ltx71
MIIxpc
MSIECrawler
Mag-Net
Mass Downloader
Meanpathbot
MolokaiBot
Mozlila
Net Vampire
NextGenSearchBot
Octopus
OutclicksBot
Page Analyzer
PageScorer
Pavuk
Pockey
PyCurl
Re-re
RepoMonkey
ScrepyBot
Seekport
SemrushBot
SemrushBot-OCOB
Sitebeam
Sottopop
Spammen
Stripper
Swiftbot
TightTwatBot
Titan
Trendiction
TurnitinBot
VCI
Voil
WeSEE
Web Fuck
Web Pix
WebBandit
WebEnhancer
WebLeacher
WebZIP
WebmasterWorldForumBot
Whack
Woobot
Wotbox
Xenu
Zauba
anthropic-ai
backlink-check
cognitiveseo
crawler.feedback
dataforseobot
domainsproject.org
evc-batch
plumanalytics
sexsearcher
sogouspider
trendiction.de
voyagerx.com
webmeup-crawler