nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-20 10:11:44 +00:00

100 lines
1 KiB
Text

404checker
AIBOT
ASPSeek
Badass
Buddy
Bullseye
BunnySlippers
CODE87
CSHttp
Cegbfeieh
Cliqzbot
Domains Project
ExtractorPro
FemtosearchBot
FlashGet
Flunky
Foobot
Fuzz
G-i-g-a-b-o-t
GalaxyBot
Genieo
GoZilla
GrabNet
Haansoft
HaosouSpider
Harvest
Heritrix
IlseBot
Image Fetch
InfraSec Scanner
Iskanie
JennyBot
JikeSpider
Joomla
Kinza
Lanshanbot
Larbin
LibWeb
LinkpadBot
Magnet
MeanPath Bot
Meanpathbot
MegaIndex.ru
Minefield
Mojeek
NearSite
NetZIP
Nibbler
NimbleCrawler
Octopus
OnCrawl
Openvas
Picsearch
Piepmatz
PxBroker
RankurBot
SemrushBot-BA
SemrushBot-SWA
SeoCherryBot
Siphon
SiteAuditBot
Sitebeam
Sitevigil
Snoopy
Stripper
Sucker
Telesphorep
Titan
Turingos
TurnitinBot
UnisterBot
VB Project
VelenPublicWebCrawler
Voltron
WPScan
Web Sucker
WebBandit
WebImageCollector
WebReaper
WebsiteExtractor
WebsiteQuester
Xaldon_WebSpider
YoudaoBot
Zeus
Zitebot
ZoominfoBot
backlink-check
com.plumanalytics
crawler4j
demandbase-bot
evc-batch
meanpathbot
mediawords
s1z.ru
seoscanners
serpstatbot
sysscan
webgains-bot
webpros.com
x09Mozilla