nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-28 22:04:48 +00:00

100 lines
1 KiB
Text

404checker
ASPSeek
Aboundex
AhrefsBot
Atomseobot
Blow
Boardreader
BotALot
Buck
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
Cocolyzebot
Crescent
Digincore
Disco
Dispatch
DnyzBot
DomainSigmaCrawler
ExtractorPro
FemtosearchBot
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
GermCrawler
GetWeb
HaosouSpider
Havij
Humanlinks
IRLbot
IndeedBot
Indy Library
JikeSpider
Kinza
Kozmosbot
LibWeb
LinkWalker
Litemage_walker
MJ12bot
Mail.RU_Bot
MarkWatch
Mata Hari
MauiBot
Microsoft Data Access
NetAnts
NetMechanic
Offline Explorer
OnCrawl
Openvas
PECL::HTTP
Panscient
Petalbot
Pi-Monster
Pimonster
Pu_iN
PxBroker
RSSingBot
RankFlex
Rogerbot
SEOkicks-Robot
SenutoBot
SiteExplorer
Sociscraper
Sogou web spider
Sottopop
SuperBot
Teleport
Thumbor
Turingos
TurnitinBot
TwengaBot
UnisterBot
Upflow
Vacuum
WASALive-Bot
WPScan
WWW-Collector-E
Web Enhancer
WebFuck
WebReaper
WebSauger
Wotbox
Xenu
ZmEu
cah.io.community
crawler4j
dataforseobot
netEstate NE Crawler
oBot
openai
seocompany.store
serpstatbot
sexsearcher
sogouspider
trendiction.de
x09Mozilla