nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-01 04:27:11 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
Acunetix
Anarchie
Ankit
Apexoo
BetaBot
Brandprotect
Buddy
CazoodleBot
ChinaClaw
Chlooe
Citoid
Claritybot
Devil
Discoverybot
DnBCrawler-Analytics
DomainAppender
EirGrabber
Evil
ExtractorPro
FHscan
GT::WWW
GetRight
GridBot
HTMLparser
HybridBot
IlseBot
Image Fetch
InfoNaviRobot
InfoTekies
JamesBOT
JetCar
Keybot Translation-Search-Machine
LeechGet
Litemage_walker
Majestic-SEO
MarkMonitor
Meanpathbot
Mediatoolkitbot
Minefield
Moblie Safari
Mr.4x3
Nuclei
Offline Explorer
Offline Navigator
Openfind
Openvas
Panscient
Pavuk
PyCurl
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Reaper
RedesScrapy
ScoutJet
ScreenerBot
ScrepyBot
SemanticJuice
Semrush
SemrushBot
SentiBot
SiteLockSpider
Sociscraper
Sucker
T8Abot
Toweyabot
Turingos
V-BOT
WISENutbot
WWWOFFLE
WeSEE
Web Enhancer
WebCopier
WebReaper
Whatweb
Wotbox
Xaldon_WebSpider
YoudaoBot
Zauba
ZoomBot
ZoominfoBot
archive.org_bot
backlink-check
com.plumanalytics
heritrix
instabid
internetVista monitor
isitwp.com
iubenda-radar
lwp-trivial
page scorer
plumanalytics
s1z.ru
sysscan
voyagerx.com
webmeup-crawler
x09Mozilla