nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-08 10:07:30 +00:00

100 lines
1 KiB
Text

AIBOT
Apexoo
Asterias
BacklinksExtendedBot
Bullseye
CODE87
Calculon
Cloud mapping
Custo
DIIbot
DTS Agent
Demon
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
Exabot
Foobot
GPTBot
GT::WWW
Gotit
GrapeshotCrawler
HMView
HTTrack
Heritrix
HybridBot
Iblog
InternetMeasurement
Iria
Keyword Density
Lanshanbot
Leap
Lightspeedsystems
Likse
MFC_Tear_Sample
MSFrontPage
Majestic SEO
MarkMonitor
MarkWatch
Mata Hari
Mister PiX
Moblie Safari
MolokaiBot
Name Intelligence
Needle
NetLyzer
Offline Navigator
OpenVAS
Page Analyzer
PageGrabber
Piepmatz
PleaseCrawl
Pockey
Psbot
PyCurl
Rogerbot
SBIder
SEOkicks-Robot
Screaming
SeoCherryBot
Shodan
Sitevigil
SputnikBot
SurveyBot
Szukacz
Telesphorep
Upflow
VelenPublicWebCrawler
VidibleScraper
Voil
WBSearchBot
WWW-Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Enhancer
Web Sucker
WebAuto
WebEnhancer
WebFetch
WebZIP
WebsiteExtractor
WebsiteQuester
Whack
Whatweb
Wprecon
YaK
Zitebot
adscanner
backlink-check
coccocbot
cognitiveseo
crawler4j
instabid
lwp-request
oBot
pcBrowser
tAkeOut
webprosbot
x09Mozilla