nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-26 10:07:42 +00:00

100 lines
1.1 KiB
Text

404checker
AIBOT
ASPSeek
Aboundexbot
Anthill
BBBike
Barkrowler
BatchFTP
BetaBot
Bolt
Bytespider
Cegbfeieh
Copyscape
CrazyWebCrawler
Crescent
CrunchBot
DittoSpyder
DnyzBot
DomainCrawler
DomainStatsBot
ECCP/1.0
EasyDL
Ezooms
GPTBot
Grafula
GrapeFX
Harvest
IRLbot
IndeedBot
Indy Library
Information Security Team InfraSec Scanner
Jetty
Kenjin Spider
LexiBot
Lipperhey
MicroMessenger
Moblie Safari
Nameprotect
Navroad
Net Vampire
NetSpider
Netvibes
NimbleCrawler
Nimbostratus
Nmap
Nutch
Octopus
Pimonster
PleaseCrawl
ProPowerBot
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankurBot
Recorder
SEOkicks
ScoutJet
ScreenerBot
SearchmetricsBot
SentiBot
SiteExplorer
SiteSnagger
SpankBot
Stripper
Sucker
SuperHTTP
T0PHackTeam
Telesphoreo
TightTwatBot
True_Robot
TwengaBot
Typhoeus
URLy Warning
V-BOT
VeriCiteCrawler
WEBDAV
WISENutbot
Wallpapers/3.0
Web Enhancer
WebBandit
Website Quester
Whack
Widow
Woobot
YaK
arquivo-web-crawler
cah.io.community
cohere-ai
com.plumanalytics
instabid
ips-agent
openai.com
page scorer
sitechecker.pro
sysscan
voyagerx.com
webmeup-crawler
xpymep1.exe
zauba.io