nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-03-30 10:11:04 +00:00

100 lines
1 KiB
Text

360Spider
ASPSeek
Acunetix
AdsTxtCrawlerTP
Alexibot
Anarchy99
Anthill
BDCbot
BackWeb
Bandit
Bigfoot
Blackboard
BuiltWith
Cegbfeieh
Claritybot
Collector
DataCha0s
Dispatch
DomainAppender
EirGrabber
FemtosearchBot
Firefox/7.0
G-i-g-a-b-o-t
GrapeshotCrawler
GridBot
HEADMasterSEO
IDBTE4M
InfoTekies
InfraSec Scanner
Intelliseek
JOC Web Spider
JikeSpider
Kozmosbot
LNSpiderguy
Likse
Lmspider
MJ12bot
MeanPath Bot
MegaIndex.ru
Minefield
Nameprotect
Navroad
Nessus
NetMechanic
Nmap
Openvas
OrangeSpider
Petalbot
Piepmatz
PleaseCrawl
ProPowerBot
Quick-Crawler
RSSingBot
Rainbot
RankingBot
RedesScrapy
SeekportBot
Semrush
SemrushBot-OCOB
SemrushBot-SWA
Siphon
Snoopy
SpankBot
Sqlmap
Swiftbot
T0PHackTeam
T8Abot
TheNomad
True_Robot
Turingos
Turnitin
Twice
Upflow
Vacuum
WEBDAV
WPScan
WWW::Mechanize
Web Auto
Web Fuck
WebBandit
WebCollage
WebCopier
Website Quester
WebsiteQuester
YaK
Zauba
Zermelo
autoemailspider
coccocbot
dataforseobot
gopher
instabid
isitwp.com
iubenda-radar
openai
page scorer
probe-image-size
seobility
webmeup-crawler
zauba.io