nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-14 10:11:26 +00:00

100 lines
1.1 KiB
Text

404checker
80legs
ADmantX
ALittle Client
ASPSeek
Aboundexbot
Acunetix
Aspiegel
Asterias
AwarioBot
Blackboard
Brandprotect
CensysInspect
Cocolyzebot
ECCP/1.0
EMail Siphon
EasyDL
Evil
Freeuploader
FrontPage
GT::WWW
Genieo
GetRight
Grafula
IDBTE4M
IDBot
InfoTekies
InfraSec Scanner
InterGET
Internet Ninja
Joomla
Lftp
MFC_Tear_Sample
MIIxpc
Mail.RU_Bot
MarkWatch
Masscan
Metauri
Microsoft Data Access
Mojeek
Mozlila
Nameprotect
Navroad
NetLyzer
NetSpider
NetZIP
Octopus
Offline Explorer
OrangeSpider
PageAnalyzer
PageScorer
Pavuk
PleaseCrawl
Pump
Quick-Crawler
ReGet
Reaper
SMTBot
ScanAlert
ScreenerBot
SemrushBot
SemrushBot-BA
SemrushBot-FT
SemrushBot-OCOB
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
Sogou web spider
Spbot
Spider_Bot/3.0
Spinn3r
SputnikBot
TeleportPro
The Intraformant
TwengaBot
V-BOT
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WEBDAV
Wallpapers
Web Enhancer
Web Pix
WebReaper
WebSauger
WebStripper
Webalta
Xaldon_WebSpider
Zitebot
arquivo-web-crawler
crawl.sogou.com
crawler.feedback
dataforseobot
isitwp.com
openai
sitechecker.pro
sp_auditbot
voyagerx.com
webprosbot