nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-09-02 10:13:13 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Aboundexbot
AfD-Verbotsverfahren
BLEXBot
Battleztar Bazinga
Bolt
Buddy
CCBot
CSHttp
Cegbfeieh
CheTeam
Claritybot
Copyscape
Curious
DSearch
Demon
Discobot
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
ECCP/1.0
Evil
EyeNetIE
FacebookBot
FemtosearchBot
FyberSpider
GrabNet
Grafula
HTMLparser
HTTrack
Harvest
Heritrix
HonoluluBot
Iblog
JikeSpider
Kenjin Spider
LeechFTP
Mail.RU_Bot
Mass Downloader
MegaIndex.ru
Microsoft Data Access
Minefield
Needle
Net Vampire
NetLyzer
Nibbler
Ninja
OpenVAS
OutclicksBot
PECL::HTTP
PageGrabber
PageScorer
Pavuk
Ripper
SBIder
SemrushBot-BA
SemrushBot-OCOB
SemrushBot-SI
Shodan
SiteAuditBot
SiteExplorer
Spanner
Spider_Bot
Spinn3r
SurveyBot
Szukacz
Telesphoreo
Thumbor
Tracemyfile
URLy Warning
URLy.Warning
VB Project
VoidEYE
WASALive-Bot
Web Auto
WebCopier
WebReaper
WebZIP
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
YoudaoBot
archive.org_bot
backlink-check
clark-crawler
coccocbot
domainsproject.org
facebookscraper
imagesift.com
internetVista monitor
muhstik-scan
page scorer
plumanalytics
sitechecker.pro
sysscan
voyagerx.com
webpros.com
zgrab