nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-17 22:08:23 +00:00

100 lines
1 KiB
Text

01h4x.com
Badass
BatchFTP
Black Hole
Blow
BuzzSumo
CCBot
Chlooe
Cloud mapping
Copier
Disco
Discobot
Dispatch
DnyzBot
DomainSigmaCrawler
Dotbot
ECCP/1.0
Ebingbong
Evil
Express WebPictures
FemtosearchBot
Fimap
FlashGet
Flunky
Fuzz
FyberSpider
Gotit
GrapeshotCrawler
HaosouSpider
Hloader
Humanlinks
JustView
Keybot Translation-Search-Machine
Leap
Lmspider
Majestic-SEO
Majestic12
Meanpathbot
MicroMessenger
Mojeek
NearSite
NetZIP
NextGenSearchBot
Nibbler
Offline Explorer
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Pavuk
PeoplePal
PictureFinder
RankurBot
ReGet
Ripper
SEOkicks
SEOkicks-Robot
Scrapy
SeekportBot
SemrushBot
SeobilityBot
SiteAuditBot
Sitebeam
Snake
Spanner
Spbot
SuperHTTP
SurveyBot
Telesphorep
Thumbor
Tracemyfile
Turnitin
URLy.Warning
V-BOT
VB Project
Vacuum
WBSearchBot
WWW-Mechanize
WallpapersHD
Web Pix
WebCollage
WebEnhancer
WebReaper
Whack
Wprecon
Xaldon WebSpider
YaK
YoudaoBot
Zermelo
ZmEu
awario.com
check1.exe
crawl.sogou.com
domainsproject.org
heritrix
ips-agent
linkdexbot
muhstik-scan
sysscan
webpros.com
zauba.io