nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-12 10:06:51 +00:00

100 lines
1 KiB
Text

404enemy
Atomseobot
AwarioSmartBot
Badass
Barkrowler
Battleztar Bazinga
Bigfoot
Blackboard
BlowFish
Bolt
BotALot
Bytespider
CherryPicker
Claritybot
Craftbot
CrunchBot
CyotekWebCopy
DBLBot
DTS Agent
Demon
Disco
Dispatch
DomCopBot
Fuzz
Fyrebot
GalaxyBot
HTMLparser
HaosouSpider
Iskanie
LWP::Simple
Larbin
LibWeb
LinkextractorPro
LinqiaScrapeBot
MIDown tool
MQQBrowser
MSIECrawler
Microsoft URL Control
Msrabot
NearSite
Netvibes
OnCrawl
Page Analyzer
Panscient
PeoplePal
Petalbot
Piepmatz
Pockey
Probethenet
RankActive
Rankivabot
RankurBot
Re-re
ReGet
RebelMouse
SemrushBot
Sqworm
Steeler
Stripper
SuperBot
Thumbor
Twice
VB Project
VidibleScraper
WASALive-Bot
WWW-Mechanize
Wallpapers
WeSEE
WebReaper
WebSauger
WebZIP
Website Quester
WebsiteQuester
Whacker
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zermelo
coccocbot
cognitiveseo
eCatch
evc-batch
facebookscraper
lwp-request
muhstik-scan
netEstate NE Crawler
oBot
page scorer
plumanalytics
s1z.ru
seoscanners
seostar
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
spyfu
tAkeOut