nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-03 10:07:39 +00:00

100 lines
1.1 KiB
Text

AIBOT
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Alexibot
AlphaBot
Anarchie
BackStreet
Barkrowler
BlackWidow
Blackboard
Blow
Bullseye
Copier
Craftbot
Dispatch
DomainStatsBot
Download Wonder
EMail Wolf
FemtosearchBot
Firefox/7.0
GT::WWW
GetRight
Grafula
GrapeFX
IDBot
IstellaBot
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LieBaoFast
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
MIDown tool
MQQBrowser
Mass Downloader
MegaIndex.ru
Mojeek
NICErsPRO
Navroad
Nibbler
Nikto
Nutch
Offline Explorer
OnCrawl
POE-Component-Client-HTTP
Page Analyzer
Piepmatz
ProWebWalker
Probethenet
Quick-Crawler
RankFlex
RankingBot
Re-re
Recorder
RepoMonkey
Rogerbot
SEOkicks
ScreenerBot
Searchestate
SiteSnagger
Sucuri
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
Turingos
VelenPublicWebCrawler
WebSauger
WebSucker
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Whacker
Whatweb
WiseGuys Robot
Woobot
Wprecon
Xenu
YoudaoBot
ZmEu
cognitiveseo
crawler.feedback
demandbase-bot
evc-batch
magpie-crawler
netEstate NE Crawler
page scorer
polaris version
ripz
scalaj-http
xpymep1.exe
zauba.io