nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-11 22:04:47 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
ALittle Client
AdsTxtCrawlerTP
Anthill
BackDoorBot
BackWeb
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BetaBot
BlackWidow
BuiltBotTough
CATExplorador
CSHttp
Chlooe
Cogentbot
Copier
Cosmos
Craftbot
DIIbot
DataCha0s
Demon
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
Exabot
ExtractorPro
GT::WWW
Grabber
HEADMasterSEO
HaosouSpider
Hloader
Humanlinks
IRLbot
Iblog
Image Sucker
IndeedBot
InfoTekies
JustView
Kinza
Larbin
Lftp
Libwhisker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
MIIxpc
MarkWatch
MauiBot
Mb2345Browser
Microsoft Data Access
Nikto
Nmap
Openvas
PageGrabber
PictureFinder
Pimonster
PleaseCrawl
Pockey
PyCurl
RankFlex
RankingBot
SalesIntelligent
Scanbot
ScreenerBot
SentiBot
SeoSiteCheckup
Sitebeam
Snoopy
SpankBot
Spbot
Spinn3r
SuperBot
T8Abot
Toata
Tracemyfile
Turnitin
Typhoeus
WEBDAV
WISENutbot
WallpapersHD
Web Auto
Web Fuck
WebSucker
WebsiteExtractor
Xenu
check1.exe
dataforseobot
facebookscraper
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
s1z.ru
satoristudio.net
scan.lol
sysscan