nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-14 22:05:07 +00:00

100 lines
1 KiB
Text

01h4x.com
AdsTxtCrawlerTP
AiHitBot
Anarchie
Anarchy99
AwarioRssBot
BackDoorBot
BotALot
Brandwatch
Bullseye
CATExplorador
CazoodleBot
CensysInspect
Cloud mapping
Collector
Copyscape
Cosmos
Curious
DIIbot
Devil
Digincore
Dirbuster
Disco
EMail Wolf
EroCrawler
Exabot
Ezooms
G-i-g-a-b-o-t
GT::WWW
Getintent
Gotit
GrapeshotCrawler
HaosouSpider
HybridBot
Image Sucker
Intelliseek
Keyword Density
Kozmosbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MSFrontPage
Mb2345Browser
Meanpathbot
Metauri
NetLyzer
NetSpider
Netcraft
NextGenSearchBot
PageGrabber
Panscient
PictureFinder
Probethenet
RankingBot
RankurBot
Reaper
Ripper
SEOkicks
SEOprofiler
SISTRIX
Screaming
ScreenerBot
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
Sociscraper
SpaceBison
Surfbot
SurveyBot
Telesphoreo
Telesphorep
Trendiction
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
VCI
VeriCiteCrawler
VidibleScraper
WBSearchBot
WeSEE
Web Enhancer
Web Pix
WebAuto
WebZIP
Zauba
autoemailspider
cah.io.community
com.plumanalytics
eCatch
muhstik-scan
s1z.ru
scan.lol
seoscanners
sexsearcher
sp_auditbot
sysscan