nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-19 10:07:56 +00:00

100 lines
1 KiB
Text

01h4x.com
ADmantX
AdsTxtCrawlerTP
AllSubmitter
Anarchy
Anthill
Aspiegel
BBBike
BackWeb
Barkrowler
Bigfoot
Blackboard
BlowFish
Brandwatch
BuiltBotTough
BuzzSumo
CazoodleBot
Citoid
Claritybot
Cogentbot
CrunchBot
Custo
Devil
Digincore
DittoSpyder
Dragonfly
EMail Siphon
Ebingbong
EroCrawler
ExtLinksBot
Extractor
Fimap
GPTBot
GetWeb
Getintent
HTMLparser
Havij
JOC Web Spider
Litemage_walker
Lmspider
Ltx71
MIIxpc
MQQBrowser
Magnet
MegaIndex.ru
MicroMessenger
Mister PiX
Net Vampire
NetZIP
Niki-bot
Nmap
OpenVAS
OrangeSpider
Page Analyzer
PleaseCrawl
RepoMonkey
Rogerbot
SEOlyt
SISTRIX
ScoutJet
SearchmetricsBot
Seekport
SentiBot
SeoCherryBot
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
Snoopy
Spider_Bot/3.0
SuperHTTP
T8Abot
TinyTestBot
Tracemyfile
Twice
WWWOFFLE
Web Auto
Web Sucker
WebFuck
WebPix
WebStripper
WebsiteQuester
Wonderbot
Wprecon
arquivo.pt
awario.com
crawler4j
evc-batch
iubenda-radar
lwp-request
openai
openai.com
page scorer
plumanalytics
polaris version
probe-image-size
scalaj-http
trendiction.de
webpros.com
xpymep1.exe