nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-09 22:05:04 +00:00

100 lines
1 KiB
Text

AIBOT
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
BBBike
BDCbot
BDFetch
Bolt
Brandwatch
BuiltWith
CATExplorador
CensysInspect
Copier
Deusu
Discobot
DnBCrawler-Analytics
Drip
EirGrabber
Evil
Exabot
Express WebPictures
FDM
Genieo
Go!Zilla
HTTrack
Haansoft
Heritrix
Hloader
IDBTE4M
InfoNaviRobot
Intelliseek
Iria
JetCar
JikeSpider
LWP::Simple
LibWeb
LinkpadBot
Litemage_walker
MIDown tool
Majestic SEO
MeanPath Bot
Mojolicious
NetAnts
NetLyzer
NetSpider
Ninja
Nmap
Offline Explorer
OnCrawl
OutfoxBot
PHPCrawl
PageGrabber
Papa Foto
PleaseCrawl
Probethenet
Proximic
RSSingBot
RealDownload
SEOlyticsCrawler
Shodan
Siteimprove
Snapbot
Snoopy
Sogou web spider
Spinn3r
SurveyBot
T0PHackTeam
Telesphorep
The Intraformant
TinyTestBot
Typhoeus
Vacuum
VelenPublicWebCrawler
VoidEYE
WWW-Mechanize
Wallpapers
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebLeacher
Webalta
Webster
Zauba
Zermelo
Zitebot
adscanner
coccocbot
evc-batch
instabid
lwp-trivial
magpie-crawler
scalaj-http
seocompany.store
seostar
serpstatbot
sitechecker.pro
ubermetrics-technologies.com
x09Mozilla
zgrab