nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-06 22:08:24 +00:00

100 lines
1.1 KiB
Text

360Spider
ADmantX
Abonti
Alligator
Anarchie
AwarioRssBot
AwarioSmartBot
BBBike
Badass
Bitacle
BotALot
Calculon
ChinaClaw
Cliqzbot
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
DataCha0s
Demon
DigitalPebble
DomCopBot
DomainAppender
EasyDL
EirGrabber
ExtractorPro
FDM
Firefox/7.0
Fuzz
GPTBot
GalaxyBot
GrapeshotCrawler
HaosouSpider
Iria
Iskanie
JetCar
Jorgee
Jyxobot
Keyword Density
Kozmosbot
Likse
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MQQBrowser
MTRobot
Metauri
Microsoft Data Access
Nameprotect
NearSite
Ninja
OrangeSpider
OutclicksBot
PECL::HTTP
PageAnalyzer
ProPowerBot
Psbot
QueryN Metasearch
RankingBot2
ReGet
SemrushBot-OCOB
SemrushBot-SWA
SentiBot
SenutoBot
Site Sucker
SiteLockSpider
Sitebeam
Snake
Sosospider
Spammen
Spbot
Sucuri
TeleportPro
TinyTestBot
Trendictionbot
Turingos
URLy.Warning
V-BOT
WISENutbot
WWW::Mechanize
Web Collage
WebWhacker
Webalta
Zauba
ZyBorg
arquivo-web-crawler
demandbase-bot
lwp-request
magpie-crawler
mediawords
page scorer
probe-image-size
seocompany.store
siteripz
ubermetrics-technologies.com
zgrab