nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-14 22:04:47 +00:00

100 lines
1.1 KiB
Text

01h4x.com
360Spider
404enemy
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
Attach
BackDoorBot
Bandit
BlackWidow
Bolt
Buck
BuiltBotTough
BuiltWith
ChatGPT-User
Cloud mapping
DBLBot
Discobot
DomCopBot
Ecxi
Express WebPictures
ExtractorPro
FlashGet
Foobot
G-i-g-a-b-o-t
GoZilla
HaosouSpider
IlseBot
IndeedBot
Indy Library
InfoTekies
InternetSeer
JOC Web Spider
Jyxobot
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Linkbot
Lmspider
MIDown tool
Majestic-SEO
Majestic12
Masscan
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
NICErsPRO
Nameprotect
NearSite
Nikto
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Petalbot
PictureFinder
Piepmatz
Probethenet
Reaper
Recorder
SMTBot
SearchmetricsBot
SeekportBot
SeobilityBot
Site Sucker
SiteLockSpider
Teleport
TinyTestBot
Vacuum
Voltron
WASALive-Bot
WEBDAV
Wallpapers
WeSEE
Web Enhancer
Web Sucker
WebFetch
WebGo IS
WebZIP
WebsiteExtractor
WebsiteQuester
Zitebot
arquivo-web-crawler
awario.com
cah.io.community
domainsproject.org
facebookscraper
heritrix
instabid
internetVista monitor
iubenda-radar
openai
pcBrowser
seocompany.store
siteripz
webpros.com
webprosbot