nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-13 10:06:55 +00:00

100 lines
1.1 KiB
Text

Aboundexbot
AiHitBot
Anarchie
Anthill
Aspiegel
Asterias
AwarioBot
BackDoorBot
BacklinkCrawler
BlowFish
CODE87
CensysInspect
ChatGPT-User
Cocolyzebot
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
DIIbot
DatabaseDriverMysqli
Discoverybot
Dispatch
DittoSpyder
DomainAppender
Fyrebot
Gigabot
GoZilla
Google-Extended
Gotit
IRLbot
Image Sucker
JetCar
LNSpiderguy
Lanshanbot
LinkScan
LinqiaRSSBot
Lipperhey
Majestic12
MarkMonitor
MauiBot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Moblie Safari
MolokaiBot
Needle
NetAnts
NetSpider
Netcraft
Nettrack
Nutch
Offline Explorer
PHPCrawl
ProPowerBot
Probethenet
Quick-Crawler
RSSingBot
RankingBot
RankingBot2
SBIder
SEOkicks
SEOkicks-Robot
ScanAlert
SeekportBot
SemrushBot
Seomoz
Siphon
Site Sucker
Snapbot
Sqlworm
Sucuri
TeleportPro
The Intraformant
Toata
Trendiction
TwengaBot
VB Project
WEBDAV
Web Auto
Web Sauger
WebEnhancer
WebImageCollector
Zauba
adscanner
arquivo-web-crawler
check1.exe
crawl.sogou.com
crawler.feedback
dataforseobot
facebookscraper
lwp-trivial
magpie-crawler
openai
probe-image-size
scan.lol
seobility
seostar
sp_auditbot
spyfu
zgrab