nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-03-18 10:13:01 +00:00

100 lines
1.1 KiB
Text

ADmantX
Acunetix
Ankit
Asterias
Attach
BDFetch
Barkrowler
Black Hole
BlowFish
Boardreader
BunnySlippers
Cloud mapping
Crawling at Home Project
Crescent
DataCha0s
DatabaseDriverMysqli
Demon
DomCopBot
Domains Project
EroCrawler
ExtLinksBot
Extractor
ExtractorPro
FacebookBot
Genieo
HEADMasterSEO
IDBTE4M
IDBot
IRLbot
Indy Library
Information Security Team InfraSec Scanner
JikeSpider
Kenjin Spider
Keyword Density
Leap
LinkScan
Lipperhey Spider
Lmspider
MSIECrawler
MTRobot
MauiBot
Mb2345Browser
Mediatoolkitbot
Mister PiX
Mozlila
Musobot
NPbot
Net Vampire
NetLyzer
Niki-bot
Openvas
Petalbot
ProPowerBot
Pu_iN
PxBroker
QueryN Metasearch
RankActiveLinkBot
RealDownload
SEOkicks
SemrushBot-OCOB
SemrushBot-SWA
SiteSucker
Snoopy
Sosospider
Sottopop
Spanner
Spider_Bot
Spinn3r
Sqlmap
Sqlworm
Steeler
SuperHTTP
Telesphorep
The Intraformant
Turingos
TwengaBot
VidibleScraper
VoidEYE
Web Fetch
Web Pix
WebAuto
WebSauger
WebStripper
WebZIP
Webshag
Webster
Wotbox
adscanner
anthropic-ai
check1.exe
crawler.feedback
dataforseobot
facebookscraper
imagesift.com
ips-agent
netEstate NE Crawler
omgili
pcBrowser
seostar
tAkeOut