nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-05 10:07:25 +00:00

100 lines
1.1 KiB
Text

360Spider
ADmantX
ASPSeek
Aboundex
Alexibot
Anthill
BDCbot
BDFetch
BackStreet
Bandit
BlowFish
BunnySlippers
Calculon
Claritybot
Collector
Copier
Digincore
DnBCrawler-Analytics
DnyzBot
Dotbot
Ebingbong
Firefox/7.0
GoZilla
Gotit
HEADMasterSEO
HTTP::Lite
Haansoft
Havij
JamesBOT
JennyBot
Jyxobot
Lanshanbot
Lftp
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkWatch
Masscan
MeanPath Bot
Meanpathbot
Moblie Safari
Name Intelligence
Nameprotect
Navroad
Nessus
NextGenSearchBot
Nutch
Openfind
POE-Component-Client-HTTP
PageScorer
PageThing.com
Panscient
ProPowerBot
RSSingBot
RocketCrawler
SEOkicks-Robot
SISTRIX
Screaming
SearchmetricsBot
Sitevigil
Snapbot
Sociscraper
Sogou web spider
Sqworm
TeleportPro
The Intraformant
TheNomad
Trendiction
URLy Warning
VelenPublicWebCrawler
WASALive-Bot
WBSearchBot
WISENutbot
Web Collage
Web Fetch
Web Fuck
WebCollage
WebReaper
Website Quester
WebsiteExtractor
Webster
Who.is Bot
Wonderbot
Woobot
ZoominfoBot
arquivo.pt
crawler4j
domainsproject.org
facebookscraper
lwp-trivial
meanpathbot
probe-image-size
scalaj-http
seocompany.store
sysscan
xpymep1.exe