nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-06-22 10:07:28 +00:00

100 lines
1.1 KiB
Text

360Spider
80legs
AIBOT
ALittle Client
BackStreet
Bitacle
BlackWidow
BlowFish
Bolt
Brandprotect
Bullseye
Calculon
CazoodleBot
CensysInspect
Cloud mapping
Crawling at Home Project
CrunchBot
Custo
DSearch
EMail Wolf
Extreme Picture Finder
FHscan
Fimap
FlashGet
Fuzz
FyberSpider
Gigabot
Grabber
HTTP::Lite
HybridBot
IRLbot
JamesBOT
JikeSpider
LNSpiderguy
LieBaoFast
LinqiaScrapeBot
Majestic SEO
Majestic12
Nameprotect
Navroad
NetLyzer
Netvibes
Nimbostratus
Nmap
Offline Explorer
OnCrawl
OrangeSpider
OutfoxBot
PHPCrawl
Piepmatz
ProWebWalker
PyCurl
RankFlex
ReGet
RealDownload
RepoMonkey
RocketCrawler
SISTRIX
Scrapy
ScreenerBot
SentiBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
Siteimprove
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
Telesphoreo
The Intraformant
Turnitin
URLy.Warning
Voil
Voltron
WWW-Mechanize
WWWOFFLE
Web Sauger
WebAuto
WebWhacker
Webshag
Website Quester
Whatweb
Who.is Bot
arquivo-web-crawler
cah.io.community
dataforseobot
facebookscraper
magpie-crawler
netEstate NE Crawler
s1z.ru
satoristudio.net
scan.lol
seobility
spyfu
xpymep1.exe
zgrab