nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-06 22:04:51 +00:00

100 lines
1.1 KiB
Text

360Spider
404checker
404enemy
AdsTxtCrawlerTP
BDCbot
BackStreet
Battleztar Bazinga
Black Hole
Boardreader
BuiltBotTough
BunnySlippers
Copyscape
CrunchBot
DBLBot
Demon
Digincore
DomainAppender
DomainCrawler
EMail Siphon
EirGrabber
Fimap
Foobot
Freeuploader
G-i-g-a-b-o-t
GermCrawler
Go!Zilla
GrapeFX
GrapeshotCrawler
HTTrack
HonoluluBot
IDBot
IlseBot
JamesBOT
JikeSpider
JustView
Jyxobot
Kenjin Spider
LWP::Simple
Lanshanbot
Leap
Lmspider
MJ12bot
MarkMonitor
NICErsPRO
NetMechanic
Netcraft
NextGenSearchBot
Nutch
OpenLinkProfiler
OutfoxBot
PHPCrawl
RankingBot2
Re-re
RealDownload
RepoMonkey
SISTRIX
SalesIntelligent
Screaming
Site Sucker
Snake
SocialRankIOBot
Sogou web spider
SputnikBot
Suzuran
T0PHackTeam
Telesphorep
Thumbor
Tracemyfile
URLy.Warning
Virusdie
Voil
WPScan
WWW-Mechanize
Web Auto
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebEnhancer
WebImageCollector
WebStripper
Whatweb
Widow
Zade
Zauba
Zeus
ZumBot
backlink-check
clark-crawler
cognitiveseo
crawl.sogou.com
crawler.feedback
domainsproject.org
instabid
internetVista monitor
muhstik-scan
netEstate NE Crawler
ripz
seostar
xpymep1.exe