nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-17 22:08:01 +00:00

100 lines
1 KiB
Text

80legs
Abonti
Acunetix
Attach
AwarioSmartBot
BBBike
Badass
Blackboard
Buddy
Copier
Cosmos
CrunchBot
Discoverybot
DnBCrawler-Analytics
DnyzBot
Domains Project
Dragonfly
EasyDL
Extractor
Fimap
FlashGet
Foobot
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeFX
GridBot
HaosouSpider
IDBot
IRLbot
IndeedBot
InfraSec Scanner
JamesBOT
Jetty
Joomla
Jorgee
Jyxobot
Larbin
Leap
LibWeb
Linkbot
LinqiaRSSBot
Litemage_walker
MFC_Tear_Sample
MQQBrowser
Majestic-SEO
MicroMessenger
Mojolicious
Mr.4x3
NICErsPRO
Nameprotect
NextGenSearchBot
Nibbler
Offline Explorer
Offline Navigator
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Pixray
Pump
SMTBot
Scrapy
SemrushBot-FT
SiteSnagger
SocialRankIOBot
Spinn3r
Sucker
Sucuri
Swiftbot
T0PHackTeam
T8Abot
True_Robot
TurnitinBot
Upflow
V-BOT
VB Project
VeriCiteCrawler
Voil
WASALive-Bot
WEBDAV
WWW-Mechanize
WWWOFFLE
WebImageCollector
WebWhacker
Wonderbot
Wotbox
YoudaoBot
Zitebot
check1.exe
clark-crawler
crawler.feedback
instabid
iubenda-radar
mediawords
plumanalytics
probe-image-size
webmeup-crawler
webpros.com