nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-15 10:07:00 +00:00

100 lines
1.1 KiB
Text

404checker
80legs
Aboundex
AdsTxtCrawlerTP
Anarchie
Asterias
AwarioRssBot
AwarioSmartBot
BackStreet
BatchFTP
Blackboard
Bolt
BuiltBotTough
BunnySlippers
BuzzSumo
Bytespider
ChinaClaw
Craftbot
CrunchBot
Curious
Digincore
DigitalPebble
Disco
Discoverybot
Domains Project
Drip
EMail Wolf
EasyDL
Ebingbong
Exabot
Foobot
Freeuploader
GetRight
Gigabot
GrabNet
HTTP::Lite
Harvest
IRLbot
Joomla
Jorgee
Jyxobot
Lanshanbot
LeechGet
Lightspeedsystems
LinkWalker
Litemage_walker
Mass Downloader
Masscan
Mojolicious
NPbot
NimbleCrawler
Nimbostratus
Offline Explorer
OnCrawl
OutfoxBot
PECL::HTTP
PageGrabber
Pixray
Proximic
Pu_iN
PxBroker
Reaper
SEOkicks-Robot
SalesIntelligent
SearchmetricsBot
Seekport
SeoSiteCheckup
SiteLockSpider
SlySearch
SuperBot
Swiftbot
Telesphoreo
The Intraformant
Tracemyfile
Trendiction
Turingos
Turnitin
Upflow
VoidEYE
WASALive-Bot
WPScan
Wallpapers
WeSEE
Web Sucker
WebCollage
WebImageCollector
WebLeacher
WebSucker
WebmasterWorldForumBot
Xaldon_WebSpider
YoudaoBot
Zitebot
archive.org_bot
autoemailspider
com.plumanalytics
eCatch
internetVista monitor
seobility
ubermetrics-technologies.com
zgrab