nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-09 22:05:13 +00:00

100 lines
1,006 B
Text

360Spider
404checker
AIBOT
AiHitBot
AlphaBot
AwarioSmartBot
BDFetch
BLEXBot
Badass
Bigfoot
Blackboard
BlowFish
Bolt
Bullseye
CSHttp
Craftbot
CyotekWebCopy
DSearch
Deusu
Digincore
Dragonfly
ECCP/1.0
Extractor
Ezooms
FDM
Flunky
Fuzz
FyberSpider
Gotit
HMView
Humanlinks
Intelliseek
Jorgee
Kozmosbot
Lftp
LibWeb
MSIECrawler
Magnet
MarkMonitor
MarkWatch
Moblie Safari
NPbot
Net Vampire
NetAnts
NetLyzer
NetSpider
Ninja
OnCrawl
OpenLinkProfiler
OpenVAS
Piepmatz
ProPowerBot
Proximic
RSSingBot
RankActiveLinkBot
Re-re
Reaper
SenutoBot
Siphon
Sitebeam
Snoopy
Sosospider
Spbot
Steeler
Sucuri
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
TeleportPro
The Intraformant
Tracemyfile
Vacuum
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Enhancer
WebFuck
WebImageCollector
WebLeacher
Xaldon WebSpider
YoudaoBot
clark-crawler
cognitiveseo
eCatch
gopher
internetVista monitor
magpie-crawler
mediawords
ripz
seocompany.store
sogouspider
sp_auditbot
tAkeOut
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla