nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-24 10:07:12 +00:00

100 lines
1.1 KiB
Text

80legs
ALittle Client
Abonti
Alexibot
Alligator
Apexoo
BackWeb
BacklinkCrawler
Barkrowler
Bitacle
Black Hole
Blackboard
Cegbfeieh
CopyRightCheck
Curious
Demon
DittoSpyder
DnBCrawler-Analytics
Drip
Ezooms
Foobot
GalaxyBot
Genieo
Go!Zilla
GrabNet
Id-search
Iskanie
JamesBOT
Jetty
Jyxobot
Keybot Translation-Search-Machine
LNSpiderguy
LinqiaMetadataDownloaderBot
MFC_Tear_Sample
MJ12bot
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Mozlila
Musobot
NICErsPRO
Netcraft
Nibbler
Nimbostratus
Nmap
OnCrawl
OpenVAS
OrangeBot
Page Analyzer
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Pump
QueryN Metasearch
RocketCrawler
SEOlyticsCrawler
ScanAlert
ScoutJet
Scrapy
SemrushBot
SiteSucker
Siteimprove
Sogou web spider
Sottopop
SpankBot
Surfbot
T0PHackTeam
TightTwatBot
Toata
TurnitinBot
URLy.Warning
VCI
Virusdie
WASALive-Bot
WWW-Collector-E
WWW::Mechanize
Web Collage
WebFuck
WebImageCollector
WebReaper
WebsiteQuester
Woobot
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
heritrix
isitwp.com
linkdexbot
lwp-trivial
ripz
satoristudio.net
scalaj-http
seostar
trendiction.de
x09Mozilla
zgrab