nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-27 22:04:57 +00:00

100 lines
1 KiB
Text

Anarchy
Aspiegel
Asterias
BLEXBot
Citoid
Cliqzbot
Collector
Copyscape
DTS Agent
Devil
Exabot
Extractor
FDM
G-i-g-a-b-o-t
Genieo
Gigabot
Go-Ahead-Got-It
HEADMasterSEO
HMView
HTTrack
JamesBOT
JennyBot
JetCar
Jetty
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Lanshanbot
Leap
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MarkWatch
Masscan
MeanPath Bot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Mojolicious
NPbot
Nameprotect
NearSite
Needle
NetLyzer
NetZIP
Netcraft
NextGenSearchBot
Nuclei
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeSpider
PECL::HTTP
PageGrabber
Papa Foto
PeoplePal
Pi-Monster
PictureFinder
Pixray
Pockey
Pu_iN
RSSingBot
Scrapy
SemrushBot
SentiBot
SeobilityBot
Sitevigil
SmartDownload
Snake
SpankBot
Spbot
SurveyBot
Teleport
TeleportPro
Thumbor
Tracemyfile
Upflow
WWWOFFLE
Wallpapers
Web Auto
Web Fetch
WebBandit
WebFetch
WebsiteQuester
Who.is Bot
Wprecon
ZumBot
archive.org_bot
backlink-check
crawler.feedback
eCatch
gopher
ips-agent
muhstik-scan
page scorer
plumanalytics
seoscanners
webmeup-crawler
xpymep1.exe
zauba.io