nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-11 10:07:07 +00:00

100 lines
1 KiB
Text

ADmantX
Alexibot
BackWeb
Badass
Bandit
Black Hole
Blow
CherryPicker
Chlooe
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
Curious
Custo
DTS Agent
Deusu
DigitalPebble
DomCopBot
Evil
FlashGet
FrontPage
GrabNet
Grafula
Heritrix
HonoluluBot
HybridBot
Indy Library
InfoNaviRobot
JOC Web Spider
JennyBot
Jorgee
Keyword Density
Kinza
Kozmosbot
Lftp
LieBaoFast
Likse
Litemage_walker
MSFrontPage
Majestic-SEO
Mass Downloader
MicroMessenger
Minefield
MolokaiBot
Mr.4x3
Navroad
Netvibes
NextGenSearchBot
Nibbler
Openvas
OutfoxBot
PHPCrawl
Page Analyzer
Pandalytics
Pavuk
PictureFinder
QueryN Metasearch
Reaper
Recorder
SBIder
SEOkicks
SEOstats
Screaming
Snake
Sogou web spider
Sosospider
Spammen
Sqlmap
Surfbot
Teleport
Titan
Trendictionbot
True_Robot
TurnitinBot
WEBDAV
WWW-Mechanize
WebFetch
WebLeacher
Website Quester
WebsiteQuester
Widow
WiseGuys Robot
Xaldon WebSpider
YoudaoBot
ZumBot
ZyBorg
adscanner
archive.org_bot
backlink-check
dataforseo.com
internetVista monitor
lwp-request
meanpathbot
oBot
page scorer
pcBrowser
x22Mozilla