nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-15 22:07:23 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
ADmantX
AIBOT
Aipbot
Alexibot
Anarchy99
Apexoo
BBBike
BDCbot
BLEXBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
Battleztar Bazinga
Bitacle
Blackboard
BotALot
Brandwatch
BuzzSumo
CSHttp
CherryPicker
Chlooe
Citoid
Cocolyzebot
CopyRightCheck
Cosmos
CrunchBot
Curious
Custo
CyotekWebCopy
DBLBot
Deusu
Disco
Discobot
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
EMail Wolf
Evil
Exabot
FemtosearchBot
Fimap
Freeuploader
Fuzz
FyberSpider
GalaxyBot
Gigabot
Go-Ahead-Got-It
Grabber
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
Haansoft
Havij
Hloader
Humanlinks
IDBot
Id-search
IndeedBot
InfoTekies
InterGET
InternetSeer
Iria
Iskanie
JOC Web Spider
JetCar
Jorgee
Keyword Density
Kozmosbot
LWP::Simple
LeechFTP
LeechGet
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkpadBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Mb2345Browser
MegaIndex.ru
Mister PiX
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NPbot
NearSite
Nessus
Net Vampire
NetMechanic
Netcraft
Netvibes
Nikto
NimbleCrawler
Nimbostratus
Not
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Pavuk
Petalbot
Picscout
Piepmatz
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Psbot
QueryN Metasearch
Re-re
ReGet
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SISTRIX
SalesIntelligent
ScoutJet
ScreenerBot
Searchestate
Seekport
SemanticJuice
SentiBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteSnagger
SocialRankIOBot
Sociscraper
Spbot
Sqworm
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
T8Abot
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Turingos
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Sauger
WebCopier
WebEnhancer
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whack
Whacker
Whatweb
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
Xenu
Zeus
ZumBot
arquivo.pt
cah.io.community
coccocbot
com.plumanalytics
domainsproject.org
internetVista monitor
ips-agent
linkdexbot
lwp-trivial
muhstik-scan
pcBrowser
polaris version
probe-image-size
satoristudio.net
seobility
seocompany.store
seostar
serpstatbot
sexsearcher
sogouspider
sp_auditbot
spyfu
sysscan
trendiction.com
ubermetrics-technologies.com
webgains-bot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io