nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-07 10:09:21 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
Aboundex
AiHitBot
Alexibot
Anarchy
Anarchy99
Anthill
Atomseobot
Attach
AwarioRssBot
BDCbot
BDFetch
BacklinkCrawler
Badass
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
Bullseye
BuzzSumo
CODE87
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Citoid
Collector
Copier
CrunchBot
Custo
DIIbot
DTS Agent
Deusu
Devil
Dirbuster
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
Dotbot
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
FHscan
Fimap
Flunky
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
GoZilla
Gotit
HTMLparser
HTTrack
Haansoft
Harvest
Humanlinks
HybridBot
IDBot
Iblog
IlseBot
Indy Library
InfoNaviRobot
InterGET
Iria
JetCar
Joomla
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
Lipperhey
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Musobot
NPbot
NearSite
Nessus
Net Vampire
NetMechanic
NetZIP
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Not
Nuclei
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Pandalytics
Pi-Monster
Picscout
Picsearch
Probethenet
Pump
PyCurl
QueryN Metasearch
RankingBot
Rankivabot
ReGet
RepoMonkey
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
Seekport
SemanticJuice
SeobilityBot
Seomoz
SiteSucker
Sitevigil
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Sqworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
Teleport
Telesoft
Telesphoreo
Thumbor
Toweyabot
Tracemyfile
Trendiction
Turingos
Turnitin
Twice
Typhoeus
Vagabondo
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Sucker
WebAuto
WebBandit
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebSauger
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Who.is Bot
Widow
WinHTTrack
Wprecon
Xaldon WebSpider
ZmEu
arquivo.pt
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
evc-batch
ips-agent
iubenda-radar
lwp-trivial
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
page scorer
plumanalytics
polaris version
s1z.ru
scan.lol
seobility
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
xpymep1.exe