nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-22 10:09:27 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
AIBOT
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alligator
Anarchy99
Ankit
Anthill
Atomseobot
Attach
AwarioSmartBot
BBBike
BLEXBot
BackStreet
BackWeb
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Black Hole
Blackboard
Blow
Boardreader
Bolt
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
CCBot
Cegbfeieh
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Copier
CrunchBot
Custo
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
Domains Project
Drip
EMail Siphon
EasyDL
Ebingbong
Ecxi
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
FDM
FlashGet
Flunky
FrontPage
FyberSpider
GT::WWW
Genieo
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grafula
GridBot
HEADMasterSEO
Humanlinks
IDBTE4M
Iblog
Id-search
IlseBot
Indy Library
InfoTekies
InterGET
Internet Ninja
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
Jorgee
Kenjin Spider
Keyword Density
LWP::Simple
LeechFTP
Lftp
Libwhisker
LieBaoFast
Likse
LinkScan
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Majestic SEO
MarkWatch
Mass Downloader
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Musobot
Navroad
NearSite
Needle
Net Vampire
NetLyzer
NetMechanic
NetZIP
Netcraft
Niki-bot
Nuclei
Nutch
OpenLinkProfiler
OpenVAS
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
Piepmatz
Pimonster
Pockey
ProPowerBot
Pu_iN
PxBroker
PyCurl
RSSingBot
RankActive
RankFlex
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemrushBot
Seomoz
Siphon
SiteExplorer
SiteSucker
Sitevigil
SlySearch
Sosospider
Spammen
Spanner
SputnikBot
Steeler
Stripper
Sucuri
Surfbot
SurveyBot
Szukacz
Telesoft
The Intraformant
Thumbor
URLy Warning
VCI
Vacuum
Voltron
WEBDAV
WeSEE
Web Auto
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebEnhancer
WebGo IS
WebLeacher
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Webster
Whatweb
Wonderbot
Wotbox
Xaldon WebSpider
Xenu
Zauba
ZoominfoBot
ZumBot
adscanner
arquivo.pt
clark-crawler
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
gopher
heritrix
internetVista monitor
magpie-crawler
netEstate NE Crawler
oBot
pcBrowser
probe-image-size
ripz
s1z.ru
serpstatbot
sitechecker.pro
sp_auditbot
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io