nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-12 22:07:43 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Alexibot
Alligator
Anarchy
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
BacklinkCrawler
Badass
Bitacle
Black Hole
Blackboard
Blow
Brandprotect
Brandwatch
Buddy
Bullseye
BunnySlippers
CATExplorador
CODE87
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
Cliqzbot
Collector
Copier
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Custo
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Digincore
DigitalPebble
Discoverybot
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Drip
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
FHscan
Freeuploader
FrontPage
GalaxyBot
Getintent
GoZilla
Gotit
Grafula
GrapeshotCrawler
HMView
HTMLparser
Humanlinks
IRLbot
Iblog
IndeedBot
Intelliseek
Internet Ninja
InternetSeer
Iria
Iskanie
JamesBOT
JetCar
Jetty
Jyxobot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LNSpiderguy
Larbin
Leap
LexiBot
Lftp
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
Mag-Net
Magnet
Mail.RU_Bot
MarkMonitor
Masscan
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
MolokaiBot
Mozlila
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
Net Vampire
NetSpider
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Not
Nutch
Offline Explorer
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
PageAnalyzer
PageScorer
Pandalytics
Panscient
Petalbot
Picscout
Pimonster
PleaseCrawl
PyCurl
RankingBot2
Rankivabot
ReGet
RealDownload
Reaper
RocketCrawler
SEOlyticsCrawler
SEOstats
Scanbot
ScoutJet
Searchestate
Seekport
SemanticJuice
Semrush
SentiBot
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
SiteSucker
Siteimprove
SlySearch
Sociscraper
Sosospider
SpaceBison
Spammen
SpankBot
Spbot
Spinn3r
Sqlworm
Steeler
Sucker
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
TurnitinBot
Typhoeus
URLy Warning
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
Wallpapers
Web Fuck
Web Sucker
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebSucker
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
Who.is Bot
Wonderbot
Xaldon WebSpider
Zauba
Zeus
ZoomBot
adscanner
arquivo.pt
cah.io.community
coccocbot
cognitiveseo
crawler.feedback
demandbase-bot
domainsproject.org
evc-batch
isitwp.com
iubenda-radar
linkdexbot
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer
probe-image-size
s1z.ru
seocompany.store
seostar
sexsearcher
sp_auditbot
tAkeOut
trendiction.com
webpros.com
webprosbot
xpymep1.exe