nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-27 22:07:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Ankit
Anthill
Apexoo
Atomseobot
Attach
AwarioSmartBot
BBBike
BDCbot
Backlink-Ceck
BacklinkCrawler
BetaBot
Bigfoot
Blackboard
Blow
Boardreader
BuiltBotTough
Bullseye
CATExplorador
CSHttp
Cegbfeieh
CheeseBot
ChinaClaw
Claritybot
Copier
Copyscape
Cosmos
Crawling at Home Project
DIIbot
DTS Agent
DataCha0s
Digincore
Dirbuster
DnyzBot
DomainSigmaCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
ExtLinksBot
ExtractorPro
Fimap
Firefox/7.0
Flunky
Foobot
GalaxyBot
Genieo
GetRight
Gigabot
Gotit
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Hloader
IDBTE4M
Iblog
Id-search
Image Sucker
Internet Ninja
Iria
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Keyword Density
Leap
LeechGet
Lftp
Libwhisker
Likse
LinkScan
LinkWalker
Linkbot
LinksManager
LinqiaRSSBot
Lmspider
Ltx71
MIIxpc
MSFrontPage
MSIECrawler
Magnet
Majestic-SEO
Majestic12
MarkMonitor
Masscan
Mata Hari
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Mojeek
Msrabot
Name Intelligence
NearSite
Net Vampire
NetSpider
NetZIP
Netcraft
Nettrack
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Not
Nutch
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeBot
OutfoxBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Pi-Monster
Pimonster
Pump
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SEOprofiler
SISTRIX
SMTBot
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot
SentiBot
Seomoz
Siphon
SiteSnagger
SiteSucker
SmartDownload
Snoopy
Sosospider
SpaceBison
Spinn3r
SputnikBot
Sqlmap
Sucker
Sucuri
SuperHTTP
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
Telesphorep
Thumbor
TightTwatBot
Titan
Trendiction
True_Robot
Twice
Upflow
V-BOT
VeriCiteCrawler
VidibleScraper
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sauger
WebAuto
WebCollage
WebFuck
WebLeacher
WebReaper
WebWhacker
Webalta
WebsiteQuester
Who.is Bot
WinHTTrack
WiseGuys Robot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZyBorg
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
domainsproject.org
gopher
heritrix
iubenda-radar
lwp-request
lwp-trivial
mediawords
probe-image-size
ripz
seobility
seocompany.store
seoscanners
sogouspider
sp_auditbot
spyfu
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
zauba.io