nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-16 22:07:06 +00:00

250 lines
2.6 KiB
Text

ADmantX
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy
Anthill
Attach
BBBike
BLEXBot
BackDoorBot
Bandit
BatchFTP
BetaBot
Bigfoot
Black Hole
BlackWidow
Blackboard
Blow
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
CCBot
Cegbfeieh
CherryPicker
Citoid
Claritybot
Cloud mapping
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
CyotekWebCopy
DTS Agent
Digincore
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DomCopBot
DomainAppender
DomainSigmaCrawler
Download Wonder
Drip
EMail Siphon
Ebingbong
Exabot
EyeNetIE
FrontPage
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Gigabot
Go-Ahead-Got-It
Gotit
Grabber
GrapeFX
GridBot
HMView
HTMLparser
Haansoft
HonoluluBot
HybridBot
IRLbot
Iblog
IlseBot
IndeedBot
Indy Library
Intelliseek
Internet Ninja
InternetSeer
Iria
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
Joomla
Jorgee
Kenjin Spider
LWP::Simple
Lanshanbot
Larbin
Leap
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
LinqiaRSSBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
Magnet
Majestic SEO
Majestic12
MarkMonitor
MeanPath Bot
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Musobot
Navroad
NearSite
Nessus
NetLyzer
NetSpider
Nettrack
Netvibes
Nibbler
Offline Explorer
OnCrawl
OpenVAS
Openfind
Openvas
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Pavuk
PeoplePal
Pi-Monster
Piepmatz
Pixray
PleaseCrawl
Quick-Crawler
RankActive
RankurBot
Re-re
ReGet
Reaper
RebelMouse
RedesScrapy
RepoMonkey
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemrushBot
SentiBot
SeobilityBot
SiteLockSpider
SiteSucker
Siteimprove
SlySearch
Snake
Snapbot
Spinn3r
Sqworm
Stripper
Sucuri
SurveyBot
Swiftbot
T0PHackTeam
Teleport
Telesphoreo
The Intraformant
TightTwatBot
Titan
Toata
Toweyabot
Trendiction
True_Robot
Turingos
TwengaBot
Typhoeus
URLy Warning
VB Project
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Fuck
Web Pix
Web Sauger
WebFetch
WebImageCollector
WebStripper
Website Quester
WebsiteQuester
Who.is Bot
WinHTTrack
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zeus
Zitebot
ZmEu
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo.pt
check1.exe
clark-crawler
dataforseo.com
eCatch
heritrix
lwp-trivial
meanpathbot
ripz
satoristudio.net
seobility
seoscanners
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
spyfu
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x22Mozilla
zgrab