nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-31 10:09:22 +00:00

250 lines
2.6 KiB
Text

01h4x.com
AIBOT
ALittle Client
Abonti
Alexibot
AllSubmitter
Anarchie
Anarchy99
Ankit
Aspiegel
Asterias
Atomseobot
AwarioRssBot
BLEXBot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
Brandprotect
Brandwatch
Buck
BuiltWith
Bullseye
BuzzSumo
CCBot
Cegbfeieh
Chlooe
Citoid
Claritybot
Copier
CopyRightCheck
CrazyWebCrawler
Custo
CyotekWebCopy
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
ECCP/1.0
EMail Siphon
EMail Wolf
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FHscan
FemtosearchBot
Flunky
Foobot
FrontPage
FyberSpider
GalaxyBot
Genieo
GetRight
GetWeb
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
Haansoft
HaosouSpider
Heritrix
HonoluluBot
Humanlinks
HybridBot
Iblog
IlseBot
IndeedBot
Iria
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
Leap
LeechGet
LieBaoFast
Linkbot
LinkextractorPro
LinkpadBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MJ12bot
MQQBrowser
Majestic SEO
Majestic12
Mass Downloader
Masscan
Mata Hari
MauiBot
MegaIndex.ru
Metauri
Minefield
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Nameprotect
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netcraft
Nikto
Nmap
Nuclei
Offline Explorer
OpenVAS
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Panscient
Papa Foto
PeoplePal
Petalbot
Picsearch
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot2
RebelMouse
Recorder
RepoMonkey
SEOprofiler
SEOstats
ScreenerBot
SemanticJuice
SeoSiteCheckup
SeobilityBot
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sosospider
Sottopop
SpaceBison
SpankBot
Sucker
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
TeleportPro
Telesoft
Telesphoreo
The Intraformant
Titan
Toweyabot
True_Robot
Turnitin
Twice
URLy Warning
UnisterBot
V-BOT
VB Project
Virusdie
VoidEYE
WEBDAV
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
Web Fetch
Web Sucker
WebBandit
WebPix
WebSauger
Webshag
Website Quester
WebsiteExtractor
Whatweb
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zitebot
ZoomBot
ZumBot
adscanner
arquivo.pt
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
gopher
instabid
ips-agent
isitwp.com
meanpathbot
oBot
plumanalytics
ripz
s1z.ru
scan.lol
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
tAkeOut
voyagerx.com
x09Mozilla
zgrab