nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-07 10:10:35 +00:00

250 lines
2.7 KiB
Text

ALittle Client
Aboundex
AfD-Verbotsverfahren
Aipbot
Alligator
AlphaBot
Anarchy
Anarchy99
Apexoo
Asterias
Atomseobot
Attach
AwarioSmartBot
BacklinkCrawler
Bandit
BatchFTP
BetaBot
Bigfoot
Black Hole
Boardreader
Buck
BuiltBotTough
Bullseye
BunnySlippers
Calculon
Cegbfeieh
CensysInspect
CherryPicker
Chlooe
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Copier
Craftbot
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Demon
Digincore
Discobot
Discoverybot
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
EMail Siphon
ExtLinksBot
ExtractorPro
FHscan
Fimap
Firefox/7.0
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
Getintent
Go!Zilla
Gotit
GrabNet
GrapeshotCrawler
HaosouSpider
Harvest
Heritrix
HonoluluBot
Image Sucker
Indy Library
InterGET
Internet Ninja
Iria
Iskanie
IstellaBot
JOC Web Spider
JetCar
Jetty
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
Leap
LexiBot
Lftp
LibWeb
Libwhisker
Likse
LinkWalker
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MFC_Tear_Sample
Majestic SEO
Mata Hari
Mediatoolkitbot
Metauri
MicroMessenger
Mister PiX
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
NetLyzer
NetMechanic
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nikto
Nutch
Offline Explorer
PECL::HTTP
PHPCrawl
Page Analyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Petalbot
Picscout
Picsearch
Piepmatz
PleaseCrawl
Pockey
ProWebWalker
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RealDownload
RebelMouse
RedesScrapy
Rogerbot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
SemanticJuice
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
SiteSucker
Sitebeam
Snake
Sociscraper
SpaceBison
Sqlmap
Sqlworm
Stripper
Sucuri
SuperBot
SurveyBot
Szukacz
Teleport
Telesoft
Thumbor
Titan
Trendictionbot
Turnitin
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WallpapersHD
Web Enhancer
Web Pix
Web Sauger
WebCopier
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebZIP
Webalta
WebsiteExtractor
WebsiteQuester
Who.is Bot
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Zade
Zermelo
ZoomBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
clark-crawler
com.plumanalytics
crawler.feedback
demandbase-bot
evc-batch
isitwp.com
iubenda-radar
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
s1z.ru
scalaj-http
scan.lol
seocompany.store
seoscanners
seostar
sitechecker.pro
sp_auditbot
trendiction.de
voyagerx.com
webpros.com
zgrab