nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-05 22:07:40 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
ADmantX
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy99
Anthill
Asterias
Attach
AwarioSmartBot
BDFetch
BackDoorBot
Backlink-Ceck
Barkrowler
Black Hole
Bolt
Brandwatch
Bullseye
BuzzSumo
CATExplorador
Chlooe
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
Curious
CyotekWebCopy
DTS Agent
Demon
Deusu
Disco
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Domains Project
EasyDL
EirGrabber
Evil
Exabot
Express WebPictures
Extractor
ExtractorPro
Ezooms
FDM
FlashGet
Flunky
Freeuploader
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetRight
Go!Zilla
GrabNet
Grafula
GrapeFX
HMView
HTTP::Lite
Harvest
HybridBot
IDBTE4M
IRLbot
Iblog
InfoNaviRobot
Internet Ninja
InternetSeer
JOC Web Spider
Jbrofuzz
JetCar
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LWP::Simple
Leap
LeechGet
LexiBot
LibWeb
Lightspeedsystems
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Metauri
Microsoft Data Access
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
Name Intelligence
Nameprotect
NearSite
Needle
NetAnts
NetZIP
Nettrack
NextGenSearchBot
NimbleCrawler
Nimbostratus
Not
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Pavuk
Pi-Monster
Picscout
Pockey
Probethenet
Psbot
PxBroker
Quick-Crawler
RankurBot
ReGet
Reaper
RedesScrapy
RepoMonkey
Ripper
SISTRIX
SalesIntelligent
Screaming
ScreenerBot
Searchestate
SeoSiteCheckup
Seomoz
SiteLockSpider
SiteSnagger
Sitebeam
Snake
Sociscraper
Sogou web spider
Sosospider
Spinn3r
Steeler
SuperHTTP
Surfbot
SurveyBot
T8Abot
Teleport
TeleportPro
The Intraformant
Thumbor
TightTwatBot
Titan
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
Typhoeus
URLy Warning
UnisterBot
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voil
Voltron
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Sauger
WebBandit
WebCollage
WebCopier
WebFuck
WebSauger
WebSucker
Webalta
WebmasterWorldForumBot
Website Quester
Whack
Whacker
Widow
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
ZoomBot
ZoominfoBot
adscanner
backlink-check
cah.io.community
clark-crawler
crawl.sogou.com
demandbase-bot
domainsproject.org
gopher
ips-agent
lwp-trivial
meanpathbot
muhstik-scan
oBot
page scorer
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seobility
seoscanners
serpstatbot
sitechecker.pro
sogouspider
spyfu
trendiction.com
trendiction.de
webprosbot
zgrab