nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-23 10:09:27 +00:00

250 lines
2.6 KiB
Text

AIBOT
ALittle Client
Abonti
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Anarchy99
Anthill
Aspiegel
BDCbot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
BlackWidow
Blackboard
Blow
Buck
CATExplorador
CCBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Citoid
Claritybot
Cosmos
Craftbot
Crescent
Custo
DataCha0s
Demon
Discobot
DomainCrawler
DomainStatsBot
Download Wonder
Dragonfly
EMail Wolf
Evil
Extractor
Firefox/7.0
Flunky
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
Getintent
GoZilla
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Havij
Hloader
Humanlinks
HybridBot
IDBot
IRLbot
Id-search
Image Sucker
IndeedBot
Indy Library
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JamesBOT
JennyBot
Jetty
Joomla
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
LeechFTP
LexiBot
Libwhisker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Majestic SEO
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Mister PiX
Mojeek
Mr.4x3
Msrabot
Musobot
Name Intelligence
Needle
Net Vampire
NetAnts
NetZIP
Nettrack
NextGenSearchBot
NimbleCrawler
Nimbostratus
Not
Nuclei
Octopus
Offline Navigator
Openfind
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
Papa Foto
Petalbot
Pi-Monster
Piepmatz
Pockey
ProWebWalker
Probethenet
Pump
PxBroker
RankActive
RankurBot
RealDownload
RebelMouse
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScrepyBot
SearchmetricsBot
Seekport
SentiBot
Siphon
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
Spbot
SputnikBot
Sqlworm
Sqworm
Sucker
Szukacz
Telesoft
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TurnitinBot
Twice
Typhoeus
Vagabondo
VeriCiteCrawler
Virusdie
Voil
WEBDAV
WWW-Collector-E
Wallpapers
Wallpapers/3.0
Web Auto
Web Fuck
Web Pix
Web Sucker
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
Whack
Whacker
Widow
WinHTTrack
Wonderbot
Wprecon
YoudaoBot
Zeus
ZoominfoBot
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
cognitiveseo
eCatch
facebookscraper
heritrix
internetVista monitor
iubenda-radar
lwp-trivial
meanpathbot
page scorer
seobility
seostar
sexsearcher
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab