nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-31 22:07:30 +00:00

250 lines
2.7 KiB
Text

404checker
404enemy
ALittle Client
ASPSeek
AiHitBot
Aipbot
Alexibot
AlphaBot
Aspiegel
AwarioRssBot
AwarioSmartBot
BackWeb
Backlink-Ceck
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
Blackboard
BlowFish
Boardreader
BotALot
Brandwatch
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CCBot
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Cocolyzebot
Collector
Copyscape
Crawling at Home Project
CrunchBot
CyotekWebCopy
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Discobot
Dispatch
DnBCrawler-Analytics
DomainAppender
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EirGrabber
Exabot
ExtractorPro
EyeNetIE
FDM
FemtosearchBot
Foobot
Fyrebot
GT::WWW
Genieo
GetWeb
Go!Zilla
GoZilla
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
HaosouSpider
Harvest
Heritrix
Hloader
IDBot
Iblog
Image Fetch
Image Sucker
IndeedBot
Indy Library
Iria
IstellaBot
JamesBOT
JetCar
Jetty
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
Leap
LexiBot
Libwhisker
LieBaoFast
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MIIxpc
MSIECrawler
Mag-Net
MarkMonitor
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO
Name Intelligence
Navroad
NearSite
Nessus
NetSpider
Netcraft
Not
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PeoplePal
Pi-Monster
Picscout
Pimonster
Pixray
Pockey
Probethenet
PxBroker
Quick-Crawler
RankActive
RankingBot
RankingBot2
RebelMouse
RepoMonkey
SEOlyticsCrawler
SEOprofiler
SEOstats
Scrapy
ScrepyBot
SearchmetricsBot
SemanticJuice
SeoSiteCheckup
SeobilityBot
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
Sottopop
Spanner
Sqworm
Sucker
Swiftbot
T0PHackTeam
Telesoft
Telesphorep
Thumbor
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
TurnitinBot
Typhoeus
URLy.Warning
V-BOT
VCI
Vagabondo
Virusdie
Voil
WBSearchBot
WWW::Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Sucker
WebAuto
WebBandit
WebEnhancer
WebFetch
WebImageCollector
WebSauger
WebStripper
WebWhacker
WebZIP
Webalta
WebsiteExtractor
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wprecon
Zade
Zeus
ZmEu
ZyBorg
arquivo-web-crawler
autoemailspider
check1.exe
clark-crawler
domainsproject.org
evc-batch
instabid
internetVista monitor
iubenda-radar
linkdexbot
magpie-crawler
oBot
page scorer
scan.lol
seoscanners
seostar
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab