nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-08 10:20:09 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
ALittle Client
Aboundex
Alexibot
AllSubmitter
Alligator
Anarchie
Aspiegel
BDFetch
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Blow
Brandprotect
Bullseye
BunnySlippers
BuzzSumo
CCBot
CODE87
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Citoid
Claritybot
Cogentbot
Copyscape
Craftbot
CrazyWebCrawler
Crescent
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
EyeNetIE
Ezooms
FDM
Firefox/7.0
FlashGet
Fyrebot
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
HTTP::Lite
Haansoft
HonoluluBot
IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
LNSpiderguy
LWP::Simple
LieBaoFast
Linkbot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MJ12bot
MSIECrawler
MTRobot
Majestic SEO
Majestic-SEO
Majestic12
Mata Hari
MauiBot
Meanpathbot
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
MolokaiBot
Mr.4x3
Musobot
NPbot
Nessus
Net Vampire
NetAnts
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Octopus
Offline Explorer
OnCrawl
OpenVAS
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Pavuk
Petalbot
Picscout
PleaseCrawl
ProPowerBot
ProWebWalker
Pump
PxBroker
QueryN Metasearch
RankingBot2
Reaper
RebelMouse
Recorder
Ripper
SBIder
SMTBot
ScanAlert
Scanbot
Scrapy
Screaming
ScrepyBot
Seekport
SemanticJuice
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
SiteExplorer
SiteSnagger
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sosospider
Spammen
SpankBot
Spanner
Sucuri
SuperBot
Surfbot
Swiftbot
T0PHackTeam
T8Abot
Telesoft
Telesphorep
TheNomad
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
Vacuum
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebCopier
WebImageCollector
WebLeacher
WebPix
WebSucker
WebZIP
Webalta
Whack
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
Zermelo
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
instabid
ips-agent
lwp-request
magpie-crawler
meanpathbot
mediawords
ripz
seobility
siteripz
sp_auditbot
trendiction.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe