nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-10 10:09:36 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Aipbot
AlphaBot
Anarchy
Anthill
Apexoo
Aspiegel
Asterias
Attach
BBBike
BDCbot
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Bitacle
BlackWidow
Blow
Boardreader
Bolt
Brandprotect
Buddy
BuzzSumo
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
Chlooe
Citoid
Cocolyzebot
Collector
CopyRightCheck
Craftbot
Crescent
CrunchBot
Curious
Custo
DSearch
Devil
Dirbuster
Discobot
DittoSpyder
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
EMail Siphon
EMail Wolf
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
FemtosearchBot
Firefox/7.0
Flunky
Freeuploader
FyberSpider
GetRight
GoZilla
Gotit
GrabNet
Grafula
GrapeFX
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Haansoft
Havij
HonoluluBot
HybridBot
IDBot
IRLbot
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
Leap
Libwhisker
LieBaoFast
LinqiaScrapeBot
Lmspider
MJ12bot
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
Mister PiX
Mojeek
Mojolicious
Musobot
NPbot
Name Intelligence
Navroad
NearSite
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Not
Nuclei
Offline Explorer
OpenVAS
Openvas
OrangeSpider
OutfoxBot
Panscient
Papa Foto
Petalbot
Picscout
Piepmatz
Pimonster
Probethenet
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RankFlex
RankingBot2
RebelMouse
Recorder
Ripper
SEOprofiler
SISTRIX
SalesIntelligent
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
SemrushBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitevigil
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spammen
Stripper
SuperBot
Telesphoreo
Thumbor
TightTwatBot
Toata
Toweyabot
Trendiction
TurnitinBot
TwengaBot
URLy.Warning
VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
Wallpapers/3.0
WeSEE
Web Collage
Web Fetch
Web Sucker
WebAuto
WebEnhancer
WebImageCollector
WebZIP
WebmasterWorldForumBot
Website Quester
Whack
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
Xaldon WebSpider
Zauba
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
meanpathbot
pcBrowser
probe-image-size
ripz
seobility
serpstatbot
sitechecker.pro
voyagerx.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io