nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-06 10:09:36 +00:00

250 lines
2.6 KiB
Text

Aboundex
Aboundexbot
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Apexoo
Asterias
Atomseobot
AwarioSmartBot
BBBike
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
BetaBot
Bigfoot
BlackWidow
Blackboard
BlowFish
Brandprotect
Buddy
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CherryPicker
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copyscape
CrazyWebCrawler
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Demon
Deusu
Discobot
DittoSpyder
ECCP/1.0
EMail Siphon
EMail Wolf
Evil
Extractor
EyeNetIE
FDM
Fimap
Firefox/7.0
FlashGet
Foobot
FyberSpider
Fyrebot
GalaxyBot
Gigabot
Go-Ahead-Got-It
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
Haansoft
Heritrix
Hloader
HonoluluBot
Humanlinks
HybridBot
IDBot
Iblog
Image Fetch
InfoNaviRobot
Intelliseek
Iria
Iskanie
IstellaBot
Jbrofuzz
JennyBot
Jetty
Joomla
Kenjin Spider
Keyword Density
Lightspeedsystems
LinkScan
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
MSFrontPage
Mag-Net
Majestic12
Mass Downloader
Masscan
Mb2345Browser
Meanpathbot
Microsoft URL Control
Mojeek
Mojolicious
Msrabot
NICErsPRO
Nameprotect
Navroad
Nessus
Net Vampire
NetLyzer
NetMechanic
NetSpider
NextGenSearchBot
Niki-bot
Nikto
Ninja
Nuclei
Nutch
Octopus
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
PageScorer
Papa Foto
Pavuk
Piepmatz
Pockey
ProWebWalker
Psbot
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot2
Re-re
ReGet
RebelMouse
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
ScoutJet
Scrapy
Screaming
Semrush
SemrushBot
SentiBot
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitebeam
SmartDownload
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
SpankBot
Spbot
Spinn3r
Sqlmap
Sqlworm
Steeler
Stripper
SuperHTTP
Surfbot
SurveyBot
Swiftbot
Telesoft
Telesphorep
Toweyabot
Tracemyfile
True_Robot
Turingos
TurnitinBot
URLy Warning
URLy.Warning
V-BOT
Vacuum
VelenPublicWebCrawler
Voil
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Sucker
WebBandit
WebCollage
WebFuck
WebLeacher
WebPix
WebReaper
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Whack
WinHTTrack
WiseGuys Robot
Woobot
YoudaoBot
Zeus
Zitebot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
backlink-check
cah.io.community
check1.exe
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
evc-batch
gopher
heritrix
instabid
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
page scorer
polaris version
probe-image-size
ripz
scalaj-http
scan.lol
seobility
seostar
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
spyfu
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
zauba.io
zgrab