nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-01 22:07:21 +00:00

250 lines
2.6 KiB
Text

404enemy
AIBOT
Abonti
Aboundexbot
Acunetix
Alexibot
AllSubmitter
Anarchy
Anarchy99
Apexoo
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
BacklinkCrawler
Bandit
BatchFTP
Battleztar Bazinga
Black Hole
Blackboard
BlowFish
Bolt
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CODE87
CensysInspect
CheTeam
CherryPicker
Collector
Copier
Curious
Custo
DSearch
DataCha0s
Demon
Devil
Digincore
Discobot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Drip
Ecxi
EirGrabber
Evil
Exabot
Extractor
Extreme Picture Finder
FDM
Flunky
Foobot
FrontPage
FyberSpider
GermCrawler
GetRight
Go!Zilla
Gotit
Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
IndeedBot
Indy Library
Intelliseek
Internet Ninja
JennyBot
JetCar
Jetty
Joomla
Jyxobot
Kinza
Kozmosbot
Lanshanbot
Larbin
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MJ12bot
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
Mata Hari
MegaIndex.ru
Metauri
Microsoft URL Control
Minefield
Moblie Safari
Mozlila
Navroad
Nessus
NetSpider
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nutch
Offline Explorer
OrangeBot
PageGrabber
PageScorer
Panscient
Picsearch
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pump
QueryN Metasearch
RankActive
ReGet
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
Scrapy
Screaming
ScreenerBot
Seekport
SeobilityBot
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SpaceBison
SpankBot
Spanner
Spbot
Sqlmap
Sqlworm
Stripper
T0PHackTeam
T8Abot
Teleport
TeleportPro
TheNomad
Thumbor
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
URLy.Warning
Upflow
VCI
Vagabondo
VeriCiteCrawler
Virusdie
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WallpapersHD
Web Auto
Web Collage
Web Pix
Web Sucker
WebLeacher
WebSauger
WebSucker
Webalta
Webshag
WebsiteExtractor
Webster
Widow
WiseGuys Robot
Wonderbot
Woobot
Xenu
Zitebot
ZoominfoBot
ZyBorg
archive.org_bot
autoemailspider
clark-crawler
coccocbot
demandbase-bot
eCatch
evc-batch
gopher
instabid
iubenda-radar
linkdexbot
lwp-request
magpie-crawler
netEstate NE Crawler
page scorer
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
seostar
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zgrab