nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-20 10:09:22 +00:00

250 lines
2.7 KiB
Text

360Spider
404checker
404enemy
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Anarchie
Anarchy99
Asterias
AwarioSmartBot
BBBike
BDCbot
BackStreet
Barkrowler
BetaBot
BlackWidow
Blow
Boardreader
Buck
BunnySlippers
CATExplorador
Chlooe
Citoid
Cloud mapping
Cogentbot
Copier
CopyRightCheck
Copyscape
Crescent
Curious
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Drip
ECCP/1.0
EMail Siphon
Ebingbong
Ecxi
Exabot
Express WebPictures
Extractor
ExtractorPro
Ezooms
FemtosearchBot
Fimap
FlashGet
Foobot
GermCrawler
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HaosouSpider
Harvest
Havij
Heritrix
Humanlinks
IDBot
Id-search
IlseBot
InfoNaviRobot
Intelliseek
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LeechFTP
LeechGet
LexiBot
LibWeb
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MIDown tool
MIIxpc
MSIECrawler
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Mozlila
Musobot
NICErsPRO
Nameprotect
Needle
Nessus
Net Vampire
NetAnts
NetMechanic
Netvibes
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Nuclei
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Panscient
Petalbot
Pimonster
RSSingBot
RankActive
RankingBot
Reaper
Recorder
RedesScrapy
RepoMonkey
Ripper
SEOlyticsCrawler
SEOprofiler
ScanAlert
Scanbot
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SentiBot
Shodan
SiteCheckerBotCrawler
SiteSnagger
Sociscraper
Sogou web spider
SpaceBison
Spinn3r
Steeler
Sucuri
SurveyBot
Swiftbot
Szukacz
T8Abot
Thumbor
TightTwatBot
Tracemyfile
Trendiction
Turnitin
Twice
UnisterBot
Upflow
V-BOT
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
WebAuto
WebBandit
WebPix
WebSucker
WebWhacker
WebmasterWorldForumBot
WebsiteQuester
Widow
Wonderbot
Woobot
Xenu
Zauba
Zeus
ZmEu
ZoomBot
ZumBot
adscanner
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
coccocbot-web
dataforseo.com
eCatch
facebookscraper
gopher
internetVista monitor
iubenda-radar
lwp-request
magpie-crawler
mediawords
page scorer
s1z.ru
scalaj-http
scan.lol
sogouspider
sp_auditbot
spyfu
sysscan
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot