nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-12 10:08:54 +00:00

250 lines
2.5 KiB
Text

01h4x.com
ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Aipbot
Alligator
AlphaBot
Anarchie
Ankit
Asterias
Attach
BDCbot
BDFetch
Badass
Black Hole
BlowFish
Boardreader
Bolt
Buck
BuiltWith
CATExplorador
CSHttp
Cegbfeieh
CheTeam
CheeseBot
Chlooe
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
Cosmos
Custo
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Digincore
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dragonfly
ECCP/1.0
Ebingbong
Evil
Express WebPictures
EyeNetIE
Firefox/7.0
FlashGet
FrontPage
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
Gotit
Grafula
GridBot
HMView
Haansoft
HybridBot
IDBTE4M
IDBot
Iblog
Image Fetch
Image Sucker
Indy Library
Intelliseek
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
JikeSpider
JustView
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LeechFTP
LexiBot
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Ltx71
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MauiBot
Metauri
Microsoft URL Control
Mozlila
Mr.4x3
Msrabot
Navroad
Needle
Net Vampire
NetAnts
NetMechanic
NetSpider
Nettrack
Niki-bot
Nikto
Ninja
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
OutclicksBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Pavuk
Petalbot
Picscout
Pixray
Pockey
ProPowerBot
Probethenet
Psbot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot2
ReGet
RebelMouse
Recorder
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
ScanAlert
ScoutJet
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Sitevigil
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spanner
Spbot
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
T8Abot
Telesphoreo
TheNomad
Thumbor
Titan
Toata
Tracemyfile
True_Robot
Turnitin
TwengaBot
Twice
UnisterBot
V-BOT
VeriCiteCrawler
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Collage
Web Pix
WebBandit
WebCollage
WebFetch
WebGo IS
WebLeacher
WebSucker
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Who.is Bot
Wonderbot
Woobot
Wotbox
Xenu
ZmEu
ZumBot
arquivo.pt
autoemailspider
cognitiveseo
com.plumanalytics
dataforseo.com
demandbase-bot
facebookscraper
instabid
internetVista monitor
isitwp.com
magpie-crawler
page scorer
pcBrowser
probe-image-size
ripz
s1z.ru
satoristudio.net
scalaj-http
seostar
serpstatbot
siteripz
sogouspider
sp_auditbot
sysscan
webmeup-crawler
xpymep1.exe
zauba.io
zgrab