nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-04 22:07:21 +00:00

250 lines
2.6 KiB
Text

360Spider
ALittle Client
Acunetix
AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anthill
Asterias
Attach
BDFetch
BLEXBot
BackDoorBot
BackStreet
Barkrowler
BatchFTP
Blackboard
Boardreader
Buddy
BuiltBotTough
BuiltWith
CSHttp
Calculon
Cegbfeieh
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Cosmos
Craftbot
Crescent
Custo
DBLBot
DIIbot
DTS Agent
Demon
Deusu
Discobot
DnBCrawler-Analytics
DomainStatsBot
Ebingbong
Ecxi
Evil
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
Fimap
Fuzz
Fyrebot
G-i-g-a-b-o-t
GermCrawler
GetRight
Getintent
Go!Zilla
GoZilla
Grabber
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Heritrix
HonoluluBot
HybridBot
IDBTE4M
IDBot
Iblog
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
Internet Ninja
Iria
IstellaBot
JamesBOT
Jbrofuzz
Joomla
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
LeechGet
LexiBot
Libwhisker
LieBaoFast
Likse
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft URL Control
Minefield
Mr.4x3
Msrabot
NPbot
Nameprotect
NearSite
Needle
NetAnts
NetMechanic
NetSpider
Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Ninja
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
Page Analyzer
PageScorer
Papa Foto
Pavuk
PeoplePal
PictureFinder
Pixray
Pockey
Probethenet
PyCurl
RankActive
RankingBot
RankingBot2
Rankivabot
Recorder
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming
Searchestate
Semrush
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
SmartDownload
Snake
Sosospider
SpankBot
Spanner
Sqlmap
Sqworm
Sucker
Suzuran
Szukacz
T0PHackTeam
Teleport
Telesoft
Telesphorep
Titan
Trendiction
TurnitinBot
URLy Warning
URLy.Warning
V-BOT
VelenPublicWebCrawler
VidibleScraper
VoidEYE
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Sucker
WebBandit
WebCollage
WebCopier
WebFetch
WebImageCollector
WebReaper
WebSucker
WebmasterWorldForumBot
Whatweb
Widow
WinHTTrack
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
Zauba
Zeus
Zitebot
ZoomBot
ZoominfoBot
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
dataforseo.com
demandbase-bot
eCatch
facebookscraper
gopher
ips-agent
meanpathbot
mediawords
muhstik-scan
oBot
page scorer
s1z.ru
scalaj-http
seocompany.store
seoscanners
seostar
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x09Mozilla