nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-07 10:09:23 +00:00

250 lines
2.7 KiB
Text

80legs
ADmantX
ASPSeek
Acunetix
Alexibot
Alligator
Anarchie
Anarchy99
Ankit
Aspiegel
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackWeb
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
BotALot
Brandprotect
Buck
Bullseye
BunnySlippers
CheTeam
Citoid
CopyRightCheck
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
Devil
Discobot
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
EMail Siphon
EMail Wolf
EroCrawler
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
FHscan
FemtosearchBot
Fimap
Freeuploader
Fyrebot
Gigabot
Grabber
Grafula
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Haansoft
Hloader
IDBTE4M
Id-search
IlseBot
Image Fetch
Indy Library
InfoTekies
Internet Ninja
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
LeechGet
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MSFrontPage
MTRobot
Mag-Net
MarkMonitor
Masscan
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Minefield
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
Nameprotect
Navroad
Nessus
NetLyzer
Niki-bot
Nimbostratus
Not
Nutch
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
Openfind
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
PictureFinder
ProPowerBot
Psbot
Pump
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
ScoutJet
SemanticJuice
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
SlySearch
Snapbot
Snoopy
Sociscraper
Sogou web spider
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
Sqlworm
Steeler
Sucker
Sucuri
Surfbot
SurveyBot
T0PHackTeam
T8Abot
Telesphorep
TheNomad
TightTwatBot
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
V-BOT
Vacuum
VelenPublicWebCrawler
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Auto
Web Fuck
Web Pix
Web Sauger
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebPix
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Whack
WiseGuys Robot
Xaldon WebSpider
YoudaoBot
Zauba
Zeus
ZoominfoBot
ZyBorg
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
crawler.feedback
crawler4j
heritrix
instabid
internetVista monitor
ips-agent
isitwp.com
magpie-crawler
muhstik-scan
oBot
pcBrowser
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scan.lol
seocompany.store
seoscanners
sitechecker.pro
siteripz
sogouspider
sp_auditbot
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zgrab