nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-12-16 17:54:40 +02:00

250 lines
2.6 KiB
Text

404enemy
Abonti
Acunetix
AhrefsBot
AIBOT
Aipbot
Alligator
AllSubmitter
Asterias
Attach
AwarioSmartBot
BackWeb
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
BetaBot
Bigfoot
Blackboard
Black Hole
BlackWidow
Boardreader
Bolt
BotALot
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
coccocbot-web
CopyRightCheck
Copyscape
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
Curious
Custo
demandbase-bot
DigitalPebble
Disco
DomainAppender
DomainStatsBot
Dotbot
Drip
DSearch
DTS Agent
Ebingbong
eCatch
ECCP/1.0
Ecxi
EroCrawler
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
FHscan
Firefox/7.0
Foobot
Genieo
Getintent
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Grabber
GrabNet
Haansoft
Havij
HEADMasterSEO
heritrix
Heritrix
Hloader
HTMLparser
Id-search
instabid
Intelliseek
InterGET
JamesBOT
JetCar
JikeSpider
Joomla
Lanshanbot
Lftp
Linkdexbot
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
lwp-request
LWP::Simple
Mag-Net
magpie-crawler
MarkWatch
Mata Hari
meanpathbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
MIDown tool
MIIxpc
Mister PiX
Msrabot
muhstik-scan
Musobot
Nameprotect
Needle
NetAnts
Netcraft
NetLyzer
NetMechanic
NetSpider
Netvibes
NetZIP
NextGenSearchBot
NICErsPRO
Nimbostratus
Nmap
OnCrawl
Openvas
OpenVAS
OrangeBot
OutfoxBot
PageAnalyzer
PageGrabber
page scorer
PageScorer
Pavuk
pcBrowser
Pockey
Probethenet
ProPowerBot
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
RedesScrapy
ReGet
RocketCrawler
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
Siphon
SISTRIX
SiteExplorer
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
Snapbot
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spbot
spyfu
Sqlmap
Sqworm
Stripper
SuperBot
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Teleport
Telesphorep
The Intraformant
Toata
Toweyabot
Turingos
TurnitinBot
Typhoeus
UnisterBot
Vacuum
Vagabondo
VB Project
VeriCiteCrawler
VoidEYE
Voltron
Wallpapers/3.0
WASALive-Bot
WebAuto
Web Auto
WebCopier
Web Enhancer
WebFuck
Web Fuck
WebImageCollector
WebLeacher
webmeup-crawler
WebReaper
WebSauger
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
WebWhacker
Whatweb
Who.is Bot
Widow
WISENutbot
Wonderbot
Woobot
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
Zade
zauba.io
zgrab
ZumBot