nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-03-08 22:04:18 +02:00

250 lines
2.5 KiB
Text

360Spider
404enemy
80legs
Abonti
Aboundex
Acunetix
ADmantX
Aipbot
Alligator
AlphaBot
Anarchie
archive.org_bot
arquivo-web-crawler
Asterias
Attach
BackDoorBot
Backlink-Ceck
Barkrowler
BDCbot
BetaBot
Black Hole
BLEXBot
BuiltBotTough
Cegbfeieh
CherryPicker
CheTeam
Cliqzbot
coccocbot-web
CopyRightCheck
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
demandbase-bot
Devil
Digincore
DigitalPebble
Dirbuster
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dragonfly
EasyDL
Ebingbong
eCatch
Ecxi
EMail Siphon
Extractor
FDM
FemtosearchBot
FHscan
FrontPage
Genieo
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit
Grabber
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HaosouSpider
Havij
HEADMasterSEO
heritrix
Heritrix
Hloader
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InterGET
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
JennyBot
Jetty
JikeSpider
JOC Web Spider
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
Likse
Linkdexbot
LinksManager
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
lwp-request
lwp-trivial
Magnet
Mag-Net
Majestic SEO
MarkWatch
Masscan
Mata Hari
MegaIndex.ru
MFC_Tear_Sample
MIDown tool
MJ12bot
Mojeek
MSFrontPage
muhstik-scan
Name Intelligence
Nameprotect
Netcraft
Nettrack
NetZIP
NextGenSearchBot
NICErsPRO
Nikto
NPbot
oBot
Offline Explorer
OpenLinkProfiler
Openvas
OpenVAS
OutfoxBot
Page Analyzer
PageScorer
Panscient
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Picsearch
PleaseCrawl
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
Rankivabot
RealDownload
Reaper
RebelMouse
ReGet
Ripper
Rogerbot
RSSingBot
s1z.ru
ScanAlert
scan.lol
Scrapy
Searchestate
Semrush
SemrushBot
SEOkicks-Robot
Seomoz
sexsearcher
Shodan
Sitebeam
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Snoopy
sogouspider
Sottopop
SpaceBison
SpankBot
sp_auditbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Sqworm
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
sysscan
Szukacz
T0PHackTeam
Telesoft
Telesphorep
Thumbor
TightTwatBot
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
URLy.Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Fuck
WebImageCollector
WebmasterWorldForumBot
WebPix
Web Pix
Webshag
WebsiteQuester
Website Quester
WebStripper
WebSucker
Web Sucker
WebWhacker
Whack
Whacker
Widow
WinHTTrack
WISENutbot
Woobot
WPScan
WWW-Collector-E
Zauba
zauba.io
zgrab
ZumBot
ZyBorg