nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-05 10:09:11 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
Aboundex
AiHitBot
AlphaBot
Ankit
Atomseobot
Attach
BDCbot
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
Bigfoot
Bitacle
Boardreader
Bolt
Brandprotect
BuiltBotTough
BuiltWith
BuzzSumo
CCBot
CODE87
Calculon
CazoodleBot
CensysInspect
ChinaClaw
Citoid
Cogentbot
CrunchBot
Curious
Custo
CyotekWebCopy
DatabaseDriverMysqli
Devil
Digincore
Discobot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Download Wonder
EMail Wolf
EasyDL
Ebingbong
Exabot
Express WebPictures
Extractor
FDM
FlashGet
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
Getintent
Gigabot
Go!Zilla
GoZilla
GrabNet
Grabber
GrapeFX
GridBot
HTMLparser
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
Indy Library
Intelliseek
InterGET
Internet Ninja
Iria
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Jyxobot
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
LieBaoFast
LinkScan
Linkbot
LinkpadBot
LinksManager
Lipperhey
MFC_Tear_Sample
MIIxpc
MTRobot
Mail.RU_Bot
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Metauri
MicroMessenger
Minefield
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Net Vampire
NetAnts
NetLyzer
NetZIP
Netcraft
NextGenSearchBot
NimbleCrawler
Nmap
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
Pi-Monster
Picscout
Pixray
PleaseCrawl
Pockey
ProPowerBot
RSSingBot
RankActive
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
ReGet
Recorder
Ripper
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
ScanAlert
Scrapy
ScreenerBot
Seekport
Semrush
SentiBot
Seomoz
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitevigil
Sottopop
Spinn3r
Sqlmap
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
Suzuran
Teleport
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TightTwatBot
Tracemyfile
Trendiction
TwengaBot
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WEBDAV
WPScan
Wallpapers
Wallpapers/3.0
Web Enhancer
WebAuto
WebFetch
WebFuck
WebGo IS
WebPix
WebStripper
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
WiseGuys Robot
Woobot
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
crawler.feedback
domainsproject.org
evc-batch
facebookscraper
internetVista monitor
iubenda-radar
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler
plumanalytics
ripz
scalaj-http
seostar
sitechecker.pro
sp_auditbot
sysscan
ubermetrics-technologies.com
webprosbot
xpymep1.exe
zauba.io