nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-12 22:10:57 +00:00

250 lines
2.5 KiB
Text

404enemy
80legs
Abonti
Aboundex
Acunetix
AhrefsBot
Alligator
Anarchie
Anarchy
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Black Hole
BlowFish
Boardreader
Bolt
Buck
Bullseye
BuzzSumo
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
Chlooe
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Collector
Copier
Cosmos
Craftbot
CrazyWebCrawler
Crescent
Custo
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Discoverybot
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
EMail Siphon
EMail Wolf
Ebingbong
EroCrawler
ExtLinksBot
ExtractorPro
FDM
FHscan
Firefox/7.0
Fuzz
GT::WWW
GoZilla
GrabNet
Grabber
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
HaosouSpider
Harvest
Hloader
HonoluluBot
IRLbot
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer
Iria
Iskanie
Jbrofuzz
JennyBot
JikeSpider
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
LeechGet
LexiBot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
MIIxpc
MJ12bot
MSFrontPage
Magnet
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
MolokaiBot
NPbot
NearSite
Needle
NetAnts
Nettrack
NextGenSearchBot
Niki-bot
NimbleCrawler
Ninja
Nmap
Not
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
OutclicksBot
OutfoxBot
PHPCrawl
PageGrabber
PageThing.com
Papa Foto
PictureFinder
Piepmatz
Pixray
Probethenet
Psbot
PxBroker
PyCurl
RSSingBot
RankActive
Rankivabot
RankurBot
ReGet
Reaper
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks-Robot
SEOstats
SalesIntelligent
Scrapy
ScrepyBot
SearchmetricsBot
SeoSiteCheckup
Seomoz
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Snapbot
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Sqlworm
Steeler
SuperBot
SuperHTTP
Surfbot
Swiftbot
T0PHackTeam
Teleport
The Intraformant
Thumbor
Toata
Toweyabot
TwengaBot
Twice
UnisterBot
Upflow
VB Project
VoidEYE
WBSearchBot
WWW-Collector-E
WWW::Mechanize
Web Pix
WebReaper
WebStripper
WebSucker
Webalta
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whatweb
Who.is Bot
WinHTTrack
ZumBot
ZyBorg
adscanner
arquivo.pt
backlink-check
cognitiveseo
com.plumanalytics
demandbase-bot
domainsproject.org
eCatch
facebookscraper
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
oBot
probe-image-size
ripz
seobility
seocompany.store
seoscanners
sexsearcher
sitechecker.pro
siteripz
sp_auditbot
spyfu
trendiction.com
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab