nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-18 22:07:23 +00:00

250 lines
2.7 KiB
Text

360Spider
404checker
404enemy
ADmantX
ASPSeek
Abonti
AfD-Verbotsverfahren
Alexibot
AwarioSmartBot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Badass
Battleztar Bazinga
Bigfoot
Boardreader
Bolt
Brandprotect
Brandwatch
Buck
Bullseye
BuzzSumo
CCBot
CSHttp
Calculon
CazoodleBot
CheTeam
CherryPicker
ChinaClaw
Copier
Copyscape
Cosmos
Crawling at Home Project
CrunchBot
Curious
Custo
CyotekWebCopy
DatabaseDriverMysqli
Demon
Deusu
Discoverybot
DnyzBot
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL
EroCrawler
Exabot
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
Freeuploader
FyberSpider
GT::WWW
Getintent
GrapeFX
GridBot
HTTP::Lite
Harvest
Heritrix
Humanlinks
IDBot
IRLbot
Id-search
Image Fetch
InfoNaviRobot
InfoTekies
InternetSeer
JOC Web Spider
JamesBOT
Jetty
Joomla
JustView
Kenjin Spider
LNSpiderguy
LWP::Simple
LeechFTP
Lftp
Libwhisker
LinkpadBot
LinksManager
Lipperhey
MSFrontPage
MSIECrawler
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
Net Vampire
NetMechanic
Netcraft
Nettrack
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot
Page Analyzer
PageThing.com
Pandalytics
PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder
PleaseCrawl
Pockey
Psbot
Pu_iN
Pump
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankingBot
RankurBot
RealDownload
Reaper
RebelMouse
Rogerbot
SEOstats
SMTBot
SalesIntelligent
ScoutJet
Searchestate
SearchmetricsBot
SemanticJuice
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
SiteSnagger
SiteSucker
SlySearch
SmartDownload
SocialRankIOBot
Sogou web spider
SpankBot
Spinn3r
SputnikBot
Steeler
Stripper
Sucker
Sucuri
SuperBot
T0PHackTeam
TeleportPro
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Toweyabot
Trendictionbot
True_Robot
URLy Warning
V-BOT
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voltron
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Collage
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebCopier
WebFuck
WebGo IS
WebWhacker
WebZIP
Webalta
WebsiteExtractor
Whatweb
Widow
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Xenu
Zade
Zauba
Zitebot
ZmEu
ZoomBot
ZoominfoBot
adscanner
autoemailspider
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
gopher
heritrix
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
seocompany.store
seostar
serpstatbot
sp_auditbot
trendiction.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io