nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-12 10:18:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ALittle Client
Abonti
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
Anarchie
Anarchy
Ankit
Anthill
Apexoo
Asterias
Attach
AwarioSmartBot
BBBike
BackDoorBot
BackWeb
Badass
Battleztar Bazinga
BetaBot
Blackboard
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
Calculon
CazoodleBot
Cogentbot
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Deusu
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DomainStatsBot
Dotbot
EMail Siphon
EMail Wolf
Ecxi
Exabot
ExtLinksBot
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
Foobot
FrontPage
G-i-g-a-b-o-t
Genieo
GetRight
GetWeb
Gigabot
GoZilla
Gotit
GrabNet
Grabber
Grafula
GrapeshotCrawler
GridBot
HMView
HTTrack
Heritrix
IlseBot
Indy Library
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Jetty
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
Lanshanbot
LeechGet
Likse
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MQQBrowser
MSFrontPage
Magnet
Mass Downloader
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
NearSite
NetLyzer
NetSpider
Netvibes
Niki-bot
Offline Explorer
OpenLinkProfiler
OpenVAS
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Pi-Monster
Picsearch
Pixray
PleaseCrawl
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
Rankivabot
RealDownload
RebelMouse
Recorder
RedesScrapy
Rogerbot
SISTRIX
SalesIntelligent
Screaming
SearchmetricsBot
SeobilityBot
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
Sociscraper
SpankBot
Spanner
Spinn3r
Steeler
Sucuri
SuperHTTP
SurveyBot
Suzuran
Szukacz
T8Abot
Teleport
TeleportPro
Telesphorep
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TurnitinBot
URLy Warning
Upflow
V-BOT
VB Project
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
Web Fetch
Web Sucker
WebGo IS
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
Webshag
Website Quester
WebsiteQuester
Whack
Whacker
Whatweb
Who.is Bot
Wonderbot
Wotbox
Wprecon
YoudaoBot
Zauba
Zeus
arquivo.pt
backlink-check
cah.io.community
cognitiveseo
com.plumanalytics
demandbase-bot
domainsproject.org
evc-batch
instabid
ips-agent
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
scan.lol
seoscanners
serpstatbot
siteripz
sogouspider
spyfu
trendiction.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io