nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-21 22:06:48 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
ALittle Client
Abonti
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchy99
Ankit
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Blow
Boardreader
BotALot
Buddy
Bullseye
BunnySlippers
BuzzSumo
CSHttp
CazoodleBot
CheTeam
CherryPicker
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Copier
Copyscape
Cosmos
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent
Dirbuster
Discobot
Discoverybot
DomainStatsBot
Domains Project
ECCP/1.0
EMail Siphon
Ebingbong
Ecxi
EroCrawler
Evil
Extractor
Extreme Picture Finder
EyeNetIE
Flunky
Fyrebot
Getintent
Go!Zilla
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
Heritrix
Humanlinks
HybridBot
IDBot
Iblog
InternetSeer
IstellaBot
JustView
Jyxobot
Keyword Density
Kozmosbot
LWP::Simple
Leap
LexiBot
Lftp
LibWeb
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
MSIECrawler
MTRobot
Mag-Net
MarkWatch
Mata Hari
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Msrabot
NPbot
Needle
Nessus
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Pavuk
Pi-Monster
Picscout
Picsearch
Pimonster
PleaseCrawl
Psbot
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
RealDownload
RebelMouse
Recorder
Ripper
RocketCrawler
SBIder
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
SemrushBot
SeoSiteCheckup
Shodan
Site Sucker
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Snake
Snoopy
Sogou web spider
Sosospider
SpaceBison
Sqlmap
Sqlworm
Stripper
Sucker
SurveyBot
Teleport
Telesphoreo
Telesphorep
The Intraformant
Toweyabot
Trendictionbot
True_Robot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
Upflow
V-BOT
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Voil
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Fuck
WebAuto
WebCopier
WebEnhancer
WebFuck
WebImageCollector
WebReaper
WebSauger
WebWhacker
Webshag
Website Quester
WebsiteExtractor
Webster
Whacker
Widow
Wonderbot
Wprecon
Xenu
Zeus
ZmEu
ZoominfoBot
ZyBorg
clark-crawler
crawl.sogou.com
dataforseo.com
demandbase-bot
domainsproject.org
heritrix
instabid
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
oBot
page scorer
pcBrowser
satoristudio.net
scan.lol
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab