nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-28 10:09:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
Abonti
Aboundex
Acunetix
Aipbot
Alexibot
AlphaBot
Apexoo
Asterias
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Barkrowler
BetaBot
Black Hole
Blackboard
BlowFish
Boardreader
BotALot
Brandwatch
Buck
Buddy
BuiltWith
Bullseye
CCBot
CODE87
CensysInspect
CherryPicker
Claritybot
Cocolyzebot
Copier
Copyscape
Cosmos
Crescent
CrunchBot
Custo
CyotekWebCopy
DataCha0s
Devil
Digincore
Dirbuster
Discobot
Dispatch
DomCopBot
DomainStatsBot
Domains Project
ECCP/1.0
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
G-i-g-a-b-o-t
Getintent
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Haansoft
Harvest
Hloader
IDBTE4M
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoTekies
Intelliseek
InterGET
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jorgee
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
LinkWalker
LinkpadBot
LinksManager
Litemage_walker
Lmspider
MJ12bot
MSFrontPage
MSIECrawler
Majestic12
Masscan
MauiBot
Mediatoolkitbot
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
Mr.4x3
Musobot
Nameprotect
Navroad
Needle
NetAnts
NetMechanic
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Nikto
Ninja
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openvas
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Pavuk
Pi-Monster
Piepmatz
Pimonster
Probethenet
Pump
PyCurl
Quick-Crawler
RSSingBot
RankFlex
Rankivabot
RealDownload
Recorder
RepoMonkey
Rogerbot
SBIder
SMTBot
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SentiBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
SlySearch
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sottopop
Spammen
SpankBot
SputnikBot
Sqlworm
Steeler
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
Swiftbot
Telesphorep
Thumbor
TightTwatBot
Toweyabot
True_Robot
UnisterBot
Vagabondo
VeriCiteCrawler
WBSearchBot
WWW-Collector-E
WWW-Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Collage
Web Fuck
Web Sucker
WebBandit
WebFetch
WebSucker
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
Who.is Bot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zitebot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
clark-crawler
cognitiveseo
dataforseo.com
heritrix
ips-agent
iubenda-radar
lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
ripz
scalaj-http
sexsearcher
siteripz
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webpros.com
x22Mozilla
xpymep1.exe
zauba.io