nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-13 10:09:17 +00:00

250 lines
2.7 KiB
Text

360Spider
AIBOT
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Aipbot
AllSubmitter
Anarchy
Anthill
BDCbot
BackStreet
Backlink-Ceck
Badass
Bandit
Battleztar Bazinga
Bigfoot
Blackboard
Blow
BotALot
Buck
Buddy
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Citoid
Cogentbot
Collector
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DSearch
Deusu
Disco
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Dragonfly
Drip
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
Evil
Extractor
Extreme Picture Finder
Ezooms
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetRight
Getintent
Go!Zilla
GoZilla
Gotit
GrabNet
Grabber
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
HonoluluBot
Humanlinks
IDBTE4M
IlseBot
Image Fetch
Intelliseek
JamesBOT
Jbrofuzz
JustView
Keybot Translation-Search-Machine
LWP::Simple
Leap
LeechFTP
Lftp
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MIDown tool
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
MeanPath Bot
Minefield
Moblie Safari
Mojolicious
MolokaiBot
Mozlila
NICErsPRO
Name Intelligence
Navroad
NearSite
NetMechanic
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Nikto
Nuclei
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Pavuk
PeoplePal
PictureFinder
Piepmatz
Pixray
ProPowerBot
Probethenet
Pump
PxBroker
QueryN Metasearch
RankActive
RankFlex
RankingBot
Re-re
RealDownload
Recorder
RocketCrawler
SMTBot
SalesIntelligent
Scanbot
Scrapy
Screaming
ScreenerBot
Searchestate
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
Snake
Snoopy
SocialRankIOBot
Sociscraper
Spbot
Sqlworm
Steeler
Stripper
SurveyBot
T8Abot
Teleport
Telesoft
Telesphoreo
TightTwatBot
Titan
Trendiction
True_Robot
Turingos
TurnitinBot
URLy Warning
Upflow
V-BOT
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
WWW::Mechanize
Web Pix
WebAuto
WebBandit
WebCollage
WebFetch
WebPix
WebReaper
WebZIP
Website Quester
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
Wprecon
Xaldon_WebSpider
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
backlink-check
cah.io.community
clark-crawler
coccocbot
com.plumanalytics
domainsproject.org
eCatch
gopher
heritrix
instabid
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
plumanalytics
probe-image-size
ripz
scalaj-http
seocompany.store
seostar
sogouspider
tAkeOut
ubermetrics-technologies.com
webmeup-crawler