nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-26 10:09:13 +00:00

250 lines
2.6 KiB
Text

Aboundex
Aboundexbot
AhrefsBot
Alligator
Aspiegel
Attach
BDCbot
BDFetch
BackWeb
Backlink-Ceck
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
Blackboard
Blow
Bolt
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CODE87
CSHttp
CheeseBot
CherryPicker
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Digincore
Dirbuster
Disco
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
ExtLinksBot
ExtractorPro
EyeNetIE
Fimap
Freeuploader
Fuzz
Fyrebot
Genieo
GetRight
GetWeb
Gigabot
Go!Zilla
GrapeshotCrawler
Hloader
Humanlinks
Iblog
Image Fetch
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
IstellaBot
Jbrofuzz
JikeSpider
Joomla
Kinza
LNSpiderguy
LWP::Simple
LeechFTP
Likse
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
MFC_Tear_Sample
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
MegaIndex.ru
Metauri
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Needle
Nessus
Net Vampire
NetAnts
NetSpider
NetZIP
Netcraft
Nettrack
Niki-bot
Nimbostratus
Ninja
Nmap
Octopus
Offline Explorer
OpenVAS
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
Panscient
Pi-Monster
Picscout
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
Quick-Crawler
RankFlex
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Recorder
Rogerbot
SEOprofiler
Scanbot
ScrepyBot
SearchmetricsBot
Seekport
SemrushBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
Snoopy
Spanner
Spbot
Steeler
Sucuri
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
Thumbor
Trendiction
True_Robot
Turingos
Turnitin
TwengaBot
V-BOT
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Fuck
WebBandit
WebCollage
WebEnhancer
WebFetch
WebImageCollector
WebSucker
Webshag
Website Quester
WebsiteExtractor
Whacker
WiseGuys Robot
Woobot
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
cognitiveseo
crawl.sogou.com
domainsproject.org
eCatch
heritrix
internetVista monitor
ips-agent
isitwp.com
iubenda-radar
lwp-request
magpie-crawler
meanpathbot
polaris version
probe-image-size
satoristudio.net
scalaj-http
siteripz
tAkeOut
trendiction.com
webgains-bot
webmeup-crawler
zauba.io
zgrab