nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-23 22:07:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
AIBOT
Acunetix
AhrefsBot
Anarchie
Anarchy
Ankit
Apexoo
Aspiegel
Asterias
BDFetch
BackDoorBot
Backlink-Ceck
Badass
Battleztar Bazinga
Bigfoot
Blackboard
BlowFish
Boardreader
Brandprotect
Buck
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CheTeam
Chlooe
Citoid
Claritybot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
DigitalPebble
Dirbuster
Discoverybot
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
ECCP/1.0
Ebingbong
EirGrabber
EroCrawler
Extreme Picture Finder
Ezooms
FemtosearchBot
FlashGet
FrontPage
Genieo
GermCrawler
Go!Zilla
Go-Ahead-Got-It
Grabber
GrapeshotCrawler
HEADMasterSEO
Haansoft
Havij
Hloader
IDBot
IRLbot
Iblog
Id-search
IlseBot
Indy Library
InfoTekies
Intelliseek
InterGET
Iria
JennyBot
Jorgee
JustView
Jyxobot
Keyword Density
Kinza
LWP::Simple
Lanshanbot
LeechFTP
LibWeb
Libwhisker
Linkdexbot
LinkpadBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
Microsoft Data Access
Minefield
Mojolicious
MolokaiBot
Mr.4x3
NPbot
Nameprotect
Navroad
NearSite
Needle
NetMechanic
NetSpider
NetZIP
Nibbler
Niki-bot
Nikto
Ninja
Not
Nuclei
Offline Explorer
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Pavuk
Petalbot
PictureFinder
PleaseCrawl
ProPowerBot
Psbot
Pump
PyCurl
RankActive
RankingBot2
Rankivabot
Re-re
ReGet
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SalesIntelligent
Scrapy
Screaming
ScreenerBot
ScrepyBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteLockSpider
SmartDownload
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
SpankBot
Spbot
SputnikBot
Sqworm
Sucuri
Suzuran
Swiftbot
Teleport
TightTwatBot
Toata
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
URLy Warning
URLy.Warning
UnisterBot
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WEBDAV
WPScan
WWW::Mechanize
WeSEE
Web Collage
Web Fuck
Web Sucker
WebImageCollector
WebLeacher
WebSauger
WebSucker
Webalta
WebsiteQuester
Webster
Whack
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
Zade
ZoomBot
ZumBot
adscanner
arquivo-web-crawler
autoemailspider
cah.io.community
com.plumanalytics
domainsproject.org
gopher
heritrix
instabid
internetVista monitor
lwp-trivial
magpie-crawler
netEstate NE Crawler
pcBrowser
polaris version
scalaj-http
seostar
sitechecker.pro
spyfu
trendiction.de
x22Mozilla
xpymep1.exe