nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-14 10:09:13 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404enemy
80legs
ALittle Client
ASPSeek
AhrefsBot
AlphaBot
Anarchie
Anarchy99
Apexoo
Aspiegel
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
BlowFish
BotALot
Buddy
BuiltBotTough
BunnySlippers
CATExplorador
Cegbfeieh
CensysInspect
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Copier
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
Curious
Custo
DIIbot
DTS Agent
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Dirbuster
Discobot
Discoverybot
DomainCrawler
Domains Project
Dragonfly
EasyDL
EroCrawler
ExtLinksBot
ExtractorPro
FHscan
FemtosearchBot
Fimap
Flunky
Genieo
Go-Ahead-Got-It
GrapeFX
GridBot
HEADMasterSEO
HMView
HTMLparser
Havij
Humanlinks
IDBot
Iblog
IlseBot
Image Fetch
Internet Ninja
Iria
Iskanie
IstellaBot
Jbrofuzz
JetCar
JikeSpider
Jorgee
Kinza
LWP::Simple
Larbin
LeechGet
LexiBot
Lftp
LibWeb
LieBaoFast
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
MFC_Tear_Sample
MIIxpc
MJ12bot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MicroMessenger
Microsoft Data Access
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
Net Vampire
NetLyzer
NetMechanic
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nuclei
Offline Navigator
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PHPCrawl
Page Analyzer
Papa Foto
Petalbot
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
ProWebWalker
RankActiveLinkBot
RankingBot2
RankurBot
Re-re
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SISTRIX
SMTBot
ScanAlert
Scrapy
SearchmetricsBot
SemrushBot
Shodan
Siphon
Site Sucker
SiteExplorer
Snapbot
Snoopy
Sociscraper
SpankBot
Spbot
SputnikBot
Sqworm
Steeler
Stripper
Sucuri
SuperHTTP
SurveyBot
Suzuran
Teleport
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Sauger
Web Sucker
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whack
Widow
WinHTTrack
Wonderbot
Zeus
ZoomBot
ZyBorg
archive.org_bot
cah.io.community
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
gopher
heritrix
internetVista monitor
isitwp.com
magpie-crawler
meanpathbot
mediawords
oBot
page scorer
pcBrowser
satoristudio.net
scan.lol
seobility
seostar
sexsearcher
sp_auditbot
sysscan
ubermetrics-technologies.com
x09Mozilla
zauba.io