nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-20 10:09:24 +00:00

250 lines
2.6 KiB
Text

ADmantX
AIBOT
Acunetix
AfD-Verbotsverfahren
Aipbot
Anarchy99
Ankit
Anthill
BackStreet
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
BlackWidow
Blackboard
BlowFish
Boardreader
Brandwatch
Buck
Bullseye
BunnySlippers
BuzzSumo
CSHttp
CherryPicker
ChinaClaw
Citoid
Claritybot
Cloud mapping
Copier
Craftbot
Crawling at Home Project
Curious
DSearch
Demon
Deusu
Digincore
Dirbuster
Disco
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
EirGrabber
Evil
Exabot
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Fimap
FlashGet
Fyrebot
GT::WWW
GetWeb
Gigabot
GoZilla
Gotit
GrabNet
Grafula
GrapeshotCrawler
HTTrack
Haansoft
HaosouSpider
Havij
Heritrix
IDBot
Iblog
Id-search
Image Fetch
Indy Library
InfoTekies
InternetSeer
Iskanie
IstellaBot
JamesBOT
JetCar
Jyxobot
LNSpiderguy
Lanshanbot
Larbin
Libwhisker
LieBaoFast
LinkScan
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Majestic SEO
Majestic12
Mata Hari
Microsoft Data Access
Microsoft URL Control
Minefield
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
NearSite
Needle
Nessus
Net Vampire
NetZIP
Netcraft
Netvibes
Nikto
Nmap
Nutch
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
Pavuk
Piepmatz
Pimonster
Pixray
Pockey
Probethenet
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankingBot2
Rankivabot
RebelMouse
Recorder
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
Scrapy
Seekport
SemrushBot
SeoSiteCheckup
Siphon
Site Sucker
SiteExplorer
SiteSucker
Snake
Snapbot
Snoopy
Sosospider
Sottopop
Sqlworm
Steeler
Stripper
Sucuri
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesphoreo
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Turnitin
TurnitinBot
Twice
URLy.Warning
UnisterBot
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WISENutbot
WPScan
WWW-Mechanize
WallpapersHD
WeSEE
Web Fetch
Web Pix
Web Sucker
WebAuto
WebBandit
WebGo IS
WebReaper
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Xenu
Zade
Zauba
Zeus
ZmEu
ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
clark-crawler
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
facebookscraper
gopher
heritrix
iubenda-radar
lwp-request
muhstik-scan
page scorer
probe-image-size
ripz
satoristudio.net
scan.lol
seoscanners
sitechecker.pro
siteripz
sogouspider
sp_auditbot
sysscan
tAkeOut
voyagerx.com
x09Mozilla
zgrab