nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-19 22:07:27 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404checker
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Asterias
Atomseobot
AwarioSmartBot
Backlink-Ceck
Battleztar Bazinga
BlackWidow
Blackboard
Boardreader
BotALot
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CSHttp
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Craftbot
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DSearch
Deusu
Dirbuster
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
EasyDL
Express WebPictures
ExtLinksBot
FemtosearchBot
Firefox/7.0
GalaxyBot
GermCrawler
GetRight
Gotit
Grabber
GrapeshotCrawler
HTMLparser
HTTrack
Haansoft
HaosouSpider
Havij
Heritrix
IDBTE4M
IlseBot
Image Sucker
Intelliseek
Internet Ninja
IstellaBot
JamesBOT
JetCar
Joomla
Jyxobot
Keybot Translation-Search-Machine
Kinza
Larbin
LeechGet
LexiBot
LibWeb
LieBaoFast
Likse
LinkScan
LinkWalker
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot
Magnet
Masscan
MauiBot
Metauri
MicroMessenger
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Musobot
NPbot
Nameprotect
Navroad
Nessus
Net Vampire
NetAnts
NetLyzer
Netcraft
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nuclei
Nutch
Offline Explorer
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PageScorer
PageThing.com
Pavuk
Picsearch
PictureFinder
Pimonster
ProPowerBot
ProWebWalker
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RankingBot
RankurBot
Reaper
RebelMouse
Ripper
RocketCrawler
SalesIntelligent
Scanbot
Scrapy
SearchmetricsBot
Seekport
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
SiteSucker
Sitebeam
SmartDownload
Snake
Snapbot
Sosospider
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Telesoft
Thumbor
Toweyabot
Trendiction
True_Robot
Turingos
TurnitinBot
URLy Warning
URLy.Warning
Upflow
VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
Web Collage
Web Enhancer
Web Pix
WebAuto
WebCollage
WebCopier
WebFuck
WebImageCollector
WebReaper
WebStripper
WebsiteExtractor
WebsiteQuester
Whacker
WinHTTrack
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
ZoomBot
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
eCatch
heritrix
instabid
internetVista monitor
linkdexbot
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
polaris version
s1z.ru
seobility
sexsearcher
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
webpros.com
xpymep1.exe
zauba.io