nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-08 10:20:11 +00:00

250 lines
2.7 KiB
Text

360Spider
404checker
ALittle Client
Abonti
Aboundexbot
AfD-Verbotsverfahren
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Aspiegel
Asterias
Atomseobot
Attach
BDFetch
BackDoorBot
Badass
Bandit
Barkrowler
Battleztar Bazinga
Blackboard
BotALot
Brandwatch
BuiltBotTough
BunnySlippers
CSHttp
Calculon
Chlooe
Collector
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DTS Agent
Discobot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Ebingbong
EirGrabber
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
FlashGet
Freeuploader
G-i-g-a-b-o-t
GetRight
Go!Zilla
GrabNet
GrapeFX
HEADMasterSEO
HaosouSpider
Havij
Hloader
Humanlinks
HybridBot
IlseBot
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JennyBot
JetCar
Keybot Translation-Search-Machine
Kozmosbot
Larbin
LeechFTP
Lftp
LieBaoFast
LinkWalker
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Needle
NetMechanic
Netcraft
Nettrack
Nibbler
Nikto
Nimbostratus
Ninja
Nuclei
Octopus
Offline Explorer
Offline Navigator
OpenVAS
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Pavuk
Petalbot
Pockey
ProPowerBot
PyCurl
RankingBot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOstats
SMTBot
ScreenerBot
SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
Siphon
SiteLockSpider
SiteSnagger
Sitebeam
SlySearch
SmartDownload
Snake
Sogou web spider
Spammen
SpankBot
Spinn3r
SputnikBot
Sqlworm
SuperHTTP
Surfbot
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Trendiction
Turingos
Turnitin
TurnitinBot
URLy.Warning
Upflow
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
Voltron
WWW-Collector-E
WWW::Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Pix
Web Sauger
Web Sucker
WebAuto
WebCopier
WebFuck
WebReaper
WebStripper
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Webster
Whack
Whacker
WinHTTrack
Wonderbot
Wotbox
Wprecon
Zeus
Zitebot
ZmEu
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
com.plumanalytics
crawler4j
facebookscraper
heritrix
internetVista monitor
magpie-crawler
meanpathbot
oBot
page scorer
probe-image-size
scalaj-http
seobility
seocompany.store
seoscanners
seostar
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
trendiction.de
webgains-bot
webpros.com
x22Mozilla
zauba.io
zgrab