nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-17 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
ADmantX
Aboundex
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator
Anarchy
Atomseobot
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
Battleztar Bazinga
BetaBot
Blackboard
BlowFish
Bolt
Brandprotect
Brandwatch
BuiltBotTough
BunnySlippers
BuzzSumo
CSHttp
Calculon
CherryPicker
Cogentbot
Collector
CopyRightCheck
CrazyWebCrawler
DSearch
DTS Agent
Deusu
Digincore
DigitalPebble
Discoverybot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EirGrabber
FemtosearchBot
Fimap
Foobot
Fuzz
G-i-g-a-b-o-t
GalaxyBot
Go!Zilla
Gotit
GrabNet
GrapeshotCrawler
HTMLparser
Heritrix
Hloader
HonoluluBot
HybridBot
IDBot
Iblog
IlseBot
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
InternetSeer
Iria
JamesBOT
JetCar
Jetty
Joomla
JustView
Jyxobot
Kozmosbot
Leap
LibWeb
LieBaoFast
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Minefield
Mojeek
MolokaiBot
Mr.4x3
NPbot
Name Intelligence
NearSite
Nessus
NetAnts
NetMechanic
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Nikto
Nmap
Nutch
Offline Navigator
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
Panscient
Papa Foto
Petalbot
Pi-Monster
Picscout
Pimonster
Pixray
ProWebWalker
Psbot
PyCurl
RSSingBot
RankFlex
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SlySearch
Snake
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Sqlmap
Sqworm
Stripper
Sucker
Sucuri
Surfbot
Szukacz
Teleport
TeleportPro
Telesphorep
Thumbor
Tracemyfile
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
VB Project
Vacuum
Vagabondo
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
Web Collage
WebAuto
WebBandit
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
WebSauger
WebStripper
Webalta
WebmasterWorldForumBot
Website Quester
Whack
Who.is Bot
WiseGuys Robot
Woobot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zitebot
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
coccocbot-web
demandbase-bot
eCatch
facebookscraper
gopher
instabid
isitwp.com
lwp-request
mediawords
netEstate NE Crawler
ripz
satoristudio.net
serpstatbot
sogouspider
trendiction.com
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla
zgrab