nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-12 22:07:12 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
AIBOT
Abonti
AhrefsBot
AllSubmitter
Anarchy99
Ankit
Aspiegel
AwarioSmartBot
BackStreet
Backlink-Ceck
BetaBot
Bigfoot
Black Hole
Blackboard
BlowFish
Bolt
Brandprotect
Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CensysInspect
CheeseBot
Citoid
Cloud mapping
Collector
Craftbot
Custo
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DomainSigmaCrawler
Download Wonder
ECCP/1.0
EMail Siphon
Extractor
FDM
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
GetWeb
Getintent
GoZilla
GrabNet
Grafula
HMView
Haansoft
Havij
Heritrix
HonoluluBot
IDBot
IRLbot
Image Sucker
IndeedBot
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JamesBOT
Jetty
Kinza
LNSpiderguy
Lanshanbot
Larbin
LexiBot
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MQQBrowser
MTRobot
Mag-Net
Magnet
Majestic12
MarkWatch
Metauri
Microsoft URL Control
Mojolicious
Mozlila
Mr.4x3
Musobot
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Nmap
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PageThing.com
Panscient
Papa Foto
Picscout
Pixray
ProWebWalker
Probethenet
PxBroker
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
RebelMouse
Recorder
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
Scrapy
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SeobilityBot
Siphon
SiteCheckerBotCrawler
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap
Sqlworm
Stripper
Sucker
Sucuri
SuperBot
SurveyBot
Szukacz
T8Abot
Teleport
Telesoft
Telesphoreo
TightTwatBot
Toata
Toweyabot
Turingos
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
VB Project
VidibleScraper
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
Web Enhancer
Web Fetch
Web Pix
WebBandit
WebCopier
WebFetch
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebsiteQuester
Webster
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZoomBot
ZoominfoBot
cah.io.community
check1.exe
dataforseo.com
domainsproject.org
eCatch
gopher
heritrix
instabid
lwp-request
lwp-trivial
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seobility
seoscanners
serpstatbot
sogouspider
trendiction.de
webprosbot
x09Mozilla
zgrab