nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-28 10:09:21 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
404enemy
Aboundexbot
AfD-Verbotsverfahren
AllSubmitter
AlphaBot
Anarchie
Anarchy
Ankit
Anthill
AwarioSmartBot
BackStreet
BackWeb
Barkrowler
BlackWidow
Blackboard
Boardreader
Bolt
Brandwatch
Buddy
BuiltWith
BunnySlippers
CATExplorador
CSHttp
CherryPicker
Chlooe
Cloud mapping
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DBLBot
Deusu
Devil
Digincore
DittoSpyder
DomCopBot
Domains Project
Dotbot
Dragonfly
EasyDL
Ecxi
EroCrawler
Evil
Extractor
Extreme Picture Finder
FemtosearchBot
Firefox/7.0
Freeuploader
G-i-g-a-b-o-t
GT::WWW
Getintent
Gigabot
Go!Zilla
Gotit
GrabNet
Grafula
GrapeFX
HaosouSpider
Heritrix
Hloader
IDBTE4M
Id-search
IlseBot
Image Fetch
InfoNaviRobot
Internet Ninja
InternetSeer
JOC Web Spider
JennyBot
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Leap
LeechFTP
LeechGet
LexiBot
LieBaoFast
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
NICErsPRO
Nessus
Net Vampire
Nettrack
Niki-bot
Nimbostratus
Ninja
Nmap
Octopus
Offline Navigator
OpenLinkProfiler
OrangeBot
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pi-Monster
PictureFinder
Piepmatz
Pixray
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
ReGet
RebelMouse
RedesScrapy
RocketCrawler
SBIder
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScrepyBot
Searchestate
SemrushBot
SeoSiteCheckup
Shodan
SiteExplorer
SiteLockSpider
Siteimprove
Snapbot
Spammen
Sqworm
Stripper
Sucker
Surfbot
SurveyBot
Szukacz
T8Abot
Teleport
Telesoft
The Intraformant
TightTwatBot
Toweyabot
Twice
URLy.Warning
UnisterBot
VB Project
Vagabondo
VelenPublicWebCrawler
VidibleScraper
WBSearchBot
WEBDAV
WWW-Collector-E
WWWOFFLE
WeSEE
Web Auto
Web Fetch
Web Pix
WebBandit
WebCollage
WebEnhancer
WebFetch
WebFuck
WebPix
WebSauger
WebWhacker
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Woobot
Wotbox
Wprecon
Zauba
Zeus
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
cognitiveseo
crawler.feedback
demandbase-bot
eCatch
evc-batch
heritrix
instabid
isitwp.com
mediawords
muhstik-scan
pcBrowser
probe-image-size
satoristudio.net
scan.lol
seobility
seoscanners
serpstatbot
siteripz
spyfu
sysscan
tAkeOut
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
zauba.io
zgrab