nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-28 22:07:02 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
AIBOT
ALittle Client
Aboundexbot
Acunetix
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Atomseobot
BDCbot
BDFetch
BackWeb
Backlink-Ceck
Bandit
Black Hole
BlackWidow
Boardreader
BotALot
Buck
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CODE87
Calculon
CheTeam
CherryPicker
Chlooe
Citoid
Claritybot
Cliqzbot
Collector
Copier
Crawling at Home Project
Curious
Custo
DTS Agent
DatabaseDriverMysqli
Discobot
Discoverybot
DomainAppender
Dotbot
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
EirGrabber
Evil
Exabot
Express WebPictures
EyeNetIE
FDM
Fimap
FlashGet
Flunky
Freeuploader
Fuzz
G-i-g-a-b-o-t
GalaxyBot
Genieo
Gigabot
Go-Ahead-Got-It
Gotit
Grabber
HTTP::Lite
Haansoft
HaosouSpider
Heritrix
Hloader
HybridBot
Image Sucker
Indy Library
InfoTekies
Intelliseek
Internet Ninja
Iria
JennyBot
Jetty
JikeSpider
Joomla
JustView
Kenjin Spider
Kozmosbot
LNSpiderguy
LeechFTP
Libwhisker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
Mag-Net
Magnet
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
Microsoft URL Control
Minefield
Mojolicious
MolokaiBot
Msrabot
NPbot
Name Intelligence
Navroad
NetSpider
NetZIP
Nettrack
Netvibes
Niki-bot
NimbleCrawler
Nimbostratus
Not
Offline Navigator
OpenVAS
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
PageScorer
PageThing.com
Panscient
Petalbot
Pi-Monster
Picsearch
Pimonster
Pixray
PleaseCrawl
Psbot
PyCurl
Quick-Crawler
RankingBot2
RankurBot
RealDownload
Recorder
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScoutJet
Scrapy
Screaming
ScrepyBot
SemanticJuice
Semrush
SeoSiteCheckup
SeobilityBot
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SocialRankIOBot
Sosospider
SpankBot
Spbot
Spinn3r
Sqlmap
Sucker
Sucuri
SuperBot
Surfbot
T8Abot
TeleportPro
The Intraformant
Trendiction
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Upflow
V-BOT
VB Project
VCI
Vacuum
VeriCiteCrawler
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Auto
Web Enhancer
Web Fetch
WebFetch
WebGo IS
WebStripper
Webshag
Website Quester
WebsiteExtractor
Webster
Whatweb
Who.is Bot
Xenu
Zauba
Zermelo
Zitebot
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
backlink-check
clark-crawler
com.plumanalytics
crawler4j
domainsproject.org
evc-batch
facebookscraper
instabid
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
sexsearcher
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io