nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-03 10:09:33 +00:00

250 lines
2.8 KiB
Text

404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Anarchie
Anarchy
Apexoo
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Blackboard
Brandprotect
Buck
BuiltBotTough
BunnySlippers
CATExplorador
CODE87
ChinaClaw
Cloud mapping
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DataCha0s
Devil
Digincore
Discoverybot
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
Domains Project
Drip
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Express WebPictures
Extractor
ExtractorPro
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Freeuploader
GetRight
Go!Zilla
GoZilla
Gotit
HTTrack
HaosouSpider
HybridBot
Id-search
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
Iskanie
JamesBOT
JetCar
Jetty
JikeSpider
Jorgee
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Larbin
Leap
LibWeb
Libwhisker
LinkScan
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Navroad
NearSite
NetLyzer
NetMechanic
NetSpider
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Not
Nutch
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageThing.com
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
Pimonster
Probethenet
PxBroker
PyCurl
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
RealDownload
RebelMouse
SEOlyticsCrawler
SEOstats
SISTRIX
Screaming
ScreenerBot
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteExplorer
SiteSucker
SmartDownload
Snoopy
Sociscraper
Sogou web spider
Sosospider
Spbot
Spinn3r
Sqlworm
Stripper
SuperBot
T0PHackTeam
Teleport
TeleportPro
The Intraformant
TightTwatBot
Toata
TwengaBot
Typhoeus
Upflow
VCI
Vacuum
VelenPublicWebCrawler
VoidEYE
Voltron
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Fetch
Web Sucker
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
Website Quester
WebsiteExtractor
Whacker
Wprecon
Xaldon_WebSpider
Zade
backlink-check
check1.exe
coccocbot
cognitiveseo
crawl.sogou.com
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
iubenda-radar
lwp-request
meanpathbot
muhstik-scan
pcBrowser
plumanalytics
probe-image-size
ripz
satoristudio.net
seostar
sitechecker.pro
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
x09Mozilla
zauba.io