nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-01 22:07:04 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
AIBOT
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Anarchie
Anarchy
Anarchy99
Ankit
Aspiegel
AwarioSmartBot
BBBike
BDCbot
BDFetch
Backlink-Ceck
BatchFTP
Bigfoot
Blow
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
BunnySlippers
BuzzSumo
CATExplorador
CSHttp
Chlooe
Citoid
Cliqzbot
Cloud mapping
Collector
Copier
Copyscape
Cosmos
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Discobot
Dragonfly
ECCP/1.0
Ebingbong
EroCrawler
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Flunky
FrontPage
FyberSpider
Genieo
GetWeb
Gotit
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
Iblog
IndeedBot
InterGET
Internet Ninja
InternetSeer
Iria
IstellaBot
JetCar
Joomla
JustView
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Nameprotect
Navroad
Nessus
NetLyzer
NetMechanic
Netcraft
NextGenSearchBot
Nikto
Nimbostratus
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Papa Foto
Petalbot
Picscout
Pockey
Pu_iN
Quick-Crawler
RankActive
RankingBot
Re-re
ReGet
RealDownload
Ripper
Rogerbot
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
Scrapy
ScreenerBot
ScrepyBot
SemrushBot
SeobilityBot
Shodan
Siphon
SiteLockSpider
SlySearch
SocialRankIOBot
Sosospider
SpaceBison
Spammen
Spanner
SputnikBot
Sucker
Sucuri
Suzuran
Swiftbot
T0PHackTeam
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Titan
Trendiction
Trendictionbot
TurnitinBot
Typhoeus
URLy.Warning
Upflow
VB Project
VCI
Vagabondo
Virusdie
VoidEYE
WEBDAV
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Pix
WebEnhancer
WebFetch
WebReaper
WebmasterWorldForumBot
Whack
Widow
Wonderbot
Wprecon
Xenu
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
clark-crawler
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
eCatch
evc-batch
instabid
ips-agent
iubenda-radar
lwp-request
magpie-crawler
netEstate NE Crawler
page scorer
polaris version
ripz
satoristudio.net
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
tAkeOut
webprosbot
xpymep1.exe