nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2021-02-04 10:25:12 +02:00

250 lines
2.6 KiB
Text

404checker
Aboundexbot
Acunetix
ADmantX
AiHitBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
AwarioRssBot
AwarioSmartBot
backlink-check
BackWeb
Badass
Barkrowler
BatchFTP
BBBike
BDFetch
BetaBot
Black Hole
BlackWidow
BlowFish
Boardreader
Bolt
Buck
BuiltBotTough
BuzzSumo
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Cloud mapping
com.plumanalytics
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
CrunchBot
CSHttp
Demon
Deusu
Devil
Disco
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
domainsproject.org
EasyDL
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
facebookscraper
FHscan
Fimap
Firefox/7.0
Freeuploader
FyberSpider
GalaxyBot
Getintent
GoZilla
GrabNet
Grafula
GT::WWW
HEADMasterSEO
Heritrix
Hloader
HMView
Humanlinks
Iblog
IDBot
IDBTE4M
Id-search
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
internetVista monitor
IstellaBot
JamesBOT
JennyBot
Jorgee
Kozmosbot
Larbin
LeechFTP
Libwhisker
Lightspeedsystems
Linkbot
LinkextractorPro
LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft URL Control
Mister PiX
MJ12bot
Mojeek
Mojolicious
MQQBrowser
Msrabot
MTRobot
Musobot
Nameprotect
NearSite
netEstate NE Crawler
NetMechanic
Nettrack
Net Vampire
NetZIP
Nibbler
Nikto
NimbleCrawler
Ninja
Nmap
NPbot
Nutch
oBot
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OPPO A33
OrangeSpider
PageAnalyzer
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Panscient
PECL::HTTP
Picscout
PictureFinder
Pimonster
Pi-Monster
ProPowerBot
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankingBot
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
RSSingBot
SBIder
ScanAlert
Scanbot
ScoutJet
Scrapy
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
sexsearcher
Siphon
SISTRIX
sitechecker.pro
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
SMTBot
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spanner
sp_auditbot
Sqworm
Sucker
Sucuri
SuperBot
Surfbot
Suzuran
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
Thumbor
Tracemyfile
Turingos
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Wallpapers/3.0
WASALive-Bot
WebAuto
Web Auto
WebBandit
WebEnhancer
WebFuck
Web Fuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Sauger
WebsiteExtractor
WebStripper
WebSucker
Web Sucker
WebWhacker
Whatweb
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
Wprecon
WPScan
WWW::Mechanize
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zermelo
Zeus
ZoominfoBot
ZyBorg