nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-04 10:09:34 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
ASPSeek
Abonti
Aboundex
AiHitBot
AllSubmitter
AlphaBot
Anarchy
Ankit
Attach
AwarioSmartBot
BDCbot
BDFetch
BetaBot
Black Hole
BlackWidow
Blow
BotALot
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
CODE87
CSHttp
Calculon
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Cosmos
Craftbot
Crawling at Home Project
Crescent
Curious
CyotekWebCopy
DTS Agent
DataCha0s
Deusu
Digincore
DigitalPebble
Discobot
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Drip
FHscan
Fimap
FlashGet
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
GetWeb
Go!Zilla
GrabNet
Grabber
GridBot
HEADMasterSEO
HTTP::Lite
Haansoft
Havij
IRLbot
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
Iria
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey Spider
Litemage_walker
Ltx71
MQQBrowser
MSFrontPage
MSIECrawler
Magnet
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Mojeek
Mojolicious
Morfeus Fucking Scanner
Musobot
NICErsPRO
Nessus
Net Vampire
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Ninja
Not
Offline Navigator
OpenVAS
Openvas
OutfoxBot
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
ProPowerBot
Pu_iN
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot
RankingBot2
Re-re
Recorder
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
ScanAlert
Scanbot
Scrapy
ScrepyBot
Searchestate
SemanticJuice
SentiBot
Seomoz
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Snapbot
Snoopy
SpankBot
Spanner
Spbot
Sqlmap
Sqlworm
Sucker
Sucuri
Swiftbot
T0PHackTeam
Telesphoreo
TightTwatBot
Titan
Trendictionbot
Turingos
TwengaBot
Twice
Typhoeus
Vagabondo
VeriCiteCrawler
Virusdie
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Fuck
Web Sucker
WebBandit
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebWhacker
Website Quester
WebsiteQuester
Whack
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Xaldon WebSpider
Xenu
Zauba
Zermelo
Zitebot
ZoomBot
adscanner
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
demandbase-bot
gopher
isitwp.com
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
pcBrowser
probe-image-size
ripz
s1z.ru
seobility
seoscanners
sexsearcher
sogouspider
sp_auditbot
sysscan
voyagerx.com
webgains-bot
webpros.com
webprosbot
x22Mozilla
zgrab