nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-02 10:09:22 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
ALittle Client
Alexibot
AllSubmitter
Anarchy
Aspiegel
Asterias
Attach
AwarioSmartBot
BDCbot
BacklinkCrawler
Badass
Bandit
BatchFTP
Battleztar Bazinga
Bitacle
Blackboard
BotALot
Brandwatch
Buck
BuiltWith
Bullseye
BuzzSumo
CCBot
CSHttp
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Citoid
Cloud mapping
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
DTS Agent
Deusu
Devil
Discoverybot
Dispatch
DnyzBot
DomCopBot
Download Wonder
EasyDL
Ebingbong
Ecxi
ExtLinksBot
Extractor
Fimap
FlashGet
Flunky
Freeuploader
FyberSpider
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
HaosouSpider
Havij
Heritrix
Humanlinks
HybridBot
Iblog
Image Fetch
Image Sucker
IndeedBot
Intelliseek
Internet Ninja
IstellaBot
JamesBOT
JennyBot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Lanshanbot
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Ltx71
MIDown tool
MJ12bot
MQQBrowser
Mail.RU_Bot
Majestic12
MarkWatch
MeanPath Bot
Meanpathbot
Minefield
Mister PiX
Mojolicious
Mozlila
NICErsPRO
NPbot
Navroad
Nessus
NetMechanic
Netcraft
Netvibes
Niki-bot
Nikto
Nimbostratus
Nutch
Offline Explorer
OpenLinkProfiler
Openfind
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Pavuk
PeoplePal
Petalbot
Picscout
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
ReGet
RealDownload
Reaper
Recorder
SEOprofiler
SEOstats
SMTBot
ScreenerBot
SearchmetricsBot
SemanticJuice
Semrush
SeoSiteCheckup
Siphon
SiteLockSpider
Sitebeam
Siteimprove
SlySearch
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
Sqlmap
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Trendiction
True_Robot
Turingos
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
V-BOT
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
Voltron
WPScan
WWW::Mechanize
Wallpapers/3.0
Web Auto
Web Fetch
Web Sucker
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
Website Quester
WebsiteQuester
Whacker
Widow
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zauba
Zermelo
ZoominfoBot
ZyBorg
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
lwp-request
lwp-trivial
magpie-crawler
muhstik-scan
oBot
plumanalytics
polaris version
ripz
scalaj-http
sp_auditbot
spyfu
tAkeOut
voyagerx.com
webpros.com
x09Mozilla
x22Mozilla
zauba.io