nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-10 22:10:33 +00:00

250 lines
2.6 KiB
Text

ALittle Client
ASPSeek
Acunetix
AhrefsBot
AllSubmitter
Atomseobot
BDCbot
BackStreet
BackWeb
Backlink-Ceck
Barkrowler
BetaBot
Bitacle
Black Hole
Blow
Bolt
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CODE87
Calculon
CazoodleBot
CensysInspect
CherryPicker
Citoid
Cliqzbot
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Curious
CyotekWebCopy
DSearch
DatabaseDriverMysqli
DittoSpyder
DomainAppender
DomainSigmaCrawler
Domains Project
Drip
EMail Wolf
Exabot
Express WebPictures
EyeNetIE
FDM
Firefox/7.0
Flunky
Foobot
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetWeb
Getintent
Gigabot
Go!Zilla
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
Hloader
Humanlinks
HybridBot
IRLbot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iskanie
IstellaBot
Jetty
JikeSpider
Joomla
Jyxobot
Kinza
Kozmosbot
Larbin
LieBaoFast
Lightspeedsystems
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Ltx71
MJ12bot
MTRobot
Magnet
Majestic SEO
Majestic12
MarkMonitor
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Minefield
Moblie Safari
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Needle
Nessus
NetAnts
NetMechanic
NetZIP
Netcraft
NimbleCrawler
Nutch
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
PECL::HTTP
PHPCrawl
PageGrabber
PageThing.com
Pandalytics
Panscient
Pavuk
Pi-Monster
Picsearch
Piepmatz
PleaseCrawl
ProWebWalker
Psbot
Pump
Quick-Crawler
RankingBot
RankurBot
Re-re
Reaper
Recorder
Ripper
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
SemanticJuice
SemrushBot
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitebeam
SmartDownload
Sociscraper
Sosospider
SpaceBison
Spammen
Spanner
SputnikBot
Sqlmap
Sqworm
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T8Abot
Teleport
Telesphoreo
Thumbor
TightTwatBot
Turnitin
TurnitinBot
Typhoeus
URLy Warning
UnisterBot
VCI
Vacuum
Virusdie
VoidEYE
Voil
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Fetch
Web Pix
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebImageCollector
WebReaper
WebSauger
WebStripper
WebWhacker
WebmasterWorldForumBot
Webster
Whatweb
Who.is Bot
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zitebot
ZoominfoBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
crawl.sogou.com
facebookscraper
linkdexbot
magpie-crawler
page scorer
plumanalytics
probe-image-size
scan.lol
seocompany.store
sp_auditbot
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
x22Mozilla
xpymep1.exe
zgrab