nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-11 10:09:30 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
ASPSeek
Abonti
Aboundex
Acunetix
AhrefsBot
Alexibot
AlphaBot
AwarioSmartBot
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
BetaBot
Black Hole
Blackboard
Blow
BotALot
Brandprotect
CODE87
CheeseBot
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cogentbot
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
DomainSigmaCrawler
Download Wonder
ECCP/1.0
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Gigabot
Go!Zilla
GoZilla
Gotit
GrabNet
GrapeFX
Haansoft
HaosouSpider
Harvest
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
IndeedBot
Intelliseek
InterGET
InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
JikeSpider
Jyxobot
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
Larbin
Leap
LeechGet
LibWeb
Libwhisker
LieBaoFast
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Majestic-SEO
MarkMonitor
MarkWatch
MeanPath Bot
Meanpathbot
Mister PiX
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NPbot
Nameprotect
Nessus
NextGenSearchBot
NimbleCrawler
Octopus
OnCrawl
OpenLinkProfiler
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pavuk
Petalbot
Picsearch
Piepmatz
Pimonster
Pixray
ProPowerBot
Probethenet
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SEOstats
SISTRIX
SMTBot
ScoutJet
ScreenerBot
SearchmetricsBot
Seekport
Semrush
SeobilityBot
Shodan
SiteExplorer
SiteSnagger
Siteimprove
SlySearch
Snake
Sociscraper
Sogou web spider
SpankBot
Steeler
Sucker
SuperHTTP
Szukacz
T8Abot
TeleportPro
Telesphoreo
Telesphorep
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
TwengaBot
Twice
URLy Warning
UnisterBot
Upflow
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebGo IS
WebPix
WebSucker
WebsiteQuester
Whacker
WiseGuys Robot
Wonderbot
Woobot
Wprecon
YoudaoBot
Zade
Zermelo
Zeus
archive.org_bot
backlink-check
cah.io.community
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
eCatch
instabid
internetVista monitor
ips-agent
lwp-trivial
meanpathbot
mediawords
oBot
page scorer
plumanalytics
ripz
seocompany.store
seoscanners
seostar
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
trendiction.com
ubermetrics-technologies.com
webgains-bot
webprosbot
zgrab