nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-11 10:08:54 +00:00

250 lines
2.6 KiB
Text

404enemy
AIBOT
ASPSeek
Abonti
Aboundexbot
AlphaBot
Anarchy
Ankit
Apexoo
Attach
BBBike
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
BatchFTP
BetaBot
Bigfoot
Blackboard
BlowFish
Boardreader
Bolt
Buddy
BuiltWith
CCBot
CODE87
CSHttp
Cegbfeieh
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Collector
Copier
Cosmos
Crawling at Home Project
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
EMail Siphon
Ecxi
Exabot
Extreme Picture Finder
FHscan
FemtosearchBot
Flunky
Freeuploader
FyberSpider
GT::WWW
GalaxyBot
GermCrawler
Gigabot
Go-Ahead-Got-It
GrabNet
Grabber
HTMLparser
HTTrack
HaosouSpider
Havij
Hloader
HybridBot
IDBTE4M
IDBot
Iblog
IlseBot
Image Sucker
Intelliseek
Internet Ninja
Iskanie
JamesBOT
JetCar
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
Larbin
Leap
LeechGet
LieBaoFast
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
Magnet
MarkWatch
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mister PiX
Mojolicious
Musobot
NICErsPRO
NPbot
Name Intelligence
NearSite
NetAnts
NetMechanic
NetSpider
NetZIP
Netcraft
NimbleCrawler
Nimbostratus
Ninja
Octopus
Offline Explorer
Offline Navigator
Openvas
OrangeBot
OutclicksBot
PHPCrawl
Page Analyzer
PageThing.com
Papa Foto
Pavuk
Petalbot
Pi-Monster
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RankingBot2
Re-re
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOstats
SMTBot
Scanbot
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Semrush
SiteCheckerBotCrawler
SiteSnagger
Sociscraper
Sogou web spider
SpaceBison
Spammen
Sqlworm
SuperBot
Surfbot
Suzuran
T0PHackTeam
Telesphoreo
TightTwatBot
Titan
Toata
Turingos
Turnitin
TurnitinBot
UnisterBot
VB Project
VCI
Vacuum
Vagabondo
Virusdie
Voil
Voltron
WEBDAV
WWWOFFLE
WallpapersHD
Web Collage
Web Fetch
Web Fuck
Web Sucker
WebCollage
WebCopier
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebWhacker
Webalta
Website Quester
WebsiteQuester
Whacker
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba
ZmEu
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
domainsproject.org
gopher
heritrix
ips-agent
magpie-crawler
mediawords
oBot
page scorer
polaris version
s1z.ru
scan.lol
seobility
sexsearcher
sitechecker.pro
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x22Mozilla