nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-17 10:09:15 +00:00

250 lines
2.6 KiB
Text

Aboundex
AiHitBot
AllSubmitter
Alligator
Anarchie
Anthill
Apexoo
Atomseobot
Attach
BBBike
BDFetch
BatchFTP
BetaBot
Bitacle
Black Hole
Blackboard
Blow
Boardreader
Brandprotect
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
Chlooe
Citoid
Copier
Cosmos
Crescent
CrunchBot
DBLBot
DIIbot
DataCha0s
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainCrawler
Domains Project
EMail Siphon
Ebingbong
Evil
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Foobot
G-i-g-a-b-o-t
GT::WWW
GetWeb
Getintent
Gigabot
Go!Zilla
Gotit
GrabNet
GrapeFX
HEADMasterSEO
HMView
HTMLparser
HTTrack
HaosouSpider
Hloader
HonoluluBot
Humanlinks
Id-search
Image Fetch
Intelliseek
IstellaBot
JOC Web Spider
JennyBot
Keybot Translation-Search-Machine
Kinza
Lanshanbot
Larbin
LibWeb
Libwhisker
LieBaoFast
Likse
Linkbot
LinkpadBot
LinksManager
Lipperhey Spider
Litemage_walker
Ltx71
MIIxpc
MJ12bot
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
Masscan
Mata Hari
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft URL Control
Mojolicious
Name Intelligence
NearSite
Needle
Net Vampire
NetAnts
NetSpider
Netvibes
NextGenSearchBot
NimbleCrawler
Nmap
Nuclei
Offline Explorer
OnCrawl
Openfind
Openvas
OrangeSpider
PECL::HTTP
PHPCrawl
PageGrabber
PageThing.com
Papa Foto
Picsearch
Piepmatz
Pixray
Pockey
Pump
PxBroker
RankActive
RankActiveLinkBot
ReGet
Recorder
RedesScrapy
Ripper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
Scrapy
ScreenerBot
ScrepyBot
Seekport
SentiBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Snapbot
Snoopy
Sogou web spider
Spbot
SputnikBot
Sqworm
Steeler
Sucuri
T8Abot
Telesphorep
Titan
Toata
Toweyabot
Tracemyfile
TwengaBot
URLy.Warning
Upflow
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Collage
Web Pix
Web Sauger
WebAuto
WebBandit
WebGo IS
WebPix
WebWhacker
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler4j
evc-batch
heritrix
instabid
ips-agent
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
polaris version
s1z.ru
scan.lol
seobility
sitechecker.pro
siteripz
sysscan
tAkeOut
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla