nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-18 10:09:20 +00:00

250 lines
2.6 KiB
Text

ADmantX
ASPSeek
Abonti
Aboundex
Aipbot
AllSubmitter
Alligator
Anarchie
Anthill
Apexoo
Aspiegel
Attach
BDCbot
BDFetch
BLEXBot
BackStreet
Badass
Bandit
BatchFTP
BetaBot
Bitacle
Black Hole
Blackboard
Blow
Bolt
Brandprotect
Buck
Buddy
CSHttp
Calculon
CheTeam
Cocolyzebot
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Devil
DigitalPebble
Dirbuster
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
Domains Project
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
ExtLinksBot
FHscan
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
Go!Zilla
GrapeFX
GrapeshotCrawler
HTTrack
HaosouSpider
Heritrix
HonoluluBot
Image Sucker
Indy Library
Intelliseek
Internet Ninja
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
LeechGet
LieBaoFast
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
MIIxpc
Mail.RU_Bot
Majestic-SEO
Masscan
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft URL Control
Mister PiX
Mozlila
Mr.4x3
Msrabot
Musobot
Name Intelligence
NetAnts
NetLyzer
NetMechanic
Netcraft
Nettrack
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Not
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Papa Foto
PeoplePal
Petalbot
Picscout
Piepmatz
Pimonster
ProPowerBot
Pump
PyCurl
RSSingBot
RankActive
RankingBot
Re-re
ReGet
Ripper
Rogerbot
SEOlyticsCrawler
Scanbot
ScoutJet
Seekport
SeoSiteCheckup
SiteExplorer
SiteSucker
Sitevigil
Snake
Sogou web spider
Spammen
Spbot
Spinn3r
SputnikBot
Sqlworm
Surfbot
Swiftbot
Teleport
TeleportPro
The Intraformant
TheNomad
Thumbor
Tracemyfile
Trendiction
True_Robot
Turingos
TurnitinBot
Typhoeus
URLy Warning
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Sucker
WebBandit
WebCollage
WebCopier
WebImageCollector
WebReaper
WebWhacker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Webster
Widow
WiseGuys Robot
Wprecon
Xaldon_WebSpider
Zauba
Zermelo
Zeus
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher
instabid
ips-agent
isitwp.com
lwp-trivial
meanpathbot
mediawords
muhstik-scan
oBot
pcBrowser
polaris version
ripz
s1z.ru
scalaj-http
seostar
serpstatbot
siteripz
webpros.com
webprosbot
x09Mozilla
zauba.io