nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-08 10:09:16 +00:00

250 lines
2.5 KiB
Text

404checker
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Alexibot
Alligator
Anthill
Asterias
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Black Hole
BlowFish
Boardreader
Brandprotect
Buck
Buddy
Bullseye
BuzzSumo
CCBot
CODE87
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
Cogentbot
Collector
Crawling at Home Project
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Demon
Deusu
Devil
Dirbuster
Disco
DomainStatsBot
Dotbot
Dragonfly
EirGrabber
EroCrawler
Exabot
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FrontPage
FyberSpider
GT::WWW
Genieo
GetRight
GoZilla
GrapeFX
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
Hloader
IDBTE4M
Iblog
IndeedBot
Indy Library
Intelliseek
Internet Ninja
Iria
JOC Web Spider
JennyBot
JikeSpider
Joomla
JustView
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LieBaoFast
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
MarkWatch
Mata Hari
MauiBot
Metauri
Microsoft URL Control
Minefield
Mister PiX
Mozlila
Musobot
NICErsPRO
Name Intelligence
NetZIP
Netcraft
Nimbostratus
Ninja
Offline Explorer
Offline Navigator
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PageThing.com
Pandalytics
Pavuk
PeoplePal
Picsearch
Piepmatz
Pixray
Pockey
Pump
PxBroker
QueryN Metasearch
RankFlex
RankurBot
Recorder
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
Scanbot
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SemrushBot
SeobilityBot
Site Sucker
SiteExplorer
SiteLockSpider
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Sqlworm
Sucker
SuperBot
Swiftbot
Szukacz
The Intraformant
Trendiction
Trendictionbot
Turingos
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
Voil
Voltron
WBSearchBot
WISENutbot
WPScan
WWW::Mechanize
WallpapersHD
Web Auto
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebBandit
WebCollage
WebCopier
WebEnhancer
WebReaper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Whacker
Woobot
Xenu
Zade
Zermelo
ZmEu
ZoominfoBot
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
clark-crawler
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
heritrix
instabid
ips-agent
lwp-request
meanpathbot
plumanalytics
probe-image-size
seocompany.store
seostar
sitechecker.pro
spyfu
sysscan
tAkeOut
trendiction.com
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io