nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-26 22:07:18 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
AIBOT
ALittle Client
Aboundexbot
AhrefsBot
Alexibot
Anarchie
Anarchy
Apexoo
Asterias
Atomseobot
Attach
BLEXBot
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
BlackWidow
Buck
BuiltWith
BuzzSumo
CherryPicker
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Demon
DigitalPebble
Disco
DittoSpyder
DnyzBot
DomainSigmaCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Wolf
Ecxi
EroCrawler
Evil
Express WebPictures
Extreme Picture Finder
FDM
Firefox/7.0
Flunky
Foobot
FyberSpider
GalaxyBot
GermCrawler
Getintent
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
Havij
HonoluluBot
Humanlinks
Image Sucker
InfoTekies
Intelliseek
InterGET
Jbrofuzz
JennyBot
JetCar
Keyword Density
LNSpiderguy
Larbin
Leap
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
Mister PiX
MolokaiBot
Mozlila
NPbot
Nameprotect
Needle
NetSpider
NetZIP
NextGenSearchBot
Nibbler
Nikto
Nmap
Not
Nuclei
Nutch
Octopus
Offline Explorer
OrangeBot
OutclicksBot
PHPCrawl
PageGrabber
Panscient
PeoplePal
Pi-Monster
Piepmatz
Pimonster
Pixray
Probethenet
Pu_iN
PxBroker
RankFlex
RankingBot2
Rankivabot
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScrepyBot
Searchestate
Seekport
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sitebeam
Siteimprove
SlySearch
SmartDownload
Snapbot
SpaceBison
Spanner
Spbot
Spinn3r
Sqlworm
Sqworm
Steeler
Sucuri
SuperHTTP
SurveyBot
T0PHackTeam
TeleportPro
Telesoft
The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
True_Robot
Turnitin
TurnitinBot
Twice
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
WISENutbot
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
WebBandit
WebCollage
WebCopier
WebFuck
WebSucker
Webalta
WebsiteQuester
Whack
Whacker
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Zermelo
Zitebot
ZmEu
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
domainsproject.org
evc-batch
gopher
instabid
iubenda-radar
lwp-request
meanpathbot
mediawords
muhstik-scan
pcBrowser
plumanalytics
seocompany.store
seoscanners
seostar
sexsearcher
siteripz
sogouspider
tAkeOut
ubermetrics-technologies.com
voyagerx.com
x09Mozilla