nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-20 10:07:02 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
AllSubmitter
AlphaBot
Attach
BDFetch
BlackWidow
Blow
BuzzSumo
CazoodleBot
CensysInspect
Crawling at Home Project
DIIbot
Demon
Devil
Dirbuster
Disco
Dispatch
DomCopBot
DomainSigmaCrawler
Download Wonder
Drip
EMail Wolf
EirGrabber
EroCrawler
Extractor
Extreme Picture Finder
FyberSpider
GalaxyBot
Getintent
Go!Zilla
GrabNet
Heritrix
Iskanie
JamesBOT
Jetty
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LeechGet
Likse
LinqiaScrapeBot
Lipperhey Spider
MIIxpc
MSFrontPage
Mass Downloader
Mb2345Browser
MeanPath Bot
Metauri
Moblie Safari
Morfeus Fucking Scanner
Net Vampire
NetMechanic
NetSpider
Netcraft
Niki-bot
OpenVAS
Page Analyzer
Pi-Monster
Picsearch
PleaseCrawl
Pockey
QueryN Metasearch
RankFlex
Re-re
Reaper
SEOkicks-Robot
SEOstats
Scanbot
ScreenerBot
Searchestate
SemanticJuice
SiteSnagger
SpaceBison
Spammen
Spbot
Surfbot
Szukacz
Telesphoreo
Tracemyfile
VidibleScraper
WASALive-Bot
WWW::Mechanize
Web Auto
Web Collage
WebFuck
WebLeacher
Webalta
Wonderbot
Zermelo
demandbase-bot
domainsproject.org
evc-batch
isitwp.com
omgili
page scorer
scan.lol
seocompany.store
seostar
sp_auditbot